Spec Studio

The runs page shows a run as external evidence from a test file

spec:consumers.spec-studio.runs-page.external-evidenceExample / Scenario · storyready floor ready

Packs: pack:self-hosting-v1, pack:spec-studio-v1

Design: no design entries · no pinned declarations · no decisions

Findings: no errors, no warnings

specs/consumers/spec-studio.runs-page.external-evidence.sdp.md

No open questions and no blocking questions; implementation binding none, verifier binding present, and expected-outcome oracle none.

Intent
outcome
Execute the runs page on one report: the run named by its tool, its results under the test file they join, and no page saying a Spec or a verifier passed.
assumptions
  • The world writes a root with one Spec and one test file holding a specTest anchor that verifies it, writes one CTRF report whose three tests name that file, two passed and one failed, builds the page set with the report as run records, and reads the runs page, then the tests lens and the Spec page for any sentence saying that the Spec or the verifier passed.
Behavior

Examples

Given one CTRF report whose tool is {tool: "vitest"} at version {version: "3.2.4"}, and whose tests in an anchored test file {passed: 2} passed and {failed: 1} failed
When the build renders the runs page
Then the run's heading reads {heading: "Run 1: external run evidence from vitest 3.2.4"}
Then the page lists {rows: 3} results under that test file
Then a page says that a Spec or a verifier passed: {verdict: false}
Verification

Verifier bindings

  • test:protocol.run-external · anchored · test anchor binding present · test/studio-s4.test.ts:378

    External run evidence from test/studio-s4.test.ts

    Test anchors: test:protocol.run-absolute, test:protocol.run-external, test:protocol.run-unjoined, test:protocol.studio-graph-only, test:protocol.studio-inputs-both-given, test:protocol.studio-stamp-apart. Specs verified by those bindings: spec:consumers.spec-studio.data.inputs, spec:consumers.spec-studio.data.inputs.both-given, spec:consumers.spec-studio.data.inputs.graph-only, spec:consumers.spec-studio.runs-page, spec:consumers.spec-studio.runs-page.external-evidence, spec:consumers.spec-studio.sharing, spec:consumers.spec-studio.sharing.stamp-written-apart, spec:observation.run-evidence, spec:observation.run-evidence.absolute-path-joins, spec:observation.run-evidence.unanchored-file-unjoined.

    Run 1: external run evidence from vitest 4.1.10

    Build: CI 380 · Branch: feature/roadmap-and-slices-v0 · Commit: 34909918bf0be0e849959644401797191cae379f · Start: 2026-10-22T17:40:31.456Z · Stop: 2026-10-22T17:42:16.171Z

    NameSuiteResultDuration
    recipe 45 joins normalized paths, preserves records and graph facts, and diagnoses other inputsnot recordedpassed40.92 ms
    renders external run evidence with result rows, metadata, diagnostics and conditional navigationnot recordedpassed67.13 ms
    reads repeated --runs before extraction and leaves input bytes untouchednot recordedpassed77.06 ms
    stamps apart, touches no page, refuses bad sources and removes the stamp on rebuildnot recordedpassed32.06 ms
    executes the bound example against a fresh worldA test whose reporter wrote an absolute path joins its anchored file (spec:observation.run-evidence.absolute-path-joins)passed3.95 ms
    executes the bound example against a fresh worldA test in a file with no test anchor is reported as unjoined (spec:observation.run-evidence.unanchored-file-unjoined)passed8.41 ms
    executes the bound example against a fresh worldThe runs page shows a run as external evidence from a test file (spec:consumers.spec-studio.runs-page.external-evidence)passed12.66 ms
    executes the bound example against a fresh worldWithout inputs the page set is the graph's alone (spec:consumers.spec-studio.data.inputs.graph-only)passed34.33 ms
    executes the bound example against a fresh worldBoth inputs add their pages, named, and the same inputs write the same bytes (spec:consumers.spec-studio.data.inputs.both-given)passed96.39 ms
    executes the bound example against a fresh worldThe stamp is written beside the page set, and a later build removes it (spec:consumers.spec-studio.sharing.stamp-written-apart)passed39.65 ms
    the stamp links source locations only after an HTTP stamp loads, encoding path segmentsnot recordedpassed7.34 ms
    recipe 45 picks the longest suffix and scopes through enabled examples at file grainnot recordedpassed11.36 ms
    ships a reusable preview, disabled by default, and deploys its own pull requests with runs and diffnot recordedpassed14.97 ms
    the tests lens counts file results once per Spec and names every run inputnot recordedpassed27.49 ms
    the Pack sentence keeps the graph's binding limit and positively names external evidencenot recordedpassed16.99 ms
    run metadata labels build and branch, and absent fields read not recordednot recordedpassed0.47 ms
    unjoined records escape outside names and explain both reason codes in wordsnot recordedpassed11.52 ms
    run files show the file alone, bindings and Suite, with one header per runnot recordedpassed15.6 ms
    recipe 45 does not join a suffix inside a path segmentnot recordedpassed3.52 ms
    stamp defaults to unknown and a stamped page set passes check-cleannot recordedpassed53.15 ms
    every reusable preview job's permissions fit the CI caller's grantnot recordedpassed15.05 ms
    PR checks and preview stamps name the same default merge checkoutnot recordedpassed8 ms
    preview download is optional and cancelled or skipped checks do not call itnot recordedpassed5.14 ms
    deploy checks the enabled Pages source before writing: gh-pagesnot recordedpassed19.63 ms
    deploy checks the enabled Pages source before writing: mainnot recordedpassed30.39 ms
    deploy checks the enabled Pages source before writing: disablednot recordedpassed17.67 ms
    deploy succeeds only once Pages publishes the pushed commit: an unrelated errored build is newestnot recordedpassed140.26 ms
    deploy succeeds only once Pages publishes the pushed commit: a retried build follows an errored onenot recordedpassed28.04 ms
    deploy succeeds only once Pages publishes the pushed commit: the build errorsnot recordedpassed54.7 ms
    deploy succeeds only once Pages publishes the pushed commit: the commit is never builtnot recordedpassed180.31 ms
    deploy succeeds only once Pages publishes the pushed commit: the answer arrives after the waitnot recordedpassed1540.7 ms
    preview still stamps and uploads rendered pages when evidence is absent and validation failsnot recordedpassed59.93 ms
    places external file rows under their verifier and renders shared files oncenot recordedpassed35.82 ms
    accepts the preview workflow's base and run flags togethernot recordedpassed18.01 ms
    formats external run durations to at most two decimals on every pagenot recordedpassed10.89 ms
Design view

Requirement drawing

  • Satisfying or referencing units: no recorded binding.
Requirement drawing for spec:consumers.spec-studio.runs-page.external-evidence
The diagram as text
  • spec:consumers.spec-studio.runs-page.external-evidence: The runs page shows a run as external evidence from a test file · declared Spec
  • spec:consumers.spec-studio.runs-page: The runs page shows the run records the build was given, joined to test files · declared Spec
  • test:protocol.run-external: test:protocol.run-external · anchored test binding · binding present · test/studio-s4.test.ts:378
  • spec:consumers.spec-studio.runs-page.external-evidence refines spec:consumers.spec-studio.runs-page · declared
  • spec:consumers.spec-studio.runs-page.external-evidence verifies spec:consumers.spec-studio.runs-page · declared
  • test:protocol.run-external verifies spec:consumers.spec-studio.runs-page.external-evidence · anchored
Mermaid source

Copyable source; the Studio draws static SVG.

Preferred and chosen syntax: requirementDiagram; exact refines, satisfies and verifies, with claim words in nodes and per-edge comments.

Decisions

No decision record named.

Runtime

No implementation neighborhood recorded.

Runtime observation: not tracked.

Evidence

Runtime observation: not tracked.

Build attestations: not tracked.

Deployments: not tracked.

Bills of materials: not tracked.

Impact
Relations of spec:consumers.spec-studio.runs-page.external-evidence
  • E2: verifies · declared
The diagram as text
  • spec:consumers.spec-studio.runs-page: The runs page shows the run records the build was given, joined to test files
  • spec:consumers.spec-studio.runs-page.external-evidence: The runs page shows a run as external evidence from a test file
  • spec:consumers.spec-studio.runs-page.external-evidence refines spec:consumers.spec-studio.runs-page · declared
  • spec:consumers.spec-studio.runs-page.external-evidence verifies spec:consumers.spec-studio.runs-page · declared
Mermaid source

Copyable source; the Studio draws static SVG.

Preferred syntax: flowchart. Chosen syntax: labelled flowchart, preserving exact relations, claims and folds.

Rests on

Rested on by

No Spec rests on this Spec.

Relations

Relation and directionOther endClaimReasonExercised keys
refines · outgoingThe runs page shows the run records the build was given, joined to test files
spec:consumers.spec-studio.runs-page · resolves
declaredNoneNone
verifies · outgoingThe runs page shows the run records the build was given, joined to test files
spec:consumers.spec-studio.runs-page · resolves
declaredNonenamesEachRun, externalEvidence, runSections

Bindings

Implementation binding: none

Design reference: none

Verifier binding: present

  • test:protocol.run-external · anchored · test/studio-s4.test.ts:378 · test anchor

Expected-outcome oracle: none

Runtime observation: not tracked.

Run results: not recorded in the graph.

Findings

None.

Composing (0)

Composing needs the script.