Full-stack acceptance campaign

Runner Full-Stack E2E

A browser-verified matrix of runner profiles, execution environments, and deterministic task contracts. Declared PNG screenshots and sanitized structured evidence are retained with every published campaign; additional diagnostic evidence remains in the access-controlled workflow artifact.

11/12Passed

1Failed

28m 7sTest time

703,390Input tokens

93,688Output tokens

7,650,392Cached tokens

$8.3096LLM reported subtotal

$0.000000Daytona list estimate

24m 36sAgent execution time

0msDaytona lease time

26/26Runs provider-priced

Model spend is the provider-reported subtotal; unpriced or unavailable runs are excluded, never counted as free. Daytona runtime is a public-list-price estimate from captured lease time and pinned resources, before credits, discounts, storage allowance, or invoice adjustments. Local execution has no external runtime meter.

Search tests Agent profile Environment Suite Status

Test suite

Everyday Paperclip Work

Real user requests, useful downloaded work, and durable continuation using production instructions.

Configuration matrix3 profiles · 2 environments · 0 selected

Agent profile	Isolated locallocal · local	Daytona warm reusable sandboxdaytona · remote
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Build, download, and revise a project not selected `everyday-workflows.runner-codex.local.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-codex.local.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Hire one teammate, then reuse that agent not selected `everyday-workflows.runner-codex.local.hire-reuse` Matchers and test context Not selected No matcher result was recorded. Use a connection after approval not selected `everyday-workflows.runner-codex.local.service-approve` Matchers and test context Not selected No matcher result was recorded. Respect a declined tool action not selected `everyday-workflows.runner-codex.local.service-decline` Matchers and test context Not selected No matcher result was recorded. Respect Not now on a new connection not selected `everyday-workflows.runner-codex.local.connection-decline` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-codex.local.recover-controller` Matchers and test context Not selected No matcher result was recorded. Stop a task and send a new direction once not selected `everyday-workflows.runner-codex.local.stop-redirect` Matchers and test context Not selected No matcher result was recorded.	Daytona warm reusable sandboxdaytona · remote Build, download, and revise a project not selected `everyday-workflows.runner-codex.daytona.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-codex.daytona.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-codex.daytona.recover-controller` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Build, download, and revise a project not selected `everyday-workflows.runner-acpx-claude.local.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-acpx-claude.local.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Hire one teammate, then reuse that agent not selected `everyday-workflows.runner-acpx-claude.local.hire-reuse` Matchers and test context Not selected No matcher result was recorded. Use a connection after approval not selected `everyday-workflows.runner-acpx-claude.local.service-approve` Matchers and test context Not selected No matcher result was recorded. Respect a declined tool action not selected `everyday-workflows.runner-acpx-claude.local.service-decline` Matchers and test context Not selected No matcher result was recorded. Respect Not now on a new connection not selected `everyday-workflows.runner-acpx-claude.local.connection-decline` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-acpx-claude.local.recover-controller` Matchers and test context Not selected No matcher result was recorded. Stop a task and send a new direction once not selected `everyday-workflows.runner-acpx-claude.local.stop-redirect` Matchers and test context Not selected No matcher result was recorded.	Daytona warm reusable sandboxdaytona · remote Build, download, and revise a project not selected `everyday-workflows.runner-acpx-claude.daytona.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-acpx-claude.daytona.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-acpx-claude.daytona.recover-controller` Matchers and test context Not selected No matcher result was recorded.
Runner Codex Mininativecodex · gpt-5.4-mini	Isolated locallocal · local Build, download, and revise a project not selected `everyday-workflows.runner-codex-mini.local.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-codex-mini.local.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Hire one teammate, then reuse that agent not selected `everyday-workflows.runner-codex-mini.local.hire-reuse` Matchers and test context Not selected No matcher result was recorded. Use a connection after approval not selected `everyday-workflows.runner-codex-mini.local.service-approve` Matchers and test context Not selected No matcher result was recorded. Respect a declined tool action not selected `everyday-workflows.runner-codex-mini.local.service-decline` Matchers and test context Not selected No matcher result was recorded. Respect Not now on a new connection not selected `everyday-workflows.runner-codex-mini.local.connection-decline` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-codex-mini.local.recover-controller` Matchers and test context Not selected No matcher result was recorded. Stop a task and send a new direction once not selected `everyday-workflows.runner-codex-mini.local.stop-redirect` Matchers and test context Not selected No matcher result was recorded.	Daytona warm reusable sandboxdaytona · remote

Test suite

Persistent Agent Chat

Task-backed conversations, session resets, and project plan handoff.

Configuration matrix4 profiles · 1 environments · 0 selected

Agent profile	Isolated locallocal · local
Legacy Codexlegacycodex · gpt-5.6-sol	Isolated locallocal · local Conversation continuity across restart not selected `agent-chat.legacy-codex.local.continuity-restart` Matchers and test context Not selected No matcher result was recorded. Fresh context within preserved history not selected `agent-chat.legacy-codex.local.new-session` Matchers and test context Not selected No matcher result was recorded. Stop, reset, and resume not selected `agent-chat.legacy-codex.local.stop-new-resume` Matchers and test context Not selected No matcher result was recorded. Draft, revise, approve, and hand off a plan not selected `agent-chat.legacy-codex.local.plan-handoff` Matchers and test context Not selected No matcher result was recorded. Clarify and reuse an existing project not selected `agent-chat.legacy-codex.local.clarify-reuse` Matchers and test context Not selected No matcher result was recorded. Create a project with multiple repository URLs not selected `agent-chat.legacy-codex.local.multi-repository` Matchers and test context Not selected No matcher result was recorded.
Legacy Claudelegacyclaude · claude-sonnet-4-6	Isolated locallocal · local Conversation continuity across restart not selected `agent-chat.legacy-claude.local.continuity-restart` Matchers and test context Not selected No matcher result was recorded. Fresh context within preserved history not selected `agent-chat.legacy-claude.local.new-session` Matchers and test context Not selected No matcher result was recorded. Stop, reset, and resume not selected `agent-chat.legacy-claude.local.stop-new-resume` Matchers and test context Not selected No matcher result was recorded. Draft, revise, approve, and hand off a plan not selected `agent-chat.legacy-claude.local.plan-handoff` Matchers and test context Not selected No matcher result was recorded. Clarify and reuse an existing project not selected `agent-chat.legacy-claude.local.clarify-reuse` Matchers and test context Not selected No matcher result was recorded. Create a project with multiple repository URLs not selected `agent-chat.legacy-claude.local.multi-repository` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Conversation continuity across restart not selected `agent-chat.runner-codex.local.continuity-restart` Matchers and test context Not selected No matcher result was recorded. Fresh context within preserved history not selected `agent-chat.runner-codex.local.new-session` Matchers and test context Not selected No matcher result was recorded. Stop, reset, and resume not selected `agent-chat.runner-codex.local.stop-new-resume` Matchers and test context Not selected No matcher result was recorded. Draft, revise, approve, and hand off a plan not selected `agent-chat.runner-codex.local.plan-handoff` Matchers and test context Not selected No matcher result was recorded. Clarify and reuse an existing project not selected `agent-chat.runner-codex.local.clarify-reuse` Matchers and test context Not selected No matcher result was recorded. Create a project with multiple repository URLs not selected `agent-chat.runner-codex.local.multi-repository` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Conversation continuity across restart not selected `agent-chat.runner-acpx-claude.local.continuity-restart` Matchers and test context Not selected No matcher result was recorded. Fresh context within preserved history not selected `agent-chat.runner-acpx-claude.local.new-session` Matchers and test context Not selected No matcher result was recorded. Stop, reset, and resume not selected `agent-chat.runner-acpx-claude.local.stop-new-resume` Matchers and test context Not selected No matcher result was recorded. Draft, revise, approve, and hand off a plan not selected `agent-chat.runner-acpx-claude.local.plan-handoff` Matchers and test context Not selected No matcher result was recorded. Clarify and reuse an existing project not selected `agent-chat.runner-acpx-claude.local.clarify-reuse` Matchers and test context Not selected No matcher result was recorded. Create a project with multiple repository URLs not selected `agent-chat.runner-acpx-claude.local.multi-repository` Matchers and test context Not selected No matcher result was recorded.

Test suite

Core Runner Compatibility

Major provider, runtime generation, and execution-environment compatibility.

Configuration matrix7 profiles · 2 environments · 0 selected

Agent profile	Isolated locallocal · local	Daytona sandboxdaytona · remote
Legacy Codexlegacycodex · gpt-5.6-sol	Isolated locallocal · local Basic response not selected `core-compatibility.legacy-codex.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-codex.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-codex.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.legacy-codex.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-codex.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-codex.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Legacy Claudelegacyclaude · claude-sonnet-4-6	Isolated locallocal · local Basic response not selected `core-compatibility.legacy-claude.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-claude.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-claude.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.legacy-claude.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-claude.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-claude.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Legacy OpenCodelegacyopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Basic response not selected `core-compatibility.legacy-opencode.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-opencode.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-opencode.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.legacy-opencode.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-opencode.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-opencode.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Basic response not selected `core-compatibility.runner-codex.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-codex.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-codex.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.runner-codex.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-codex.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-codex.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Runner OpenCodenativeopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Basic response not selected `core-compatibility.runner-opencode.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-opencode.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-opencode.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.runner-opencode.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-opencode.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-opencode.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Basic response not selected `core-compatibility.runner-acpx-claude.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-acpx-claude.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-acpx-claude.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.runner-acpx-claude.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-acpx-claude.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-acpx-claude.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Codexnativeacpx · gpt-5.6-sol	Isolated locallocal · local Basic response not selected `core-compatibility.runner-acpx-codex.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-acpx-codex.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-acpx-codex.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.runner-acpx-codex.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-acpx-codex.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-acpx-codex.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.

Test suite

Local Session Integrity

Structured interaction and continuation qualification for every supported local profile.

Configuration matrix7 profiles · 1 environments · 0 selected

Agent profile	Isolated locallocal · local
Legacy Codexlegacycodex · gpt-5.6-sol	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.legacy-codex.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.legacy-codex.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Legacy Claudelegacyclaude · claude-sonnet-4-6	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.legacy-claude.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.legacy-claude.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Legacy OpenCodelegacyopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.legacy-opencode.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.legacy-opencode.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.runner-codex.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.runner-codex.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Runner OpenCodenativeopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.runner-opencode.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.runner-opencode.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.runner-acpx-claude.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.runner-acpx-claude.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Codexnativeacpx · gpt-5.6-sol	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.runner-acpx-codex.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.runner-acpx-codex.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.

Test suite

OpenRouter Model Breadth

Weekly-ranked tool-capable OpenRouter models through native OpenCode on isolated local workspaces.

Configuration matrix4 profiles · 1 environments · 0 selected

Agent profile	Isolated locallocal · local
#1 DeepSeek V4 Flash 0731nativeopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-deepseek-deepseek-v4-flash-0731.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-deepseek-deepseek-v4-flash-0731.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded.
#3 Tencent HY 3nativeopencode · openrouter/tencent/hy3	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-tencent-hy3.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-tencent-hy3.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded.
#4 Nemotron 3 Ultra 550B A55B (free)nativeopencode · openrouter/nvidia/nemotron-3-ultra-550b-a55b:free	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded. Plan, approve, complete not selected `openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.plan-approve-complete` Matchers and test context Not selected No matcher result was recorded.
#5 GPT-5.6 Lunanativeopencode · openrouter/openai/gpt-5.6-luna	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded. Plan, approve, complete not selected `openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.plan-approve-complete` Matchers and test context Not selected No matcher result was recorded.

Test suite

Daytona Warm Continuity

Three browser-driven turns on one reusable Daytona sandbox for legacy and native Codex.

Configuration matrix2 profiles · 1 environments · 0 selected

Agent profile	Daytona warm reusable sandboxdaytona · remote
Legacy Codexlegacycodex · gpt-5.6-sol	Daytona warm reusable sandboxdaytona · remote Warm three-turn workspace continuity not selected `daytona-warm-continuity.legacy-codex.daytona.warm-three-turn` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Daytona warm reusable sandboxdaytona · remote Warm three-turn workspace continuity not selected `daytona-warm-continuity.runner-codex.daytona.warm-three-turn` Matchers and test context Not selected No matcher result was recorded.

Test suite

first-task

Suite discovered from retained campaign identities; full suite size is not known to this publisher.

Pass rate91.7%11/12 passed

Tokens8,447,470703,390 input · 93,688 output

Cost$8.3096reported LLM + runtime estimate

Agent time24m 36s0ms lease

Execution12/120 retries · cleanup passed

Configuration matrix1 profiles · 1 environments · 12 selected

Agent profile Isolated locallocal · local

Legacy Claudelegacyclaude · claude-sonnet-4-6

Isolated locallocal · local

interview-first-response passed

Tokens19,796 in · 2,810 out184,292 cached · 1/1 runs covered

LLM spend$0.29061/1 runs provider-priced

ExecutionLocal · not metered50s agent

first-task.legacy-claude.local.interview-first-response

Matchers and test context

Attempt: 1
Duration: 1m 22s
Agent runtime: 50s
Runtime: legacy
Provider: claude
Model: claude-opus-5
Issue: FIR-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.interview-questions","expected":true}	One structured interview with 3–4 questions
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-premature-work","expected":true}	Before acceptance: no hires, execution tasks, finished output, or claimed completion; closing an unexecuted rejected task is allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 1,
      "inputTokens": 19796,
      "outputTokens": 2810,
      "cachedInputTokens": 184292,
      "totalTokens": 206898,
      "reportedCostUsd": 0.290605,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 49846,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0.290605,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0.290605,
    "complete": true
  },
  "rawUsage": {
    "model": "claude-opus-5",
    "biller": "anthropic",
    "costUsd": 0.290605,
    "provider": "anthropic",
    "costStatus": "reported",
    "billingType": "metered_api",
    "inputTokens": 19796,
    "usageSource": "per_run",
    "freshSession": true,
    "outputTokens": 2810,
    "sessionReused": false,
    "rawInputTokens": 19796,
    "sessionRotated": false,
    "configFreshness": {
      "session": {
        "reset": false,
        "categories": [
          "adapter",
          "adapterConfig",
          "agentRuntimeConfig",
          "instructions",
          "issueOverrides",
          "workspaceConfig",
          "environment",
          "envBindings",
          "secrets",
          "runtimeSkills"
        ],
        "resetReasons": [],
        "nextFingerprint": "v1:sha256:178f85ec66529ce9af0a1d851a701fc9297afebfa7e968171c3fd07bb0965080",
        "changedCategories": [],
        "taskSessionReused": false,
        "fingerprintVersion": 1,
        "taskSessionAvailable": false,
        "storedFingerprintPresent": false
      },
      "version": 1,
      "workspace": {
        "action": "create",
        "reasons": [],
        "categories": [
          "mode",
          "projectWorkspace",
          "strategy",
          "repo",
          "lifecycleCommands",
          "runtimeServices",
          "environment",
          "realization"
        ],
        "reuseRequested": false,
        "nextFingerprint": "v1:sha256:1fe6111275435a382f117cb226b0ad271c3772b6c4c8530ac73cc0bd9d847bcd",
        "workspaceReused": false,
        "activeWorkspaceId": "1db10cac-6c60-4f67-abac-2f0596f0edb3",
        "changedCategories": [],
        "storedFingerprint": null,
        "fingerprintVersion": 1,
        "inferredFingerprint": null,
        "previousWorkspaceId": null,
        "configSnapshotRefreshed": false,
        "storedFingerprintPresent": false
      }
    },
    "rawOutputTokens": 2810,
    "cachedInputTokens": 184292,
    "taskSessionReused": false,
    "persistedSessionId": "d3990af8-6f3d-4846-910c-7357e5becf7a",
    "cacheAdjustedCostUsd": 0.290605,
    "rawCachedInputTokens": 184292,
    "sessionRotationReason": null
  }
}

clear-task-first-response passed

Tokens44,447 in · 3,606 out353,526 cached · 1/1 runs covered

LLM spend$0.54931/1 runs provider-priced

ExecutionLocal · not metered57s agent

first-task.legacy-claude.local.clear-task-first-response

Matchers and test context

Attempt: 1
Duration: 1m 29s
Agent runtime: 57s
Runtime: legacy
Provider: claude
Model: claude-opus-5
Issue: FIR-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.subtask-proposal","expected":true}	Propose a task for the concrete request
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-premature-work","expected":true}	Before acceptance: no hires, execution tasks, finished output, or claimed completion; closing an unexecuted rejected task is allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 1,
      "inputTokens": 44447,
      "outputTokens": 3606,
      "cachedInputTokens": 353526,
      "totalTokens": 401579,
      "reportedCostUsd": 0.5492582500000001,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 57324,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0.5492582500000001,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0.5492582500000001,
    "complete": true
  },
  "rawUsage": {
    "model": "claude-opus-5",
    "biller": "anthropic",
    "costUsd": 0.5492582500000001,
    "provider": "anthropic",
    "costStatus": "reported",
    "billingType": "metered_api",
    "inputTokens": 44447,
    "usageSource": "per_run",
    "freshSession": true,
    "outputTokens": 3606,
    "sessionReused": false,
    "rawInputTokens": 44447,
    "sessionRotated": false,
    "configFreshness": {
      "session": {
        "reset": false,
        "categories": [
          "adapter",
          "adapterConfig",
          "agentRuntimeConfig",
          "instructions",
          "issueOverrides",
          "workspaceConfig",
          "environment",
          "envBindings",
          "secrets",
          "runtimeSkills"
        ],
        "resetReasons": [],
        "nextFingerprint": "v1:sha256:ab58a7e537cf161b9c1766063f365cede594f0d5672f1f22becaf463dabfced1",
        "changedCategories": [],
        "taskSessionReused": false,
        "fingerprintVersion": 1,
        "taskSessionAvailable": false,
        "storedFingerprintPresent": false
      },
      "version": 1,
      "workspace": {
        "action": "create",
        "reasons": [],
        "categories": [
          "mode",
          "projectWorkspace",
          "strategy",
          "repo",
          "lifecycleCommands",
          "runtimeServices",
          "environment",
          "realization"
        ],
        "reuseRequested": false,
        "nextFingerprint": "v1:sha256:346ec3ae44b747d7ea35dec6254791a957e3d93cd2b127acf9eccdf4caffe0d1",
        "workspaceReused": false,
        "activeWorkspaceId": "2bb3ca96-7a33-4a77-9a00-f933fdf43da2",
        "changedCategories": [],
        "storedFingerprint": null,
        "fingerprintVersion": 1,
        "inferredFingerprint": null,
        "previousWorkspaceId": null,
        "configSnapshotRefreshed": false,
        "storedFingerprintPresent": false
      }
    },
    "rawOutputTokens": 3606,
    "cachedInputTokens": 353526,
    "taskSessionReused": false,
    "persistedSessionId": "75c87656-7c8f-4ca0-aebe-da8cbb003217",
    "cacheAdjustedCostUsd": 0.5492582500000001,
    "rawCachedInputTokens": 353526,
    "sessionRotationReason": null
  }
}

ambiguous-task-first-response passed

Tokens24,773 in · 3,003 out151,277 cached · 1/1 runs covered

LLM spend$0.31001/1 runs provider-priced

ExecutionLocal · not metered46s agent

first-task.legacy-claude.local.ambiguous-task-first-response

Matchers and test context

Attempt: 1
Duration: 1m 18s
Agent runtime: 46s
Runtime: legacy
Provider: claude
Model: claude-opus-5
Issue: FIR-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.focused-clarification","expected":true}	Ask focused questions before proposing ambiguous work
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-premature-work","expected":true}	Before acceptance: no hires, execution tasks, finished output, or claimed completion; closing an unexecuted rejected task is allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 1,
      "inputTokens": 24773,
      "outputTokens": 3003,
      "cachedInputTokens": 151277,
      "totalTokens": 179053,
      "reportedCostUsd": 0.31004975,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 46053,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0.31004975,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0.31004975,
    "complete": true
  },
  "rawUsage": {
    "model": "claude-opus-5",
    "biller": "anthropic",
    "costUsd": 0.31004975,
    "provider": "anthropic",
    "costStatus": "reported",
    "billingType": "metered_api",
    "inputTokens": 24773,
    "usageSource": "per_run",
    "freshSession": true,
    "outputTokens": 3003,
    "sessionReused": false,
    "rawInputTokens": 24773,
    "sessionRotated": false,
    "configFreshness": {
      "session": {
        "reset": false,
        "categories": [
          "adapter",
          "adapterConfig",
          "agentRuntimeConfig",
          "instructions",
          "issueOverrides",
          "workspaceConfig",
          "environment",
          "envBindings",
          "secrets",
          "runtimeSkills"
        ],
        "resetReasons": [],
        "nextFingerprint": "v1:sha256:61acdea03371ec4ef6013ef2721697c143006514d4a9e8b53ae6a3904d65268d",
        "changedCategories": [],
        "taskSessionReused": false,
        "fingerprintVersion": 1,
        "taskSessionAvailable": false,
        "storedFingerprintPresent": false
      },
      "version": 1,
      "workspace": {
        "action": "create",
        "reasons": [],
        "categories": [
          "mode",
          "projectWorkspace",
          "strategy",
          "repo",
          "lifecycleCommands",
          "runtimeServices",
          "environment",
          "realization"
        ],
        "reuseRequested": false,
        "nextFingerprint": "v1:sha256:e4cfe6136fe0e70359cfd0e7bf6eb3565f38b7059d36ed2d73beecc644c8ccc4",
        "workspaceReused": false,
        "activeWorkspaceId": "bcf7a47e-c080-46e3-b971-da9bf9d2249c",
        "changedCategories": [],
        "storedFingerprint": null,
        "fingerprintVersion": 1,
        "inferredFingerprint": null,
        "previousWorkspaceId": null,
        "configSnapshotRefreshed": false,
        "storedFingerprintPresent": false
      }
    },
    "rawOutputTokens": 3003,
    "cachedInputTokens": 151277,
    "taskSessionReused": false,
    "persistedSessionId": "0b47a423-12cf-458a-9cf9-c544c7e34d02",
    "cacheAdjustedCostUsd": 0.31004975,
    "rawCachedInputTokens": 151277,
    "sessionRotationReason": null
  }
}

plain-message-first-response passed

Tokens22,809 in · 2,349 out146,552 cached · 1/1 runs covered

LLM spend$0.27941/1 runs provider-priced

ExecutionLocal · not metered40s agent

first-task.legacy-claude.local.plain-message-first-response

Matchers and test context

Attempt: 1
Duration: 1m 12s
Agent runtime: 40s
Runtime: legacy
Provider: claude
Model: claude-opus-5
Issue: FIR-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.subtask-proposal","expected":true}	Propose a task for the concrete request
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-premature-work","expected":true}	Before acceptance: no hires, execution tasks, finished output, or claimed completion; closing an unexecuted rejected task is allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 1,
      "inputTokens": 22809,
      "outputTokens": 2349,
      "cachedInputTokens": 146552,
      "totalTokens": 171710,
      "reportedCostUsd": 0.27942425,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 40056,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0.27942425,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0.27942425,
    "complete": true
  },
  "rawUsage": {
    "model": "claude-opus-5",
    "biller": "anthropic",
    "costUsd": 0.27942425,
    "provider": "anthropic",
    "costStatus": "reported",
    "billingType": "metered_api",
    "inputTokens": 22809,
    "usageSource": "per_run",
    "freshSession": true,
    "outputTokens": 2349,
    "sessionReused": false,
    "rawInputTokens": 22809,
    "sessionRotated": false,
    "configFreshness": {
      "session": {
        "reset": false,
        "categories": [
          "adapter",
          "adapterConfig",
          "agentRuntimeConfig",
          "instructions",
          "issueOverrides",
          "workspaceConfig",
          "environment",
          "envBindings",
          "secrets",
          "runtimeSkills"
        ],
        "resetReasons": [],
        "nextFingerprint": "v1:sha256:75139d39db2c466988072850d568821b7a7589fd8c71a1fb273901da75b6023f",
        "changedCategories": [],
        "taskSessionReused": false,
        "fingerprintVersion": 1,
        "taskSessionAvailable": false,
        "storedFingerprintPresent": false
      },
      "version": 1,
      "workspace": {
        "action": "create",
        "reasons": [],
        "categories": [
          "mode",
          "projectWorkspace",
          "strategy",
          "repo",
          "lifecycleCommands",
          "runtimeServices",
          "environment",
          "realization"
        ],
        "reuseRequested": false,
        "nextFingerprint": "v1:sha256:d55cd4df4b3156477fff3080f566617dad96ec14f0aed8a7d68bc54bdd4d4cab",
        "workspaceReused": false,
        "activeWorkspaceId": "d93f8548-b096-4a23-b594-1be4efbb5dc9",
        "changedCategories": [],
        "storedFingerprint": null,
        "fingerprintVersion": 1,
        "inferredFingerprint": null,
        "previousWorkspaceId": null,
        "configSnapshotRefreshed": false,
        "storedFingerprintPresent": false
      }
    },
    "rawOutputTokens": 2349,
    "cachedInputTokens": 146552,
    "taskSessionReused": false,
    "persistedSessionId": "59039577-f717-4d63-afe8-30a8927921b8",
    "cacheAdjustedCostUsd": 0.27942425,
    "rawCachedInputTokens": 146552,
    "sessionRotationReason": null
  }
}

plan-first-response passed

Tokens44,970 in · 4,750 out259,298 cached · 1/1 runs covered

LLM spend$0.53411/1 runs provider-priced

ExecutionLocal · not metered1m 11s agent

first-task.legacy-claude.local.plan-first-response

Matchers and test context

Attempt: 1
Duration: 1m 42s
Agent runtime: 1m 11s
Runtime: legacy
Provider: claude
Model: claude-opus-5
Issue: FIR-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.durable-plan","expected":true}	Save the requested plan before acceptance
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-premature-work","expected":true}	Before acceptance: no hires, execution tasks, finished output, or claimed completion; closing an unexecuted rejected task is allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 1,
      "inputTokens": 44970,
      "outputTokens": 4750,
      "cachedInputTokens": 259298,
      "totalTokens": 309018,
      "reportedCostUsd": 0.534145,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 70787,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0.534145,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0.534145,
    "complete": true
  },
  "rawUsage": {
    "model": "claude-opus-5",
    "biller": "anthropic",
    "costUsd": 0.534145,
    "provider": "anthropic",
    "costStatus": "reported",
    "billingType": "metered_api",
    "inputTokens": 44970,
    "usageSource": "per_run",
    "freshSession": true,
    "outputTokens": 4750,
    "sessionReused": false,
    "rawInputTokens": 44970,
    "sessionRotated": false,
    "configFreshness": {
      "session": {
        "reset": false,
        "categories": [
          "adapter",
          "adapterConfig",
          "agentRuntimeConfig",
          "instructions",
          "issueOverrides",
          "workspaceConfig",
          "environment",
          "envBindings",
          "secrets",
          "runtimeSkills"
        ],
        "resetReasons": [],
        "nextFingerprint": "v1:sha256:2da64c07cf02a9d57e2bba4f22cc95f47728fb3db28bd1bb136c4458e74a2470",
        "changedCategories": [],
        "taskSessionReused": false,
        "fingerprintVersion": 1,
        "taskSessionAvailable": false,
        "storedFingerprintPresent": false
      },
      "version": 1,
      "workspace": {
        "action": "create",
        "reasons": [],
        "categories": [
          "mode",
          "projectWorkspace",
          "strategy",
          "repo",
          "lifecycleCommands",
          "runtimeServices",
          "environment",
          "realization"
        ],
        "reuseRequested": false,
        "nextFingerprint": "v1:sha256:0911ac0e64926a875fe4b94c9fe7506b50dde672f03ba49846e0bdef78e9aa30",
        "workspaceReused": false,
        "activeWorkspaceId": "e38f74cd-e71f-4fb0-95c4-5225022adf4b",
        "changedCategories": [],
        "storedFingerprint": null,
        "fingerprintVersion": 1,
        "inferredFingerprint": null,
        "previousWorkspaceId": null,
        "configSnapshotRefreshed": false,
        "storedFingerprintPresent": false
      }
    },
    "rawOutputTokens": 4750,
    "cachedInputTokens": 259298,
    "taskSessionReused": false,
    "persistedSessionId": "1f7588a6-4e00-43a5-be0c-d13bfedf0bad",
    "cacheAdjustedCostUsd": 0.534145,
    "rawCachedInputTokens": 259298,
    "sessionRotationReason": null
  }
}

ordinary-task-control passed

Tokens15,139 in · 2,425 out123,593 cached · 1/1 runs covered

LLM spend$0.22121/1 runs provider-priced

ExecutionLocal · not metered38s agent

first-task.legacy-claude.local.ordinary-task-control

Matchers and test context

Attempt: 1
Duration: 1m 22s
Agent runtime: 38s
Runtime: legacy
Provider: claude
Model: claude-opus-5
Issue: FIR-2

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.ordinary-task-control","expected":true}	Ordinary work produces output without onboarding questions or delegation
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 1,
      "inputTokens": 15139,
      "outputTokens": 2425,
      "cachedInputTokens": 123593,
      "totalTokens": 141157,
      "reportedCostUsd": 0.22117425,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 37902,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0.22117425,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0.22117425,
    "complete": true
  },
  "rawUsage": {
    "model": "claude-opus-5",
    "biller": "anthropic",
    "costUsd": 0.22117425,
    "provider": "anthropic",
    "costStatus": "reported",
    "billingType": "metered_api",
    "inputTokens": 15139,
    "usageSource": "per_run",
    "freshSession": true,
    "outputTokens": 2425,
    "sessionReused": false,
    "rawInputTokens": 15139,
    "sessionRotated": false,
    "configFreshness": {
      "session": {
        "reset": true,
        "categories": [
          "adapter",
          "adapterConfig",
          "agentRuntimeConfig",
          "instructions",
          "issueOverrides",
          "workspaceConfig",
          "environment",
          "envBindings",
          "secrets",
          "runtimeSkills"
        ],
        "resetReasons": [],
        "nextFingerprint": "v1:sha256:dd02b7b66a5629f9cc71aa7e7aaa7363f453dec39d0b69a9ac163c444c295dcc",
        "changedCategories": [],
        "taskSessionReused": false,
        "fingerprintVersion": 1,
        "taskSessionAvailable": false,
        "storedFingerprintPresent": false
      },
      "version": 1,
      "workspace": {
        "action": "create",
        "reasons": [],
        "categories": [
          "mode",
          "projectWorkspace",
          "strategy",
          "repo",
          "lifecycleCommands",
          "runtimeServices",
          "environment",
          "realization"
        ],
        "reuseRequested": false,
        "nextFingerprint": "v1:sha256:e6edd481da87b1164d26902484384ecab2a49cbd12abb005531ad66f86b17023",
        "workspaceReused": false,
        "activeWorkspaceId": null,
        "changedCategories": [],
        "storedFingerprint": null,
        "fingerprintVersion": 1,
        "inferredFingerprint": null,
        "previousWorkspaceId": null,
        "configSnapshotRefreshed": false,
        "storedFingerprintPresent": false
      }
    },
    "rawOutputTokens": 2425,
    "cachedInputTokens": 123593,
    "taskSessionReused": false,
    "persistedSessionId": "2dbcf3a0-8a62-4f67-be3a-1e1e18b6eb2c",
    "cacheAdjustedCostUsd": 0.22117425,
    "rawCachedInputTokens": 123593,
    "sessionRotationReason": null
  }
}

interview-plan-accept passed

Tokens93,674 in · 17,083 out1,426,537 cached · 4/4 runs covered

LLM spend$0.94684/4 runs provider-priced

ExecutionLocal · not metered4m 7s agent

first-task.legacy-claude.local.interview-plan-accept

Matchers and test context

Attempt: 1
Duration: 3m 57s
Agent runtime: 4m 7s
Runtime: legacy
Provider: claude
Model: claude-opus-5
Issue: FIR-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.interview-questions","expected":true}	One structured interview with 3–4 questions
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.durable-plan","expected":true}	Save the requested plan before acceptance
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-premature-work","expected":true}	Before acceptance: no hires, execution tasks, finished output, or claimed completion; closing an unexecuted rejected task is allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.acceptance-recorded","expected":true}	Explicit acceptance is persisted as a user comment or approved confirmation card
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.accepted-plan-retained","expected":true}	The accepted plan remains available as a durable document
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 4,
      "runsWithTokenUsage": 4,
      "runsWithReportedCost": 4,
      "inputTokens": 93674,
      "outputTokens": 17083,
      "cachedInputTokens": 1426537,
      "totalTokens": 1537294,
      "reportedCostUsd": 0.94676125,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 246860,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0.94676125,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0.94676125,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "6b3406f8-e48a-4dec-82cf-33b61b84c2f7",
        "usage": {
          "model": "claude-opus-5",
          "biller": "anthropic",
          "costUsd": 0.29436850000000003,
          "provider": "anthropic",
          "costStatus": "reported",
          "billingType": "metered_api",
          "inputTokens": 18358,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 2993,
          "sessionReused": false,
          "rawInputTokens": 18358,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:aa4bde6d5dfb5b8b565a8256070282838710a92132e84807d1e867c3c1c47b6e",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:e28187c50d48a7c13efc982b2e183e7ebe3736dd692cfd3df6ad6cab2212c779",
              "workspaceReused": false,
              "activeWorkspaceId": "f9b773c3-25a2-4a4f-a4be-01a84ef52d91",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 2993,
          "cachedInputTokens": 201190,
          "taskSessionReused": false,
          "persistedSessionId": "9e223b5e-3134-4d00-9555-a1cecc0ac7ba",
          "cacheAdjustedCostUsd": 0.29436850000000003,
          "rawCachedInputTokens": 201190,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "782c53b0-1c80-4e8a-b5fc-49ea82240353",
        "usage": {
          "model": "claude-opus-5",
          "biller": "anthropic",
          "costUsd": 0.15368575,
          "provider": "anthropic",
          "costStatus": "reported",
          "billingType": "metered_api",
          "inputTokens": 16885,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 6771,
          "sessionReused": true,
          "rawInputTokens": 16885,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:aa4bde6d5dfb5b8b565a8256070282838710a92132e84807d1e867c3c1c47b6e",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:e28187c50d48a7c13efc982b2e183e7ebe3736dd692cfd3df6ad6cab2212c779",
              "workspaceReused": false,
              "activeWorkspaceId": "3f6c2de3-fa64-4f39-a0ec-09e67946a148",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 6771,
          "cachedInputTokens": 755238,
          "taskSessionReused": true,
          "persistedSessionId": "729cdf1f-4a75-4b13-b598-50abcd9b02ca",
          "cacheAdjustedCostUsd": 0.15368575,
          "rawCachedInputTokens": 755238,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "9f2da8cf-e6b4-412d-97f1-0947b95607e1",
        "usage": {
          "model": "claude-opus-5",
          "biller": "anthropic",
          "costUsd": 0.20968724999999994,
          "provider": "anthropic",
          "costStatus": "reported",
          "billingType": "metered_api",
          "inputTokens": 37260,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 4474,
          "sessionReused": true,
          "rawInputTokens": 37260,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:aa4bde6d5dfb5b8b565a8256070282838710a92132e84807d1e867c3c1c47b6e",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:e28187c50d48a7c13efc982b2e183e7ebe3736dd692cfd3df6ad6cab2212c779",
              "workspaceReused": false,
              "activeWorkspaceId": "44531b4d-86af-4b84-ba82-5bcb6ee1ea3f",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 4474,
          "cachedInputTokens": 308004,
          "taskSessionReused": true,
          "persistedSessionId": "729cdf1f-4a75-4b13-b598-50abcd9b02ca",
          "cacheAdjustedCostUsd": 0.20968724999999994,
          "rawCachedInputTokens": 308004,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "18ff5b0c-1615-4bdc-b442-c97e544181a2",
        "usage": {
          "model": "claude-opus-5",
          "biller": "anthropic",
          "costUsd": 0.28901975,
          "provider": "anthropic",
          "costStatus": "reported",
          "billingType": "metered_api",
          "inputTokens": 21171,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 2845,
          "sessionReused": false,
          "rawInputTokens": 21171,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:aa4bde6d5dfb5b8b565a8256070282838710a92132e84807d1e867c3c1c47b6e",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:e28187c50d48a7c13efc982b2e183e7ebe3736dd692cfd3df6ad6cab2212c779",
              "workspaceReused": false,
              "activeWorkspaceId": "2c03e6df-843b-4aba-b6d2-5eff9cf09091",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 2845,
          "cachedInputTokens": 162105,
          "taskSessionReused": false,
          "persistedSessionId": "729cdf1f-4a75-4b13-b598-50abcd9b02ca",
          "cacheAdjustedCostUsd": 0.28901975,
          "rawCachedInputTokens": 162105,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

task-card-accept passed

Tokens86,429 in · 13,505 out1,123,510 cached · 3/3 runs covered

LLM spend$1.06913/3 runs provider-priced

ExecutionLocal · not metered3m 44s agent

first-task.legacy-claude.local.task-card-accept

Matchers and test context

Attempt: 1
Duration: 3m 38s
Agent runtime: 3m 44s
Runtime: legacy
Provider: claude
Model: claude-opus-5
Issue: FIR-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.subtask-proposal","expected":true}	Propose a task for the concrete request
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-premature-work","expected":true}	Before acceptance: no hires, execution tasks, finished output, or claimed completion; closing an unexecuted rejected task is allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.acceptance-recorded","expected":true}	Explicit acceptance is persisted as a user comment or approved confirmation card
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.one-scoped-subtask","expected":true}	Exactly one approved subtask belongs to this onboarding issue and agent
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.creation-after-acceptance","expected":true}	Task creation must follow acceptance, including between checkpoints
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.durable-completion","expected":true}	Approved output is saved on the completed child, with revised scope when applicable
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 3,
      "runsWithReportedCost": 3,
      "inputTokens": 86429,
      "outputTokens": 13505,
      "cachedInputTokens": 1123510,
      "totalTokens": 1223444,
      "reportedCostUsd": 1.06910175,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 223530,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 1.06910175,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 1.06910175,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "c2af246b-7510-4075-ac86-f43e196ca30c",
        "usage": {
          "model": "claude-opus-5",
          "biller": "anthropic",
          "costUsd": 0.23678524999999997,
          "provider": "anthropic",
          "costStatus": "reported",
          "billingType": "metered_api",
          "inputTokens": 15379,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 2325,
          "sessionReused": false,
          "rawInputTokens": 15379,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:e5b7a08de364b66a86538e9c8033d60cab5518a2d4f5a9ebfaa3dfc16c503c9f",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:6ec151b33079dca8ffaf9d817aaec73f80497e09812362a0db5fe4d278c4c6df",
              "workspaceReused": false,
              "activeWorkspaceId": "87b8df7c-acdc-4da4-bba6-c6ee1ba2bdd4",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 2325,
          "cachedInputTokens": 156746,
          "taskSessionReused": false,
          "persistedSessionId": "aff48da8-ca09-40fa-b483-44228eeda9c8",
          "cacheAdjustedCostUsd": 0.23678524999999997,
          "rawCachedInputTokens": 156746,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "2e28c19f-9ce0-43eb-ac1a-8d80345e284f",
        "usage": {
          "model": "claude-opus-5",
          "biller": "anthropic",
          "costUsd": 0.4531550000000001,
          "provider": "anthropic",
          "costStatus": "reported",
          "billingType": "metered_api",
          "inputTokens": 43676,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 7902,
          "sessionReused": true,
          "rawInputTokens": 43676,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:e5b7a08de364b66a86538e9c8033d60cab5518a2d4f5a9ebfaa3dfc16c503c9f",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:6ec151b33079dca8ffaf9d817aaec73f80497e09812362a0db5fe4d278c4c6df",
              "workspaceReused": false,
              "activeWorkspaceId": "0c2bfa15-4158-4b53-a7fb-d1f15c24973d",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 7902,
          "cachedInputTokens": 723663,
          "taskSessionReused": true,
          "persistedSessionId": "0fb5b77a-53e1-46cf-9069-018c9fdcab23",
          "cacheAdjustedCostUsd": 0.4531550000000001,
          "rawCachedInputTokens": 723663,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "ba68a540-af01-4154-86f8-8252553a7363",
        "usage": {
          "model": "claude-opus-5",
          "biller": "anthropic",
          "costUsd": 0.37916149999999993,
          "provider": "anthropic",
          "costStatus": "reported",
          "billingType": "metered_api",
          "inputTokens": 27374,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 3278,
          "sessionReused": false,
          "rawInputTokens": 27374,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:e5b7a08de364b66a86538e9c8033d60cab5518a2d4f5a9ebfaa3dfc16c503c9f",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:6ec151b33079dca8ffaf9d817aaec73f80497e09812362a0db5fe4d278c4c6df",
              "workspaceReused": false,
              "activeWorkspaceId": "9217ffeb-2774-4490-a94a-9c746d3e5921",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 3278,
          "cachedInputTokens": 243101,
          "taskSessionReused": false,
          "persistedSessionId": "0fb5b77a-53e1-46cf-9069-018c9fdcab23",
          "cacheAdjustedCostUsd": 0.37916149999999993,
          "rawCachedInputTokens": 243101,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

task-reply-accept failed

Tokens82,668 in · 11,830 out1,013,453 cached · 3/3 runs covered

LLM spend$1.02183/3 runs provider-priced

ExecutionLocal · not metered2m 54s agent

first-task.legacy-claude.local.task-reply-accept

Matchers and test context

Attempt: 1
Duration: 2m 52s
Agent runtime: 2m 54s
Runtime: legacy
Provider: claude
Model: claude-opus-5
Issue: FIR-1

acceptance-recorded: Explicit acceptance is persisted as a user comment or approved confirmation card [2mexpect([22m[31mreceived[39m[2m).[22mtoEqual[2m([22m[32mexpected[39m[2m) // deep equality[22m [32m- Expected - 1[39m [31m+ Received + 10[39m [32m- Array [][39m [31m+ Array [[39m [31m+ Object {[39m [31m+ "detail": "Explicit acceptance is persisted as a user comment or approved confirmation card",[39m [31m+ "evidence": Array [[39m [31m+ "accepted-2",[39m [31m+ ],[39m [31m+ "id": "acceptance-recorded",[39m [31m+ "passed": false,[39m [31m+ },[39m [31m+ ][39m

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.subtask-proposal","expected":true}	Propose a task for the concrete request
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-premature-work","expected":true}	Before acceptance: no hires, execution tasks, finished output, or claimed completion; closing an unexecuted rejected task is allowed
Fail	`json_path`	{"kind":"json_path","path":"firstTask.checks.acceptance-recorded","expected":true}	Explicit acceptance is persisted as a user comment or approved confirmation card
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.one-scoped-subtask","expected":true}	Exactly one approved subtask belongs to this onboarding issue and agent
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.creation-after-acceptance","expected":true}	Task creation must follow acceptance, including between checkpoints
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.durable-completion","expected":true}	Approved output is saved on the completed child, with revised scope when applicable
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 3,
      "runsWithReportedCost": 3,
      "inputTokens": 82668,
      "outputTokens": 11830,
      "cachedInputTokens": 1013453,
      "totalTokens": 1107951,
      "reportedCostUsd": 1.0217715,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 173593,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 1.0217715,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 1.0217715,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "67b4a726-3622-4b7d-a7bd-f2ad24349c65",
        "usage": {
          "model": "claude-opus-5",
          "biller": "anthropic",
          "costUsd": 0.24437625,
          "provider": "anthropic",
          "costStatus": "reported",
          "billingType": "metered_api",
          "inputTokens": 16603,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 2341,
          "sessionReused": false,
          "rawInputTokens": 16603,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:0eace15f93ec38ba55a9285bad20e5f38b6590688904dea76bad97cca9bd11f5",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:a194c1a2dff47467070e220c5759b3bb2469ca2b2021c5d1227a96ab060824b8",
              "workspaceReused": false,
              "activeWorkspaceId": "e687e2b9-6f1b-4008-b371-9106e26a303d",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 2341,
          "cachedInputTokens": 155796,
          "taskSessionReused": false,
          "persistedSessionId": "6460e2b1-9833-4876-9800-c2ba7030ee42",
          "cacheAdjustedCostUsd": 0.24437625,
          "rawCachedInputTokens": 155796,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "31ea30ac-a6f3-4464-8b2a-5f427af578a0",
        "usage": {
          "model": "claude-opus-5",
          "biller": "anthropic",
          "costUsd": 0.4712722500000001,
          "provider": "anthropic",
          "costStatus": "reported",
          "billingType": "metered_api",
          "inputTokens": 43903,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 6836,
          "sessionReused": true,
          "rawInputTokens": 43903,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:0eace15f93ec38ba55a9285bad20e5f38b6590688904dea76bad97cca9bd11f5",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:a194c1a2dff47467070e220c5759b3bb2469ca2b2021c5d1227a96ab060824b8",
              "workspaceReused": false,
              "activeWorkspaceId": "04ff1bd8-fd63-4dd8-8ffb-1d6dffa89cb3",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 6836,
          "cachedInputTokens": 664278,
          "taskSessionReused": true,
          "persistedSessionId": "27664769-a1f9-4f01-8c84-62d2ddfbcb85",
          "cacheAdjustedCostUsd": 0.4712722500000001,
          "rawCachedInputTokens": 664278,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "0acb2ff8-59b5-47bc-b777-366ded4e714c",
        "usage": {
          "model": "claude-opus-5",
          "biller": "anthropic",
          "costUsd": 0.306123,
          "provider": "anthropic",
          "costStatus": "reported",
          "billingType": "metered_api",
          "inputTokens": 22162,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 2653,
          "sessionReused": false,
          "rawInputTokens": 22162,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:0eace15f93ec38ba55a9285bad20e5f38b6590688904dea76bad97cca9bd11f5",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:a194c1a2dff47467070e220c5759b3bb2469ca2b2021c5d1227a96ab060824b8",
              "workspaceReused": false,
              "activeWorkspaceId": "cac88aee-e74a-46ca-84af-6e943c3a9ec8",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 2653,
          "cachedInputTokens": 193379,
          "taskSessionReused": false,
          "persistedSessionId": "27664769-a1f9-4f01-8c84-62d2ddfbcb85",
          "cacheAdjustedCostUsd": 0.306123,
          "rawCachedInputTokens": 193379,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

clarify-propose-accept passed

Tokens103,862 in · 12,843 out1,153,527 cached · 4/4 runs covered

LLM spend$0.96294/4 runs provider-priced

ExecutionLocal · not metered3m 25s agent

first-task.legacy-claude.local.clarify-propose-accept

Matchers and test context

Attempt: 1
Duration: 3m 30s
Agent runtime: 3m 25s
Runtime: legacy
Provider: claude
Model: claude-opus-5
Issue: FIR-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.focused-clarification","expected":true}	Ask focused questions before proposing ambiguous work
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-premature-work","expected":true}	Before acceptance: no hires, execution tasks, finished output, or claimed completion; closing an unexecuted rejected task is allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.acceptance-recorded","expected":true}	Explicit acceptance is persisted as a user comment or approved confirmation card
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.one-scoped-subtask","expected":true}	Exactly one approved subtask belongs to this onboarding issue and agent
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.creation-after-acceptance","expected":true}	Task creation must follow acceptance, including between checkpoints
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.durable-completion","expected":true}	Approved output is saved on the completed child, with revised scope when applicable
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 4,
      "runsWithTokenUsage": 4,
      "runsWithReportedCost": 4,
      "inputTokens": 103862,
      "outputTokens": 12843,
      "cachedInputTokens": 1153527,
      "totalTokens": 1270232,
      "reportedCostUsd": 0.962914,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 205436,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0.962914,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0.962914,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "1c4075fd-ccf2-4413-a705-c84e46edff8e",
        "usage": {
          "model": "claude-opus-5",
          "biller": "anthropic",
          "costUsd": 0.3447365,
          "provider": "anthropic",
          "costStatus": "reported",
          "billingType": "metered_api",
          "inputTokens": 35260,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 1904,
          "sessionReused": false,
          "rawInputTokens": 35260,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:01fca2ccd3c9f5825fbf454fa7e6b05ce922b95d5ab77b2f2e2d90a3533cc790",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:173b38e0f4040da1482643ada03ef395c88af8c291dd4946b8f3f15483e81f72",
              "workspaceReused": false,
              "activeWorkspaceId": "8da9c4c6-909c-4269-b232-815fd9ca2edd",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1904,
          "cachedInputTokens": 144912,
          "taskSessionReused": false,
          "persistedSessionId": "067ce5f2-2c32-4ca5-ae52-ed6c6775f332",
          "cacheAdjustedCostUsd": 0.3447365,
          "rawCachedInputTokens": 144912,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "450183cb-acc1-4123-a289-4d4dd2837981",
        "usage": {
          "model": "claude-opus-5",
          "biller": "anthropic",
          "costUsd": 0.3149667500000001,
          "provider": "anthropic",
          "costStatus": "reported",
          "billingType": "metered_api",
          "inputTokens": 16366,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 6254,
          "sessionReused": true,
          "rawInputTokens": 16366,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:01fca2ccd3c9f5825fbf454fa7e6b05ce922b95d5ab77b2f2e2d90a3533cc790",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:173b38e0f4040da1482643ada03ef395c88af8c291dd4946b8f3f15483e81f72",
              "workspaceReused": false,
              "activeWorkspaceId": "a0de45c0-c109-4ab1-a653-3480987c80d9",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 6254,
          "cachedInputTokens": 719150,
          "taskSessionReused": true,
          "persistedSessionId": "d51dacb5-52dd-4aa3-bf56-807ab005000e",
          "cacheAdjustedCostUsd": 0.3149667500000001,
          "rawCachedInputTokens": 719150,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "832c8e4e-ffae-4079-94ae-6d8edb5c5a31",
        "usage": {
          "model": "claude-opus-5",
          "biller": "anthropic",
          "costUsd": 0.0136135,
          "provider": "anthropic",
          "costStatus": "reported",
          "billingType": "metered_api",
          "inputTokens": 31081,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 1806,
          "sessionReused": true,
          "rawInputTokens": 31081,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:01fca2ccd3c9f5825fbf454fa7e6b05ce922b95d5ab77b2f2e2d90a3533cc790",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:173b38e0f4040da1482643ada03ef395c88af8c291dd4946b8f3f15483e81f72",
              "workspaceReused": false,
              "activeWorkspaceId": "366743d9-a26e-44b1-9a9a-8aac382847a1",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1806,
          "cachedInputTokens": 127629,
          "taskSessionReused": true,
          "persistedSessionId": "d51dacb5-52dd-4aa3-bf56-807ab005000e",
          "cacheAdjustedCostUsd": 0.0136135,
          "rawCachedInputTokens": 127629,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "c568ae85-5bd6-48f1-8420-891ff174327c",
        "usage": {
          "model": "claude-opus-5",
          "biller": "anthropic",
          "costUsd": 0.28959725,
          "provider": "anthropic",
          "costStatus": "reported",
          "billingType": "metered_api",
          "inputTokens": 21155,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 2879,
          "sessionReused": false,
          "rawInputTokens": 21155,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:01fca2ccd3c9f5825fbf454fa7e6b05ce922b95d5ab77b2f2e2d90a3533cc790",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:173b38e0f4040da1482643ada03ef395c88af8c291dd4946b8f3f15483e81f72",
              "workspaceReused": false,
              "activeWorkspaceId": "67d31758-fb9b-4ef8-9706-51b77218272e",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 2879,
          "cachedInputTokens": 161836,
          "taskSessionReused": false,
          "persistedSessionId": "d51dacb5-52dd-4aa3-bf56-807ab005000e",
          "cacheAdjustedCostUsd": 0.28959725,
          "rawCachedInputTokens": 161836,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

revise-accept passed

Tokens104,321 in · 15,391 out1,419,097 cached · 4/4 runs covered

LLM spend$1.49154/4 runs provider-priced

ExecutionLocal · not metered4m 5s agent

first-task.legacy-claude.local.revise-accept

Matchers and test context

Attempt: 1
Duration: 3m 52s
Agent runtime: 4m 5s
Runtime: legacy
Provider: claude
Model: claude-opus-5
Issue: FIR-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.subtask-proposal","expected":true}	Propose a task for the concrete request
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-premature-work","expected":true}	Before acceptance: no hires, execution tasks, finished output, or claimed completion; closing an unexecuted rejected task is allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.acceptance-recorded","expected":true}	Explicit acceptance is persisted as a user comment or approved confirmation card
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.one-scoped-subtask","expected":true}	Exactly one approved subtask belongs to this onboarding issue and agent
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.creation-after-acceptance","expected":true}	Task creation must follow acceptance, including between checkpoints
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.durable-completion","expected":true}	Approved output is saved on the completed child, with revised scope when applicable
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 4,
      "runsWithTokenUsage": 4,
      "runsWithReportedCost": 4,
      "inputTokens": 104321,
      "outputTokens": 15391,
      "cachedInputTokens": 1419097,
      "totalTokens": 1538809,
      "reportedCostUsd": 1.4915005000000003,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 245236,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 1.4915005000000003,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 1.4915005000000003,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "554c4514-5e86-4f59-be61-87b2d83174a3",
        "usage": {
          "model": "claude-opus-5",
          "biller": "anthropic",
          "costUsd": 0.36633400000000005,
          "provider": "anthropic",
          "costStatus": "reported",
          "billingType": "metered_api",
          "inputTokens": 29818,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 2688,
          "sessionReused": false,
          "rawInputTokens": 29818,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:9417b8fa7d2d9f5a5cbfffdef3d2b7ae5c27b7ea7a895b22d885b808875977c5",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:57563e21a61ae0570f94bbc9a3b6c3d53d05bcb319ce1c50f88b48dd2202e54c",
              "workspaceReused": false,
              "activeWorkspaceId": "9b03d1cc-4807-45f9-bd9c-536d0bec3436",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 2688,
          "cachedInputTokens": 217207,
          "taskSessionReused": false,
          "persistedSessionId": "2fe90dd8-1d5e-4bf3-8b4e-5ff88b3e063b",
          "cacheAdjustedCostUsd": 0.36633400000000005,
          "rawCachedInputTokens": 217207,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "8ebf3eed-7b54-4bbf-87d1-fbbfc17157cc",
        "usage": {
          "model": "claude-opus-5",
          "biller": "anthropic",
          "costUsd": 0.5713695000000002,
          "provider": "anthropic",
          "costStatus": "reported",
          "billingType": "metered_api",
          "inputTokens": 23379,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 8501,
          "sessionReused": true,
          "rawInputTokens": 23379,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:9417b8fa7d2d9f5a5cbfffdef3d2b7ae5c27b7ea7a895b22d885b808875977c5",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:57563e21a61ae0570f94bbc9a3b6c3d53d05bcb319ce1c50f88b48dd2202e54c",
              "workspaceReused": false,
              "activeWorkspaceId": "ff3b0c2f-1aea-47f3-873f-d2cbbd2accaf",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 8501,
          "cachedInputTokens": 952632,
          "taskSessionReused": true,
          "persistedSessionId": "f86429b0-ef18-4bb7-83da-551a410abfea",
          "cacheAdjustedCostUsd": 0.5713695000000002,
          "rawCachedInputTokens": 952632,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "09ffa749-6b22-43bb-9dd3-95597d483ab0",
        "usage": {
          "model": "claude-opus-5",
          "biller": "anthropic",
          "costUsd": 0.26354524999999995,
          "provider": "anthropic",
          "costStatus": "reported",
          "billingType": "metered_api",
          "inputTokens": 29065,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 1545,
          "sessionReused": true,
          "rawInputTokens": 29065,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:9417b8fa7d2d9f5a5cbfffdef3d2b7ae5c27b7ea7a895b22d885b808875977c5",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:57563e21a61ae0570f94bbc9a3b6c3d53d05bcb319ce1c50f88b48dd2202e54c",
              "workspaceReused": false,
              "activeWorkspaceId": "d2bc5575-46c4-4ab5-b33f-5f7566e23e3c",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1545,
          "cachedInputTokens": 86543,
          "taskSessionReused": true,
          "persistedSessionId": "f86429b0-ef18-4bb7-83da-551a410abfea",
          "cacheAdjustedCostUsd": 0.26354524999999995,
          "rawCachedInputTokens": 86543,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "ed858799-a260-4678-bf16-14a01c763088",
        "usage": {
          "model": "claude-opus-5",
          "biller": "anthropic",
          "costUsd": 0.29025175000000003,
          "provider": "anthropic",
          "costStatus": "reported",
          "billingType": "metered_api",
          "inputTokens": 22059,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 2657,
          "sessionReused": false,
          "rawInputTokens": 22059,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:9417b8fa7d2d9f5a5cbfffdef3d2b7ae5c27b7ea7a895b22d885b808875977c5",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:57563e21a61ae0570f94bbc9a3b6c3d53d05bcb319ce1c50f88b48dd2202e54c",
              "workspaceReused": false,
              "activeWorkspaceId": "d50237ae-7e8b-458b-9917-4fdc33e3fc80",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 2657,
          "cachedInputTokens": 162715,
          "taskSessionReused": false,
          "persistedSessionId": "f86429b0-ef18-4bb7-83da-551a410abfea",
          "cacheAdjustedCostUsd": 0.29025175000000003,
          "rawCachedInputTokens": 162715,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

reject-no-execution passed

Tokens60,502 in · 4,093 out295,730 cached · 2/2 runs covered

LLM spend$0.63292/2 runs provider-priced

ExecutionLocal · not metered1m 20s agent

first-task.legacy-claude.local.reject-no-execution

Matchers and test context

Attempt: 1
Duration: 1m 54s
Agent runtime: 1m 20s
Runtime: legacy
Provider: claude
Model: claude-opus-5
Issue: FIR-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.subtask-proposal","expected":true}	Propose a task for the concrete request
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-premature-work","expected":true}	Before acceptance: no hires, execution tasks, finished output, or claimed completion; closing an unexecuted rejected task is allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.rejection-respected","expected":true}	Rejected work never executes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 60502,
      "outputTokens": 4093,
      "cachedInputTokens": 295730,
      "totalTokens": 360325,
      "reportedCostUsd": 0.632899,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 79504,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0.632899,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0.632899,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "db72945d-52d8-4638-97dc-fafadfd4fe9f",
        "usage": {
          "model": "claude-opus-5",
          "biller": "anthropic",
          "costUsd": 0.25392950000000003,
          "provider": "anthropic",
          "costStatus": "reported",
          "billingType": "metered_api",
          "inputTokens": 33082,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 831,
          "sessionReused": true,
          "rawInputTokens": 33082,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:0c2a30a983300cc7a014f4d15714ac1000e0935190e581298c70f49279020da4",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:94bd107347e00e999f7c6e4414a3b18097c242f36ebcb08f3f033c623f64a901",
              "workspaceReused": false,
              "activeWorkspaceId": "caac5910-320a-482a-9291-1315133dc5f8",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 831,
          "cachedInputTokens": 52794,
          "taskSessionReused": true,
          "persistedSessionId": "7be47d9d-04de-41e7-b591-20ea89d7bac2",
          "cacheAdjustedCostUsd": 0.25392950000000003,
          "rawCachedInputTokens": 52794,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "4fced0bc-7915-4c2f-a772-2d14b607b846",
        "usage": {
          "model": "claude-opus-5",
          "biller": "anthropic",
          "costUsd": 0.37896949999999996,
          "provider": "anthropic",
          "costStatus": "reported",
          "billingType": "metered_api",
          "inputTokens": 27420,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 3262,
          "sessionReused": false,
          "rawInputTokens": 27420,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:0c2a30a983300cc7a014f4d15714ac1000e0935190e581298c70f49279020da4",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:94bd107347e00e999f7c6e4414a3b18097c242f36ebcb08f3f033c623f64a901",
              "workspaceReused": false,
              "activeWorkspaceId": "1d7fdab4-50a4-495e-b4f8-db1dd747d137",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 3262,
          "cachedInputTokens": 242936,
          "taskSessionReused": false,
          "persistedSessionId": "7be47d9d-04de-41e7-b591-20ea89d7bac2",
          "cacheAdjustedCostUsd": 0.37896949999999996,
          "rawCachedInputTokens": 242936,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

History

Campaign trends

No historical campaigns have been published yet.