Full-stack acceptance campaign

Runner Full-Stack E2E

A browser-verified matrix of runner profiles, execution environments, and deterministic task contracts. Declared PNG screenshots and sanitized structured evidence are retained with every published campaign; additional diagnostic evidence remains in the access-controlled workflow artifact.

10/12Passed

2Failed

16m 32sTest time

1,523,312Input tokens

19,167Output tokens

1,094,737Cached tokens

$0.000000LLM reported subtotal

$0.000000Daytona list estimate

12m 4sAgent execution time

0msDaytona lease time

22/27Runs provider-priced

Model spend is the provider-reported subtotal; unpriced or unavailable runs are excluded, never counted as free. Daytona runtime is a public-list-price estimate from captured lease time and pinned resources, before credits, discounts, storage allowance, or invoice adjustments. Local execution has no external runtime meter.

Search tests Agent profile Environment Suite Status

Test suite

Everyday Paperclip Work

Real user requests, useful downloaded work, and durable continuation using production instructions.

Configuration matrix3 profiles · 2 environments · 0 selected

Agent profile	Isolated locallocal · local	Daytona warm reusable sandboxdaytona · remote
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Build, download, and revise a project not selected `everyday-workflows.runner-codex.local.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-codex.local.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Hire one teammate, then reuse that agent not selected `everyday-workflows.runner-codex.local.hire-reuse` Matchers and test context Not selected No matcher result was recorded. Use a connection after approval not selected `everyday-workflows.runner-codex.local.service-approve` Matchers and test context Not selected No matcher result was recorded. Respect a declined tool action not selected `everyday-workflows.runner-codex.local.service-decline` Matchers and test context Not selected No matcher result was recorded. Respect Not now on a new connection not selected `everyday-workflows.runner-codex.local.connection-decline` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-codex.local.recover-controller` Matchers and test context Not selected No matcher result was recorded. Stop a task and send a new direction once not selected `everyday-workflows.runner-codex.local.stop-redirect` Matchers and test context Not selected No matcher result was recorded.	Daytona warm reusable sandboxdaytona · remote Build, download, and revise a project not selected `everyday-workflows.runner-codex.daytona.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-codex.daytona.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-codex.daytona.recover-controller` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Build, download, and revise a project not selected `everyday-workflows.runner-acpx-claude.local.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-acpx-claude.local.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Hire one teammate, then reuse that agent not selected `everyday-workflows.runner-acpx-claude.local.hire-reuse` Matchers and test context Not selected No matcher result was recorded. Use a connection after approval not selected `everyday-workflows.runner-acpx-claude.local.service-approve` Matchers and test context Not selected No matcher result was recorded. Respect a declined tool action not selected `everyday-workflows.runner-acpx-claude.local.service-decline` Matchers and test context Not selected No matcher result was recorded. Respect Not now on a new connection not selected `everyday-workflows.runner-acpx-claude.local.connection-decline` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-acpx-claude.local.recover-controller` Matchers and test context Not selected No matcher result was recorded. Stop a task and send a new direction once not selected `everyday-workflows.runner-acpx-claude.local.stop-redirect` Matchers and test context Not selected No matcher result was recorded.	Daytona warm reusable sandboxdaytona · remote Build, download, and revise a project not selected `everyday-workflows.runner-acpx-claude.daytona.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-acpx-claude.daytona.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-acpx-claude.daytona.recover-controller` Matchers and test context Not selected No matcher result was recorded.
Runner Codex Mininativecodex · gpt-5.4-mini	Isolated locallocal · local Build, download, and revise a project not selected `everyday-workflows.runner-codex-mini.local.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-codex-mini.local.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Hire one teammate, then reuse that agent not selected `everyday-workflows.runner-codex-mini.local.hire-reuse` Matchers and test context Not selected No matcher result was recorded. Use a connection after approval not selected `everyday-workflows.runner-codex-mini.local.service-approve` Matchers and test context Not selected No matcher result was recorded. Respect a declined tool action not selected `everyday-workflows.runner-codex-mini.local.service-decline` Matchers and test context Not selected No matcher result was recorded. Respect Not now on a new connection not selected `everyday-workflows.runner-codex-mini.local.connection-decline` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-codex-mini.local.recover-controller` Matchers and test context Not selected No matcher result was recorded. Stop a task and send a new direction once not selected `everyday-workflows.runner-codex-mini.local.stop-redirect` Matchers and test context Not selected No matcher result was recorded.	Daytona warm reusable sandboxdaytona · remote

Test suite

Persistent Agent Chat

Task-backed conversations, session resets, and project plan handoff.

Configuration matrix4 profiles · 1 environments · 0 selected

Agent profile	Isolated locallocal · local
Legacy Codexlegacycodex · gpt-5.6-sol	Isolated locallocal · local Conversation continuity across restart not selected `agent-chat.legacy-codex.local.continuity-restart` Matchers and test context Not selected No matcher result was recorded. Fresh context within preserved history not selected `agent-chat.legacy-codex.local.new-session` Matchers and test context Not selected No matcher result was recorded. Stop, reset, and resume not selected `agent-chat.legacy-codex.local.stop-new-resume` Matchers and test context Not selected No matcher result was recorded. Draft, revise, approve, and hand off a plan not selected `agent-chat.legacy-codex.local.plan-handoff` Matchers and test context Not selected No matcher result was recorded. Clarify and reuse an existing project not selected `agent-chat.legacy-codex.local.clarify-reuse` Matchers and test context Not selected No matcher result was recorded. Create a project with multiple repository URLs not selected `agent-chat.legacy-codex.local.multi-repository` Matchers and test context Not selected No matcher result was recorded.
Legacy Claudelegacyclaude · claude-sonnet-4-6	Isolated locallocal · local Conversation continuity across restart not selected `agent-chat.legacy-claude.local.continuity-restart` Matchers and test context Not selected No matcher result was recorded. Fresh context within preserved history not selected `agent-chat.legacy-claude.local.new-session` Matchers and test context Not selected No matcher result was recorded. Stop, reset, and resume not selected `agent-chat.legacy-claude.local.stop-new-resume` Matchers and test context Not selected No matcher result was recorded. Draft, revise, approve, and hand off a plan not selected `agent-chat.legacy-claude.local.plan-handoff` Matchers and test context Not selected No matcher result was recorded. Clarify and reuse an existing project not selected `agent-chat.legacy-claude.local.clarify-reuse` Matchers and test context Not selected No matcher result was recorded. Create a project with multiple repository URLs not selected `agent-chat.legacy-claude.local.multi-repository` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Conversation continuity across restart not selected `agent-chat.runner-codex.local.continuity-restart` Matchers and test context Not selected No matcher result was recorded. Fresh context within preserved history not selected `agent-chat.runner-codex.local.new-session` Matchers and test context Not selected No matcher result was recorded. Stop, reset, and resume not selected `agent-chat.runner-codex.local.stop-new-resume` Matchers and test context Not selected No matcher result was recorded. Draft, revise, approve, and hand off a plan not selected `agent-chat.runner-codex.local.plan-handoff` Matchers and test context Not selected No matcher result was recorded. Clarify and reuse an existing project not selected `agent-chat.runner-codex.local.clarify-reuse` Matchers and test context Not selected No matcher result was recorded. Create a project with multiple repository URLs not selected `agent-chat.runner-codex.local.multi-repository` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Conversation continuity across restart not selected `agent-chat.runner-acpx-claude.local.continuity-restart` Matchers and test context Not selected No matcher result was recorded. Fresh context within preserved history not selected `agent-chat.runner-acpx-claude.local.new-session` Matchers and test context Not selected No matcher result was recorded. Stop, reset, and resume not selected `agent-chat.runner-acpx-claude.local.stop-new-resume` Matchers and test context Not selected No matcher result was recorded. Draft, revise, approve, and hand off a plan not selected `agent-chat.runner-acpx-claude.local.plan-handoff` Matchers and test context Not selected No matcher result was recorded. Clarify and reuse an existing project not selected `agent-chat.runner-acpx-claude.local.clarify-reuse` Matchers and test context Not selected No matcher result was recorded. Create a project with multiple repository URLs not selected `agent-chat.runner-acpx-claude.local.multi-repository` Matchers and test context Not selected No matcher result was recorded.

Test suite

Core Runner Compatibility

Major provider, runtime generation, and execution-environment compatibility.

Configuration matrix7 profiles · 2 environments · 0 selected

Agent profile	Isolated locallocal · local	Daytona sandboxdaytona · remote
Legacy Codexlegacycodex · gpt-5.6-sol	Isolated locallocal · local Basic response not selected `core-compatibility.legacy-codex.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-codex.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-codex.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.legacy-codex.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-codex.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-codex.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Legacy Claudelegacyclaude · claude-sonnet-4-6	Isolated locallocal · local Basic response not selected `core-compatibility.legacy-claude.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-claude.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-claude.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.legacy-claude.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-claude.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-claude.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Legacy OpenCodelegacyopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Basic response not selected `core-compatibility.legacy-opencode.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-opencode.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-opencode.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.legacy-opencode.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-opencode.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-opencode.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Basic response not selected `core-compatibility.runner-codex.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-codex.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-codex.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.runner-codex.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-codex.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-codex.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Runner OpenCodenativeopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Basic response not selected `core-compatibility.runner-opencode.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-opencode.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-opencode.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.runner-opencode.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-opencode.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-opencode.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Basic response not selected `core-compatibility.runner-acpx-claude.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-acpx-claude.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-acpx-claude.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.runner-acpx-claude.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-acpx-claude.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-acpx-claude.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Codexnativeacpx · gpt-5.6-sol	Isolated locallocal · local Basic response not selected `core-compatibility.runner-acpx-codex.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-acpx-codex.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-acpx-codex.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.runner-acpx-codex.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-acpx-codex.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-acpx-codex.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.

Test suite

Local Session Integrity

Structured interaction and continuation qualification for every supported local profile.

Configuration matrix7 profiles · 1 environments · 0 selected

Agent profile	Isolated locallocal · local
Legacy Codexlegacycodex · gpt-5.6-sol	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.legacy-codex.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.legacy-codex.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Legacy Claudelegacyclaude · claude-sonnet-4-6	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.legacy-claude.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.legacy-claude.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Legacy OpenCodelegacyopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.legacy-opencode.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.legacy-opencode.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.runner-codex.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.runner-codex.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Runner OpenCodenativeopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.runner-opencode.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.runner-opencode.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.runner-acpx-claude.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.runner-acpx-claude.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Codexnativeacpx · gpt-5.6-sol	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.runner-acpx-codex.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.runner-acpx-codex.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.

Test suite

OpenRouter Model Breadth

Weekly-ranked tool-capable OpenRouter models through native OpenCode on isolated local workspaces.

Configuration matrix4 profiles · 1 environments · 0 selected

Agent profile	Isolated locallocal · local
#1 DeepSeek V4 Flash 0731nativeopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-deepseek-deepseek-v4-flash-0731.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-deepseek-deepseek-v4-flash-0731.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded.
#3 Tencent HY 3nativeopencode · openrouter/tencent/hy3	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-tencent-hy3.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-tencent-hy3.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded.
#4 Nemotron 3 Ultra 550B A55B (free)nativeopencode · openrouter/nvidia/nemotron-3-ultra-550b-a55b:free	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded. Plan, approve, complete not selected `openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.plan-approve-complete` Matchers and test context Not selected No matcher result was recorded.
#5 GPT-5.6 Lunanativeopencode · openrouter/openai/gpt-5.6-luna	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded. Plan, approve, complete not selected `openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.plan-approve-complete` Matchers and test context Not selected No matcher result was recorded.

Test suite

Daytona Warm Continuity

Three browser-driven turns on one reusable Daytona sandbox for legacy and native Codex.

Configuration matrix2 profiles · 1 environments · 0 selected

Agent profile	Daytona warm reusable sandboxdaytona · remote
Legacy Codexlegacycodex · gpt-5.6-sol	Daytona warm reusable sandboxdaytona · remote Warm three-turn workspace continuity not selected `daytona-warm-continuity.legacy-codex.daytona.warm-three-turn` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Daytona warm reusable sandboxdaytona · remote Warm three-turn workspace continuity not selected `daytona-warm-continuity.runner-codex.daytona.warm-three-turn` Matchers and test context Not selected No matcher result was recorded.

Test suite

first-task

Suite discovered from retained campaign identities; full suite size is not known to this publisher.

Pass rate83.3%10/12 passed

Tokens2,637,2161,523,312 input · 19,167 output

Cost$0.000000reported LLM + runtime estimate

Agent time12m 4s0ms lease

Execution12/120 retries · cleanup passed

Configuration matrix1 profiles · 1 environments · 12 selected

Agent profile Isolated locallocal · local

Runner Codexnativecodex · gpt-5.6-sol

Isolated locallocal · local

interview-first-response passed

Tokens0 in · 0 out0 cached · 0/1 runs covered

LLM spendunavailable0/1 runs provider-priced

ExecutionLocal · not metered14s agent

first-task.runner-codex.local.interview-first-response

Matchers and test context

Attempt: 1
Duration: 46s
Agent runtime: 14s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: FIR-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.interview-questions","expected":true}	One structured interview with 3–4 questions
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-premature-work","expected":true}	Before acceptance: no hires, execution tasks, finished output, or claimed completion; closing an unexecuted rejected task is allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 14458,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null
}

clear-task-first-response failed

Tokens17,871 in · 145 out0 cached · 1/1 runs covered

LLM spend$0.0000001/1 runs provider-priced

ExecutionLocal · not metered17s agent

first-task.runner-codex.local.clear-task-first-response

Matchers and test context

Attempt: 1
Duration: 50s
Agent runtime: 17s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: FIR-1

Behavior failure: work executed before acceptance [2mexpect([22m[31mreceived[39m[2m).[22mtoBe[2m([22m[32mexpected[39m[2m) // Object.is equality[22m Expected: [32mtrue[39m Received: [31mfalse[39m

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.subtask-proposal","expected":true}	Propose a task for the concrete request
Fail	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-premature-work","expected":true}	Before acceptance: no hires, execution tasks, finished output, or claimed completion; closing an unexecuted rejected task is allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 1,
      "inputTokens": 17871,
      "outputTokens": 145,
      "cachedInputTokens": 0,
      "totalTokens": 18016,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 17435,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "model": "gpt-5.6-sol",
    "biller": "openai",
    "costUsd": 0,
    "provider": "openai",
    "costStatus": "reported",
    "billingType": "unknown",
    "inputTokens": 17871,
    "usageSource": "per_run",
    "freshSession": true,
    "outputTokens": 145,
    "sessionReused": false,
    "rawInputTokens": 17871,
    "sessionRotated": false,
    "configFreshness": {
      "session": {
        "reset": false,
        "categories": [
          "adapter",
          "adapterConfig",
          "agentRuntimeConfig",
          "instructions",
          "issueOverrides",
          "workspaceConfig",
          "environment",
          "envBindings",
          "secrets",
          "runtimeSkills"
        ],
        "resetReasons": [],
        "nextFingerprint": "v1:sha256:bba67e131737ed67be08a73364fde3ce1aa46cc7c073d9c9abcf6952214f13a4",
        "changedCategories": [],
        "taskSessionReused": false,
        "fingerprintVersion": 1,
        "taskSessionAvailable": false,
        "storedFingerprintPresent": false
      },
      "version": 1,
      "workspace": {
        "action": "create",
        "reasons": [],
        "categories": [
          "mode",
          "projectWorkspace",
          "strategy",
          "repo",
          "lifecycleCommands",
          "runtimeServices",
          "environment",
          "realization"
        ],
        "reuseRequested": false,
        "nextFingerprint": "v1:sha256:7c8e973583c092465ed57201d1eaa63a6c213fb8f898df8bf2839e9ecd5018a4",
        "workspaceReused": false,
        "activeWorkspaceId": "8126a017-8ef3-45bc-a0ad-6793d9387470",
        "changedCategories": [],
        "storedFingerprint": null,
        "fingerprintVersion": 1,
        "inferredFingerprint": null,
        "previousWorkspaceId": null,
        "configSnapshotRefreshed": false,
        "storedFingerprintPresent": false
      }
    },
    "rawOutputTokens": 145,
    "cachedInputTokens": 0,
    "taskSessionReused": false,
    "persistedSessionId": "01a0a731-3319-7593-bcb0-d22a6afbd439",
    "cacheAdjustedCostUsd": 0,
    "rawCachedInputTokens": 0,
    "sessionRotationReason": null
  }
}

ambiguous-task-first-response passed

Tokens0 in · 0 out0 cached · 0/1 runs covered

LLM spendunavailable0/1 runs provider-priced

ExecutionLocal · not metered10s agent

first-task.runner-codex.local.ambiguous-task-first-response

Matchers and test context

Attempt: 1
Duration: 40s
Agent runtime: 10s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: FIR-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.focused-clarification","expected":true}	Ask focused questions before proposing ambiguous work
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-premature-work","expected":true}	Before acceptance: no hires, execution tasks, finished output, or claimed completion; closing an unexecuted rejected task is allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 10265,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null
}

plain-message-first-response failed

Tokens17,993 in · 145 out0 cached · 1/1 runs covered

LLM spend$0.0000001/1 runs provider-priced

ExecutionLocal · not metered15s agent

first-task.runner-codex.local.plain-message-first-response

Matchers and test context

Attempt: 1
Duration: 45s
Agent runtime: 15s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: FIR-1

Behavior failure: work executed before acceptance [2mexpect([22m[31mreceived[39m[2m).[22mtoBe[2m([22m[32mexpected[39m[2m) // Object.is equality[22m Expected: [32mtrue[39m Received: [31mfalse[39m

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.subtask-proposal","expected":true}	Propose a task for the concrete request
Fail	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-premature-work","expected":true}	Before acceptance: no hires, execution tasks, finished output, or claimed completion; closing an unexecuted rejected task is allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 1,
      "inputTokens": 17993,
      "outputTokens": 145,
      "cachedInputTokens": 0,
      "totalTokens": 18138,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 14854,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "model": "gpt-5.6-sol",
    "biller": "openai",
    "costUsd": 0,
    "provider": "openai",
    "costStatus": "reported",
    "billingType": "unknown",
    "inputTokens": 17993,
    "usageSource": "per_run",
    "freshSession": true,
    "outputTokens": 145,
    "sessionReused": false,
    "rawInputTokens": 17993,
    "sessionRotated": false,
    "configFreshness": {
      "session": {
        "reset": false,
        "categories": [
          "adapter",
          "adapterConfig",
          "agentRuntimeConfig",
          "instructions",
          "issueOverrides",
          "workspaceConfig",
          "environment",
          "envBindings",
          "secrets",
          "runtimeSkills"
        ],
        "resetReasons": [],
        "nextFingerprint": "v1:sha256:8b5bf23d652c308d186381df7dcd5ada481ebecf42f4f1e36b0247a002914c38",
        "changedCategories": [],
        "taskSessionReused": false,
        "fingerprintVersion": 1,
        "taskSessionAvailable": false,
        "storedFingerprintPresent": false
      },
      "version": 1,
      "workspace": {
        "action": "create",
        "reasons": [],
        "categories": [
          "mode",
          "projectWorkspace",
          "strategy",
          "repo",
          "lifecycleCommands",
          "runtimeServices",
          "environment",
          "realization"
        ],
        "reuseRequested": false,
        "nextFingerprint": "v1:sha256:43c5e369ce3d49ad42f56b1dc2e00e93dd33987074b4e9a44f89ac5f909571fe",
        "workspaceReused": false,
        "activeWorkspaceId": "d3bbf715-cdc8-4ed7-9b6b-b21561d9e7cf",
        "changedCategories": [],
        "storedFingerprint": null,
        "fingerprintVersion": 1,
        "inferredFingerprint": null,
        "previousWorkspaceId": null,
        "configSnapshotRefreshed": false,
        "storedFingerprintPresent": false
      }
    },
    "rawOutputTokens": 145,
    "cachedInputTokens": 0,
    "taskSessionReused": false,
    "persistedSessionId": "01a0a731-21d9-7a32-993e-824ddbbf8b89",
    "cacheAdjustedCostUsd": 0,
    "rawCachedInputTokens": 0,
    "sessionRotationReason": null
  }
}

plan-first-response passed

Tokens56,306 in · 735 out36,628 cached · 1/1 runs covered

LLM spend$0.0000001/1 runs provider-priced

ExecutionLocal · not metered26s agent

first-task.runner-codex.local.plan-first-response

Matchers and test context

Attempt: 1
Duration: 56s
Agent runtime: 26s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: FIR-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.durable-plan","expected":true}	Save the requested plan before acceptance
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-premature-work","expected":true}	Before acceptance: no hires, execution tasks, finished output, or claimed completion; closing an unexecuted rejected task is allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 1,
      "inputTokens": 56306,
      "outputTokens": 735,
      "cachedInputTokens": 36628,
      "totalTokens": 93669,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 26015,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "model": "gpt-5.6-sol",
    "biller": "openai",
    "costUsd": 0,
    "provider": "openai",
    "costStatus": "reported",
    "billingType": "unknown",
    "inputTokens": 56306,
    "usageSource": "per_run",
    "freshSession": true,
    "outputTokens": 735,
    "sessionReused": false,
    "rawInputTokens": 56306,
    "sessionRotated": false,
    "configFreshness": {
      "session": {
        "reset": false,
        "categories": [
          "adapter",
          "adapterConfig",
          "agentRuntimeConfig",
          "instructions",
          "issueOverrides",
          "workspaceConfig",
          "environment",
          "envBindings",
          "secrets",
          "runtimeSkills"
        ],
        "resetReasons": [],
        "nextFingerprint": "v1:sha256:a258403ce898fe906904c79e39ce75cfbea92311a02da33e4f1776aee40ccc35",
        "changedCategories": [],
        "taskSessionReused": false,
        "fingerprintVersion": 1,
        "taskSessionAvailable": false,
        "storedFingerprintPresent": false
      },
      "version": 1,
      "workspace": {
        "action": "create",
        "reasons": [],
        "categories": [
          "mode",
          "projectWorkspace",
          "strategy",
          "repo",
          "lifecycleCommands",
          "runtimeServices",
          "environment",
          "realization"
        ],
        "reuseRequested": false,
        "nextFingerprint": "v1:sha256:15e3ded6056b9afe66e27b5cd0e8250af4424127a22f112e3a9914dff1ce0f35",
        "workspaceReused": false,
        "activeWorkspaceId": "e82e3361-78e1-4596-b13d-138d0f9cc5f4",
        "changedCategories": [],
        "storedFingerprint": null,
        "fingerprintVersion": 1,
        "inferredFingerprint": null,
        "previousWorkspaceId": null,
        "configSnapshotRefreshed": false,
        "storedFingerprintPresent": false
      }
    },
    "rawOutputTokens": 735,
    "cachedInputTokens": 36628,
    "taskSessionReused": false,
    "persistedSessionId": "01a0a731-2e57-71a3-b404-4f1a43d3cd96",
    "cacheAdjustedCostUsd": 0,
    "rawCachedInputTokens": 36628,
    "sessionRotationReason": null
  }
}

ordinary-task-control passed

Tokens68,471 in · 1,420 out50,220 cached · 1/1 runs covered

LLM spend$0.0000001/1 runs provider-priced

ExecutionLocal · not metered47s agent

first-task.runner-codex.local.ordinary-task-control

Matchers and test context

Attempt: 1
Duration: 1m 25s
Agent runtime: 47s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: FIR-2

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.ordinary-task-control","expected":true}	Ordinary work produces output without onboarding questions or delegation
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 1,
      "inputTokens": 68471,
      "outputTokens": 1420,
      "cachedInputTokens": 50220,
      "totalTokens": 120111,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 46606,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "model": "gpt-5.6-sol",
    "biller": "openai",
    "costUsd": 0,
    "provider": "openai",
    "costStatus": "reported",
    "billingType": "unknown",
    "inputTokens": 68471,
    "usageSource": "per_run",
    "freshSession": true,
    "outputTokens": 1420,
    "sessionReused": false,
    "rawInputTokens": 68471,
    "sessionRotated": false,
    "configFreshness": {
      "session": {
        "reset": true,
        "categories": [
          "adapter",
          "adapterConfig",
          "agentRuntimeConfig",
          "instructions",
          "issueOverrides",
          "workspaceConfig",
          "environment",
          "envBindings",
          "secrets",
          "runtimeSkills"
        ],
        "resetReasons": [],
        "nextFingerprint": "v1:sha256:8e100fb3b5dfdaeca74f90e08e780538593a3cc7b70e3ab4fdd1922cfc5dbb36",
        "changedCategories": [],
        "taskSessionReused": false,
        "fingerprintVersion": 1,
        "taskSessionAvailable": false,
        "storedFingerprintPresent": false
      },
      "version": 1,
      "workspace": {
        "action": "create",
        "reasons": [],
        "categories": [
          "mode",
          "projectWorkspace",
          "strategy",
          "repo",
          "lifecycleCommands",
          "runtimeServices",
          "environment",
          "realization"
        ],
        "reuseRequested": false,
        "nextFingerprint": "v1:sha256:26cf96bfac34969cda7707cbc811f978dab9d7eff1268b5367536708c1a1b308",
        "workspaceReused": false,
        "activeWorkspaceId": null,
        "changedCategories": [],
        "storedFingerprint": null,
        "fingerprintVersion": 1,
        "inferredFingerprint": null,
        "previousWorkspaceId": null,
        "configSnapshotRefreshed": false,
        "storedFingerprintPresent": false
      }
    },
    "rawOutputTokens": 1420,
    "cachedInputTokens": 50220,
    "taskSessionReused": false,
    "persistedSessionId": "01a0a731-373c-7c82-888f-0616206e08f4",
    "cacheAdjustedCostUsd": 0,
    "rawCachedInputTokens": 50220,
    "sessionRotationReason": null
  }
}

interview-plan-accept passed

Tokens400,590 in · 4,222 out315,736 cached · 4/5 runs covered

LLM spend$0.0000004/5 runs provider-priced

ExecutionLocal · not metered2m 31s agent

first-task.runner-codex.local.interview-plan-accept

Matchers and test context

Attempt: 1
Duration: 2m 32s
Agent runtime: 2m 31s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: FIR-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.interview-questions","expected":true}	One structured interview with 3–4 questions
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.durable-plan","expected":true}	Save the requested plan before acceptance
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-premature-work","expected":true}	Before acceptance: no hires, execution tasks, finished output, or claimed completion; closing an unexecuted rejected task is allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.acceptance-recorded","expected":true}	Explicit acceptance is persisted as a user comment or approved confirmation card
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.accepted-plan-retained","expected":true}	The accepted plan remains available as a durable document
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 5,
      "runsWithTokenUsage": 4,
      "runsWithReportedCost": 4,
      "inputTokens": 400590,
      "outputTokens": 4222,
      "cachedInputTokens": 315736,
      "totalTokens": 720548,
      "reportedCostUsd": 0,
      "costStatus": "partial"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 151191,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "0eb86011-ff3f-45bd-8b1e-7ba41340aeb5",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 82520,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 648,
          "sessionReused": true,
          "rawInputTokens": 82520,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:5ec372e86432a95fe1e7a73f057e88d6144e112779eeaa1f80ae4d1a433c0f54",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:cc561467c59961047b8e8b8241e27988c484f1a64b8c31f9b0b10c83bdcb6711",
              "workspaceReused": false,
              "activeWorkspaceId": "6b6ab0bd-a046-4ccf-9df0-32cb6d95d0d6",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 648,
          "cachedInputTokens": 60824,
          "taskSessionReused": true,
          "persistedSessionId": "01a0a732-7c8d-7cd2-b600-d35130e2e946",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 60824,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "3ee4275d-feab-4a67-b555-5dc55cefcce5",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 104313,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 1357,
          "sessionReused": false,
          "rawInputTokens": 104313,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:5ec372e86432a95fe1e7a73f057e88d6144e112779eeaa1f80ae4d1a433c0f54",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:cc561467c59961047b8e8b8241e27988c484f1a64b8c31f9b0b10c83bdcb6711",
              "workspaceReused": false,
              "activeWorkspaceId": "9f42d951-bbea-4bb0-b60d-e721966f0003",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1357,
          "cachedInputTokens": 85793,
          "taskSessionReused": false,
          "persistedSessionId": "01a0a731-fb76-7361-9fbe-6ce183b42af6",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 85793,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "15f35f8d-c91c-45ca-8d56-7a111a896fd4",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 152355,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 1624,
          "sessionReused": true,
          "rawInputTokens": 152355,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:5ec372e86432a95fe1e7a73f057e88d6144e112779eeaa1f80ae4d1a433c0f54",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:cc561467c59961047b8e8b8241e27988c484f1a64b8c31f9b0b10c83bdcb6711",
              "workspaceReused": false,
              "activeWorkspaceId": "b445e083-33a5-4f49-8638-4207b4ff3b47",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1624,
          "cachedInputTokens": 129063,
          "taskSessionReused": true,
          "persistedSessionId": "01a0a731-bac3-7471-b5fc-2416ba9a5a50",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 129063,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "674c1209-f439-4378-91a3-0c2f355bf6ed",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 61402,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 593,
          "sessionReused": true,
          "rawInputTokens": 61402,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:5ec372e86432a95fe1e7a73f057e88d6144e112779eeaa1f80ae4d1a433c0f54",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:cc561467c59961047b8e8b8241e27988c484f1a64b8c31f9b0b10c83bdcb6711",
              "workspaceReused": false,
              "activeWorkspaceId": "9a6713a3-7b83-40d0-b6f4-d1185c8e2b27",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 593,
          "cachedInputTokens": 40056,
          "taskSessionReused": true,
          "persistedSessionId": "01a0a731-3f78-7d31-a818-9ac2153bdaf3",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 40056,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "e0a6c069-d31c-4c33-8504-dc8a81c25356",
        "usage": null
      }
    ]
  }
}

task-card-accept passed

Tokens241,747 in · 3,066 out183,893 cached · 3/3 runs covered

LLM spend$0.0000003/3 runs provider-priced

ExecutionLocal · not metered1m 32s agent

first-task.runner-codex.local.task-card-accept

Matchers and test context

Attempt: 1
Duration: 1m 42s
Agent runtime: 1m 32s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: FIR-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.subtask-proposal","expected":true}	Propose a task for the concrete request
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-premature-work","expected":true}	Before acceptance: no hires, execution tasks, finished output, or claimed completion; closing an unexecuted rejected task is allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.acceptance-recorded","expected":true}	Explicit acceptance is persisted as a user comment or approved confirmation card
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.one-scoped-subtask","expected":true}	Exactly one approved subtask belongs to this onboarding issue and agent
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.creation-after-acceptance","expected":true}	Task creation must follow acceptance, including between checkpoints
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.durable-completion","expected":true}	Approved output is saved on the completed child, with revised scope when applicable
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 3,
      "runsWithReportedCost": 3,
      "inputTokens": 241747,
      "outputTokens": 3066,
      "cachedInputTokens": 183893,
      "totalTokens": 428706,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 91726,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "79e642c5-af4d-4780-9b66-79decb475ebf",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 86433,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 1063,
          "sessionReused": false,
          "rawInputTokens": 86433,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:a18eb078d5d07fb66e6dcd765718f30166d308c499282874ec97e678437b168a",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:369ab3978db158647fdbc8c008742bf59b0c3858830d19378d6b4b044a328d9c",
              "workspaceReused": false,
              "activeWorkspaceId": "05d2af0c-da51-48d3-ab45-cc2dc4b21d6d",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1063,
          "cachedInputTokens": 68304,
          "taskSessionReused": false,
          "persistedSessionId": "01a0a731-b9d4-7a23-9129-52d01834b5ad",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 68304,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "27ba3e96-b66d-4bf1-92ab-6dca1897ef7f",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 118863,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 1500,
          "sessionReused": true,
          "rawInputTokens": 118863,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:a18eb078d5d07fb66e6dcd765718f30166d308c499282874ec97e678437b168a",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:369ab3978db158647fdbc8c008742bf59b0c3858830d19378d6b4b044a328d9c",
              "workspaceReused": false,
              "activeWorkspaceId": "6475a89c-dd07-444c-91db-71734e4d178c",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1500,
          "cachedInputTokens": 97726,
          "taskSessionReused": true,
          "persistedSessionId": "01a0a731-739a-70a1-beed-f814e841c138",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 97726,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "a1aaa9c5-f1db-413d-bc21-bea4c1b45b36",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 36451,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 503,
          "sessionReused": false,
          "rawInputTokens": 36451,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:a18eb078d5d07fb66e6dcd765718f30166d308c499282874ec97e678437b168a",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:369ab3978db158647fdbc8c008742bf59b0c3858830d19378d6b4b044a328d9c",
              "workspaceReused": false,
              "activeWorkspaceId": "89973972-5e5f-45c3-aabf-9a1333f6e276",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 503,
          "cachedInputTokens": 17863,
          "taskSessionReused": false,
          "persistedSessionId": "01a0a731-24dc-76c1-b4a0-a97b125ddfd5",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 17863,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

task-reply-accept passed

Tokens290,119 in · 3,109 out230,267 cached · 3/3 runs covered

LLM spend$0.0000003/3 runs provider-priced

ExecutionLocal · not metered2m 5s agent

first-task.runner-codex.local.task-reply-accept

Matchers and test context

Attempt: 1
Duration: 1m 58s
Agent runtime: 2m 5s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: FIR-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.subtask-proposal","expected":true}	Propose a task for the concrete request
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-premature-work","expected":true}	Before acceptance: no hires, execution tasks, finished output, or claimed completion; closing an unexecuted rejected task is allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.acceptance-recorded","expected":true}	Explicit acceptance is persisted as a user comment or approved confirmation card
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.one-scoped-subtask","expected":true}	Exactly one approved subtask belongs to this onboarding issue and agent
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.creation-after-acceptance","expected":true}	Task creation must follow acceptance, including between checkpoints
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.durable-completion","expected":true}	Approved output is saved on the completed child, with revised scope when applicable
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 3,
      "runsWithReportedCost": 3,
      "inputTokens": 290119,
      "outputTokens": 3109,
      "cachedInputTokens": 230267,
      "totalTokens": 523495,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 124695,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "821f4601-777c-4db2-b6ec-5f75783570e1",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 68893,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 1310,
          "sessionReused": false,
          "rawInputTokens": 68893,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:44e416273fd8730eda37bcef911ab520abaecad825ead9d2493bfd5d0640a963",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:e2aa9f5f3235d8e5be9a146c81d0f9e7ecabe4afbd685b2966e35d377d333280",
              "workspaceReused": false,
              "activeWorkspaceId": "ca4c71f2-5a4d-4ea5-b285-76327e76f4eb",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1310,
          "cachedInputTokens": 50591,
          "taskSessionReused": false,
          "persistedSessionId": "01a0a731-bc14-7313-95c8-85c034aa2f56",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 50591,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "ce73bb12-de1f-4029-a78d-1fadecfda4a2",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 165298,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 1268,
          "sessionReused": true,
          "rawInputTokens": 165298,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:44e416273fd8730eda37bcef911ab520abaecad825ead9d2493bfd5d0640a963",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:e2aa9f5f3235d8e5be9a146c81d0f9e7ecabe4afbd685b2966e35d377d333280",
              "workspaceReused": false,
              "activeWorkspaceId": "b34a8e10-e5c0-410a-b131-03317066862f",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1268,
          "cachedInputTokens": 143111,
          "taskSessionReused": true,
          "persistedSessionId": "01a0a731-7beb-7400-b8a9-fc69ecf11b7c",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 143111,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "95054d47-4d68-4ea1-ac85-88595ef528cb",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 55928,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 531,
          "sessionReused": false,
          "rawInputTokens": 55928,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:44e416273fd8730eda37bcef911ab520abaecad825ead9d2493bfd5d0640a963",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:e2aa9f5f3235d8e5be9a146c81d0f9e7ecabe4afbd685b2966e35d377d333280",
              "workspaceReused": false,
              "activeWorkspaceId": "b4eef29e-0b96-450b-95a2-f52b51fc319f",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 531,
          "cachedInputTokens": 36565,
          "taskSessionReused": false,
          "persistedSessionId": "01a0a731-1aa3-7162-b517-ed74aaa7f16d",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 36565,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

clarify-propose-accept passed

Tokens205,263 in · 3,325 out147,948 cached · 3/4 runs covered

LLM spend$0.0000003/4 runs provider-priced

ExecutionLocal · not metered1m 40s agent

first-task.runner-codex.local.clarify-propose-accept

Matchers and test context

Attempt: 1
Duration: 1m 56s
Agent runtime: 1m 40s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: FIR-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.focused-clarification","expected":true}	Ask focused questions before proposing ambiguous work
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-premature-work","expected":true}	Before acceptance: no hires, execution tasks, finished output, or claimed completion; closing an unexecuted rejected task is allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.acceptance-recorded","expected":true}	Explicit acceptance is persisted as a user comment or approved confirmation card
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.one-scoped-subtask","expected":true}	Exactly one approved subtask belongs to this onboarding issue and agent
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.creation-after-acceptance","expected":true}	Task creation must follow acceptance, including between checkpoints
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.durable-completion","expected":true}	Approved output is saved on the completed child, with revised scope when applicable
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 4,
      "runsWithTokenUsage": 3,
      "runsWithReportedCost": 3,
      "inputTokens": 205263,
      "outputTokens": 3325,
      "cachedInputTokens": 147948,
      "totalTokens": 356536,
      "reportedCostUsd": 0,
      "costStatus": "partial"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 100278,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "fe117df5-c4b4-4dd9-a535-5988c827afbe",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 86106,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 1178,
          "sessionReused": false,
          "rawInputTokens": 86106,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:767041ce92731a09cef06460bdf6bc5fd91120d552b7b8b80a1f15a2b633667b",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:66ff81fa61e0327c8bf4d1824aefcd666df63dc16b943832b0afb3391dd92d6a",
              "workspaceReused": false,
              "activeWorkspaceId": "264ca34e-084a-4431-9eca-9401cd993402",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1178,
          "cachedInputTokens": 67940,
          "taskSessionReused": false,
          "persistedSessionId": "01a0a732-08d9-7341-a9b6-ef287382f49d",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 67940,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "8b4546d2-f437-40aa-af33-61e4403822d4",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 101494,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 1513,
          "sessionReused": true,
          "rawInputTokens": 101494,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:767041ce92731a09cef06460bdf6bc5fd91120d552b7b8b80a1f15a2b633667b",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:66ff81fa61e0327c8bf4d1824aefcd666df63dc16b943832b0afb3391dd92d6a",
              "workspaceReused": false,
              "activeWorkspaceId": "559a4ed1-5d58-44bd-a210-83f213cc3358",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1513,
          "cachedInputTokens": 80008,
          "taskSessionReused": true,
          "persistedSessionId": "01a0a731-c74b-7d82-a782-a4cc673a8fd7",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 80008,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "962779b9-e9c8-464b-84a2-87d40e8569ad",
        "usage": null
      },
      {
        "runId": "8152ceb4-4cb6-44c8-b4f9-95077ca53253",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 17663,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 634,
          "sessionReused": false,
          "rawInputTokens": 17663,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:767041ce92731a09cef06460bdf6bc5fd91120d552b7b8b80a1f15a2b633667b",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:66ff81fa61e0327c8bf4d1824aefcd666df63dc16b943832b0afb3391dd92d6a",
              "workspaceReused": false,
              "activeWorkspaceId": "a7b7e2d6-de66-4d72-b1c1-c66397619d3c",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 634,
          "cachedInputTokens": 0,
          "taskSessionReused": false,
          "persistedSessionId": "01a0a731-2d36-7c82-b842-55c569e6d779",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 0,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

revise-accept passed

Tokens169,209 in · 2,617 out111,292 cached · 3/4 runs covered

LLM spend$0.0000003/4 runs provider-priced

ExecutionLocal · not metered1m 41s agent

first-task.runner-codex.local.revise-accept

Matchers and test context

Attempt: 1
Duration: 2m 3s
Agent runtime: 1m 41s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: FIR-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.subtask-proposal","expected":true}	Propose a task for the concrete request
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-premature-work","expected":true}	Before acceptance: no hires, execution tasks, finished output, or claimed completion; closing an unexecuted rejected task is allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.acceptance-recorded","expected":true}	Explicit acceptance is persisted as a user comment or approved confirmation card
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.one-scoped-subtask","expected":true}	Exactly one approved subtask belongs to this onboarding issue and agent
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.creation-after-acceptance","expected":true}	Task creation must follow acceptance, including between checkpoints
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.durable-completion","expected":true}	Approved output is saved on the completed child, with revised scope when applicable
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 4,
      "runsWithTokenUsage": 3,
      "runsWithReportedCost": 3,
      "inputTokens": 169209,
      "outputTokens": 2617,
      "cachedInputTokens": 111292,
      "totalTokens": 283118,
      "reportedCostUsd": 0,
      "costStatus": "partial"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 101459,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "21a22e22-5c57-4bb9-bd09-bdc505c215e5",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 69628,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 1323,
          "sessionReused": false,
          "rawInputTokens": 69628,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:11607a1d7b713b314527dd1c86c71bcd9834d4396a672834a69e67b412e86753",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:728fbaed7442bd47eb4a5548c3f2a12393b9bfb2f2af6b76faa0289bd41829dc",
              "workspaceReused": false,
              "activeWorkspaceId": "6f379e77-f135-4502-96e1-22439dc3625c",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1323,
          "cachedInputTokens": 51235,
          "taskSessionReused": false,
          "persistedSessionId": "01a0a731-ee83-7940-a92a-ebc3025ce1d0",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 51235,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "022e3744-5195-4838-96c1-c0be17098a33",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 81703,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 1191,
          "sessionReused": true,
          "rawInputTokens": 81703,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:11607a1d7b713b314527dd1c86c71bcd9834d4396a672834a69e67b412e86753",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:728fbaed7442bd47eb4a5548c3f2a12393b9bfb2f2af6b76faa0289bd41829dc",
              "workspaceReused": false,
              "activeWorkspaceId": "08d4c0b0-4844-49f5-b7e1-52a657e8a727",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1191,
          "cachedInputTokens": 60057,
          "taskSessionReused": true,
          "persistedSessionId": "01a0a731-b82c-7d23-ba46-8a405fd54e0c",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 60057,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "7f71de62-3ecd-44ab-8094-08c0d0f1aada",
        "usage": null
      },
      {
        "runId": "5d5f6df1-9225-48c4-86a8-e78590e3c5d1",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 17878,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 103,
          "sessionReused": false,
          "rawInputTokens": 17878,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:11607a1d7b713b314527dd1c86c71bcd9834d4396a672834a69e67b412e86753",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:728fbaed7442bd47eb4a5548c3f2a12393b9bfb2f2af6b76faa0289bd41829dc",
              "workspaceReused": false,
              "activeWorkspaceId": "17905b40-7c47-476a-81a0-98203888a0a6",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 103,
          "cachedInputTokens": 0,
          "taskSessionReused": false,
          "persistedSessionId": "01a0a730-fc17-7033-a1e5-534fc046de80",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 0,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

reject-no-execution passed

Tokens55,743 in · 383 out18,753 cached · 2/2 runs covered

LLM spend$0.0000002/2 runs provider-priced

ExecutionLocal · not metered25s agent

first-task.runner-codex.local.reject-no-execution

Matchers and test context

Attempt: 1
Duration: 58s
Agent runtime: 25s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: FIR-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.recorded-response","expected":true}	An agent response or structured interaction was recorded
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.instruction-snapshot","expected":true}	Actual persona and skill were retained with verified hashes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.question-choice-options","expected":true}	Every presented choice question offers at least two distinct options; open-ended text questions are allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-reintroduction","expected":true}	Do not repeat the seeded welcome
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.opening-not-repeated","expected":true}	Do not post another opening choice
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.subtask-proposal","expected":true}	Propose a task for the concrete request
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.no-premature-work","expected":true}	Before acceptance: no hires, execution tasks, finished output, or claimed completion; closing an unexecuted rejected task is allowed
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.rejection-respected","expected":true}	Rejected work never executes
Pass	`json_path`	{"kind":"json_path","path":"firstTask.checks.provider-runs-succeeded","expected":true}	All observed provider runs settled successfully

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 55743,
      "outputTokens": 383,
      "cachedInputTokens": 18753,
      "totalTokens": 74879,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 24553,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "c6f2889d-590b-4ce3-8d05-5f8ad989298f",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 37843,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 269,
          "sessionReused": true,
          "rawInputTokens": 37843,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:c9bfcc205cc50250320b87c8ad5756c4e1117f46d7f7a7b3046e3b813b7f9123",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:8ffba08f9f7de9945085180461b2f27f12c0f9843244538c1e941c46d9eff217",
              "workspaceReused": false,
              "activeWorkspaceId": "1cea1323-4a8a-4cb2-8117-7b2da0bb43dc",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 269,
          "cachedInputTokens": 18753,
          "taskSessionReused": true,
          "persistedSessionId": "01a0a731-6d92-75b3-9eb1-4227af7b4bc8",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 18753,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "215e3ceb-62b4-4cbf-aa87-3e79a119138a",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 17900,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 114,
          "sessionReused": false,
          "rawInputTokens": 17900,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:c9bfcc205cc50250320b87c8ad5756c4e1117f46d7f7a7b3046e3b813b7f9123",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:8ffba08f9f7de9945085180461b2f27f12c0f9843244538c1e941c46d9eff217",
              "workspaceReused": false,
              "activeWorkspaceId": "5c1fd830-d557-4705-bcf6-a7529205bc65",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 114,
          "cachedInputTokens": 0,
          "taskSessionReused": false,
          "persistedSessionId": "01a0a731-269d-7581-a24a-0fa7d273e0c4",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 0,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

History

Campaign trends

No historical campaigns have been published yet.