continuation.legacy-codex.local.answer-updates-scope
Matchers and test context
Not selected
No matcher result was recorded.
Full-stack acceptance campaign
A browser-verified matrix of runner profiles, execution environments, and deterministic task contracts. Declared PNG screenshots and sanitized structured evidence are retained with every published campaign; additional diagnostic evidence remains in the access-controlled workflow artifact.

Model spend is the provider-reported subtotal; unpriced or unavailable runs are excluded, never counted as free. Daytona runtime is a public-list-price estimate from captured lease time and pinned resources, before credits, discounts, storage allowance, or invoice adjustments. Local execution has no external runtime meter.
Test suite
Human direction, approval boundaries, untrusted evidence, and completed actions across turns.
| Agent profile | Isolated locallocal · local |
|---|---|
Legacy Codexlegacycodex · gpt-5.6-sol
|
Isolated locallocal · local
answer updates scope
not selected
continuation.legacy-codex.local.answer-updates-scope
Matchers and test contextNot selected No matcher result was recorded.
clarification not approval
not selected
continuation.legacy-codex.local.clarification-not-approval
Matchers and test contextNot selected No matcher result was recorded.
revision preserves approval
not selected
continuation.legacy-codex.local.revision-preserves-approval
Matchers and test contextNot selected No matcher result was recorded.
untrusted evidence
not selected
continuation.legacy-codex.local.untrusted-evidence
Matchers and test contextNot selected No matcher result was recorded.
completed action resume
not selected
continuation.legacy-codex.local.completed-action-resume
Matchers and test contextNot selected No matcher result was recorded. |
Legacy Claudelegacyclaude · claude-sonnet-4-6
|
Isolated locallocal · local
answer updates scope
not selected
continuation.legacy-claude.local.answer-updates-scope
Matchers and test contextNot selected No matcher result was recorded.
clarification not approval
not selected
continuation.legacy-claude.local.clarification-not-approval
Matchers and test contextNot selected No matcher result was recorded.
revision preserves approval
not selected
continuation.legacy-claude.local.revision-preserves-approval
Matchers and test contextNot selected No matcher result was recorded.
untrusted evidence
not selected
continuation.legacy-claude.local.untrusted-evidence
Matchers and test contextNot selected No matcher result was recorded.
completed action resume
not selected
continuation.legacy-claude.local.completed-action-resume
Matchers and test contextNot selected No matcher result was recorded. |
Runner Codexnativecodex · gpt-5.6-sol
|
Isolated locallocal · local
answer updates scope
not selected
continuation.runner-codex.local.answer-updates-scope
Matchers and test contextNot selected No matcher result was recorded.
clarification not approval
not selected
continuation.runner-codex.local.clarification-not-approval
Matchers and test contextNot selected No matcher result was recorded.
revision preserves approval
not selected
continuation.runner-codex.local.revision-preserves-approval
Matchers and test contextNot selected No matcher result was recorded.
untrusted evidence
not selected
continuation.runner-codex.local.untrusted-evidence
Matchers and test contextNot selected No matcher result was recorded.
completed action resume
not selected
continuation.runner-codex.local.completed-action-resume
Matchers and test contextNot selected No matcher result was recorded.
question tool documentation
not selected
continuation.runner-codex.local.question-tool-documentation
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Claudenativeacpx · claude-sonnet-5
|
Isolated locallocal · local
answer updates scope
not selected
continuation.runner-acpx-claude.local.answer-updates-scope
Matchers and test contextNot selected No matcher result was recorded.
clarification not approval
not selected
continuation.runner-acpx-claude.local.clarification-not-approval
Matchers and test contextNot selected No matcher result was recorded.
revision preserves approval
not selected
continuation.runner-acpx-claude.local.revision-preserves-approval
Matchers and test contextNot selected No matcher result was recorded.
untrusted evidence
not selected
continuation.runner-acpx-claude.local.untrusted-evidence
Matchers and test contextNot selected No matcher result was recorded.
completed action resume
not selected
continuation.runner-acpx-claude.local.completed-action-resume
Matchers and test contextNot selected No matcher result was recorded.
question tool documentation
not selected
continuation.runner-acpx-claude.local.question-tool-documentation
Matchers and test contextNot selected No matcher result was recorded.
provider question bridge
not selected
continuation.runner-acpx-claude.local.provider-question-bridge
Matchers and test contextNot selected No matcher result was recorded. |
Test suite
Real user requests, useful downloaded work, and durable continuation using production instructions.
| Agent profile | Isolated locallocal · local | Daytona warm reusable sandboxdaytona · remote |
|---|---|---|
Runner Codexnativecodex · gpt-5.6-sol
|
Isolated locallocal · local
Build, download, and revise a project
not selected
everyday-workflows.runner-codex.local.build-revise
Matchers and test contextNot selected No matcher result was recorded.
Delegate implementation and preserve late feedback
not selected
everyday-workflows.runner-codex.local.delegate-feedback
Matchers and test contextNot selected No matcher result was recorded.
Delegate work through an agent review handoff
not selected
everyday-workflows.runner-codex.local.agent-review-handoff
Matchers and test contextNot selected No matcher result was recorded.
Hire one teammate, then reuse that agent
not selected
everyday-workflows.runner-codex.local.hire-reuse
Matchers and test contextNot selected No matcher result was recorded.
Use a connection after approval
not selected
everyday-workflows.runner-codex.local.service-approve
Matchers and test contextNot selected No matcher result was recorded.
Respect a declined tool action
not selected
everyday-workflows.runner-codex.local.service-decline
Matchers and test contextNot selected No matcher result was recorded.
Respect Not now on a new connection
not selected
everyday-workflows.runner-codex.local.connection-decline
Matchers and test contextNot selected No matcher result was recorded.
Recover work after the server restarts
not selected
everyday-workflows.runner-codex.local.recover-controller
Matchers and test contextNot selected No matcher result was recorded.
Stop a task and send a new direction once
not selected
everyday-workflows.runner-codex.local.stop-redirect
Matchers and test contextNot selected No matcher result was recorded.
Create and edit a company skill
not selected
everyday-workflows.runner-codex.local.create-skill-studio
Matchers and test contextNot selected No matcher result was recorded. |
Daytona warm reusable sandboxdaytona · remote
Build, download, and revise a project
not selected
everyday-workflows.runner-codex.daytona.build-revise
Matchers and test contextNot selected No matcher result was recorded.
Delegate implementation and preserve late feedback
not selected
everyday-workflows.runner-codex.daytona.delegate-feedback
Matchers and test contextNot selected No matcher result was recorded.
Recover work after the server restarts
not selected
everyday-workflows.runner-codex.daytona.recover-controller
Matchers and test contextNot selected No matcher result was recorded.
Create and edit a company skill
not selected
everyday-workflows.runner-codex.daytona.create-skill-studio
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Claudenativeacpx · claude-sonnet-5
|
Isolated locallocal · local
Build, download, and revise a project
not selected
everyday-workflows.runner-acpx-claude.local.build-revise
Matchers and test contextNot selected No matcher result was recorded.
Delegate implementation and preserve late feedback
not selected
everyday-workflows.runner-acpx-claude.local.delegate-feedback
Matchers and test contextNot selected No matcher result was recorded.
Delegate work through an agent review handoff
not selected
everyday-workflows.runner-acpx-claude.local.agent-review-handoff
Matchers and test contextNot selected No matcher result was recorded.
Hire one teammate, then reuse that agent
not selected
everyday-workflows.runner-acpx-claude.local.hire-reuse
Matchers and test contextNot selected No matcher result was recorded.
Use a connection after approval
not selected
everyday-workflows.runner-acpx-claude.local.service-approve
Matchers and test contextNot selected No matcher result was recorded.
Respect a declined tool action
not selected
everyday-workflows.runner-acpx-claude.local.service-decline
Matchers and test contextNot selected No matcher result was recorded.
Respect Not now on a new connection
not selected
everyday-workflows.runner-acpx-claude.local.connection-decline
Matchers and test contextNot selected No matcher result was recorded.
Recover work after the server restarts
not selected
everyday-workflows.runner-acpx-claude.local.recover-controller
Matchers and test contextNot selected No matcher result was recorded.
Stop a task and send a new direction once
not selected
everyday-workflows.runner-acpx-claude.local.stop-redirect
Matchers and test contextNot selected No matcher result was recorded.
Create and edit a company skill
not selected
everyday-workflows.runner-acpx-claude.local.create-skill-studio
Matchers and test contextNot selected No matcher result was recorded. |
Daytona warm reusable sandboxdaytona · remote
Build, download, and revise a project
not selected
everyday-workflows.runner-acpx-claude.daytona.build-revise
Matchers and test contextNot selected No matcher result was recorded.
Delegate implementation and preserve late feedback
not selected
everyday-workflows.runner-acpx-claude.daytona.delegate-feedback
Matchers and test contextNot selected No matcher result was recorded.
Recover work after the server restarts
not selected
everyday-workflows.runner-acpx-claude.daytona.recover-controller
Matchers and test contextNot selected No matcher result was recorded.
Create and edit a company skill
not selected
everyday-workflows.runner-acpx-claude.daytona.create-skill-studio
Matchers and test contextNot selected No matcher result was recorded. |
Runner Codex Mininativecodex · gpt-5.4-mini
|
Isolated locallocal · local
Build, download, and revise a project
not selected
everyday-workflows.runner-codex-mini.local.build-revise
Matchers and test contextNot selected No matcher result was recorded.
Delegate implementation and preserve late feedback
not selected
everyday-workflows.runner-codex-mini.local.delegate-feedback
Matchers and test contextNot selected No matcher result was recorded.
Delegate work through an agent review handoff
not selected
everyday-workflows.runner-codex-mini.local.agent-review-handoff
Matchers and test contextNot selected No matcher result was recorded.
Hire one teammate, then reuse that agent
not selected
everyday-workflows.runner-codex-mini.local.hire-reuse
Matchers and test contextNot selected No matcher result was recorded.
Use a connection after approval
not selected
everyday-workflows.runner-codex-mini.local.service-approve
Matchers and test contextNot selected No matcher result was recorded.
Respect a declined tool action
not selected
everyday-workflows.runner-codex-mini.local.service-decline
Matchers and test contextNot selected No matcher result was recorded.
Respect Not now on a new connection
not selected
everyday-workflows.runner-codex-mini.local.connection-decline
Matchers and test contextNot selected No matcher result was recorded.
Recover work after the server restarts
not selected
everyday-workflows.runner-codex-mini.local.recover-controller
Matchers and test contextNot selected No matcher result was recorded.
Stop a task and send a new direction once
not selected
everyday-workflows.runner-codex-mini.local.stop-redirect
Matchers and test contextNot selected No matcher result was recorded.
Create and edit a company skill
not selected
everyday-workflows.runner-codex-mini.local.create-skill-studio
Matchers and test contextNot selected No matcher result was recorded. |
Daytona warm reusable sandboxdaytona · remote
|
Test suite
Production onboarding, first replies, approval, and durable task execution.
| Agent profile | Isolated locallocal · local |
|---|---|
Legacy Codexlegacycodex · Production onboarding default
|
Isolated locallocal · local
Interview: first response
not selected
first-task.legacy-codex.local.interview-first-response
Matchers and test contextNot selected No matcher result was recorded.
Clear task: first response
not selected
first-task.legacy-codex.local.clear-task-first-response
Matchers and test contextNot selected No matcher result was recorded.
Ambiguous task: first response
not selected
first-task.legacy-codex.local.ambiguous-task-first-response
Matchers and test contextNot selected No matcher result was recorded.
Opening card replaced by a message
not selected
first-task.legacy-codex.local.plain-message-first-response
Matchers and test contextNot selected No matcher result was recorded.
Explicit plan: first response
not selected
first-task.legacy-codex.local.plan-first-response
Matchers and test contextNot selected No matcher result was recorded.
Other tasks do not inherit onboarding policy
not selected
first-task.legacy-codex.local.ordinary-task-control
Matchers and test contextNot selected No matcher result was recorded.
Interview, plan, and acceptance
not selected
first-task.legacy-codex.local.interview-plan-accept
Matchers and test contextNot selected No matcher result was recorded.
Subtask accepted through a card
not selected
first-task.legacy-codex.local.task-card-accept
Matchers and test contextNot selected No matcher result was recorded.
Accept a proposal while its agent is still running
not selected
first-task.legacy-codex.local.accept-while-running
Matchers and test contextNot selected No matcher result was recorded.
Subtask accepted in conversation
not selected
first-task.legacy-codex.local.task-reply-accept
Matchers and test contextNot selected No matcher result was recorded.
Clarification, proposal, and acceptance
not selected
first-task.legacy-codex.local.clarify-propose-accept
Matchers and test contextNot selected No matcher result was recorded.
Revise scope before accepting
not selected
first-task.legacy-codex.local.revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Decline proposed work
not selected
first-task.legacy-codex.local.reject-no-execution
Matchers and test contextNot selected No matcher result was recorded. |
Legacy Claudelegacyclaude · Production onboarding default
|
Isolated locallocal · local
Interview: first response
not selected
first-task.legacy-claude.local.interview-first-response
Matchers and test contextNot selected No matcher result was recorded.
Clear task: first response
not selected
first-task.legacy-claude.local.clear-task-first-response
Matchers and test contextNot selected No matcher result was recorded.
Ambiguous task: first response
not selected
first-task.legacy-claude.local.ambiguous-task-first-response
Matchers and test contextNot selected No matcher result was recorded.
Opening card replaced by a message
not selected
first-task.legacy-claude.local.plain-message-first-response
Matchers and test contextNot selected No matcher result was recorded.
Explicit plan: first response
not selected
first-task.legacy-claude.local.plan-first-response
Matchers and test contextNot selected No matcher result was recorded.
Other tasks do not inherit onboarding policy
not selected
first-task.legacy-claude.local.ordinary-task-control
Matchers and test contextNot selected No matcher result was recorded.
Interview, plan, and acceptance
not selected
first-task.legacy-claude.local.interview-plan-accept
Matchers and test contextNot selected No matcher result was recorded.
Subtask accepted through a card
not selected
first-task.legacy-claude.local.task-card-accept
Matchers and test contextNot selected No matcher result was recorded.
Accept a proposal while its agent is still running
not selected
first-task.legacy-claude.local.accept-while-running
Matchers and test contextNot selected No matcher result was recorded.
Subtask accepted in conversation
not selected
first-task.legacy-claude.local.task-reply-accept
Matchers and test contextNot selected No matcher result was recorded.
Clarification, proposal, and acceptance
not selected
first-task.legacy-claude.local.clarify-propose-accept
Matchers and test contextNot selected No matcher result was recorded.
Revise scope before accepting
not selected
first-task.legacy-claude.local.revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Decline proposed work
not selected
first-task.legacy-claude.local.reject-no-execution
Matchers and test contextNot selected No matcher result was recorded. |
Runner Codexnativecodex · Production onboarding default
|
Isolated locallocal · local
Interview: first response
not selected
first-task.runner-codex.local.interview-first-response
Matchers and test contextNot selected No matcher result was recorded.
Clear task: first response
not selected
first-task.runner-codex.local.clear-task-first-response
Matchers and test contextNot selected No matcher result was recorded.
Ambiguous task: first response
not selected
first-task.runner-codex.local.ambiguous-task-first-response
Matchers and test contextNot selected No matcher result was recorded.
Opening card replaced by a message
not selected
first-task.runner-codex.local.plain-message-first-response
Matchers and test contextNot selected No matcher result was recorded.
Explicit plan: first response
not selected
first-task.runner-codex.local.plan-first-response
Matchers and test contextNot selected No matcher result was recorded.
Other tasks do not inherit onboarding policy
not selected
first-task.runner-codex.local.ordinary-task-control
Matchers and test contextNot selected No matcher result was recorded.
Interview, plan, and acceptance
not selected
first-task.runner-codex.local.interview-plan-accept
Matchers and test contextNot selected No matcher result was recorded.
Subtask accepted through a card
not selected
first-task.runner-codex.local.task-card-accept
Matchers and test contextNot selected No matcher result was recorded.
Accept a proposal while its agent is still running
not selected
first-task.runner-codex.local.accept-while-running
Matchers and test contextNot selected No matcher result was recorded.
Subtask accepted in conversation
not selected
first-task.runner-codex.local.task-reply-accept
Matchers and test contextNot selected No matcher result was recorded.
Clarification, proposal, and acceptance
not selected
first-task.runner-codex.local.clarify-propose-accept
Matchers and test contextNot selected No matcher result was recorded.
Revise scope before accepting
not selected
first-task.runner-codex.local.revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Decline proposed work
not selected
first-task.runner-codex.local.reject-no-execution
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Claudenativeacpx · Production onboarding default
|
Isolated locallocal · local
Interview: first response
not selected
first-task.runner-acpx-claude.local.interview-first-response
Matchers and test contextNot selected No matcher result was recorded.
Clear task: first response
not selected
first-task.runner-acpx-claude.local.clear-task-first-response
Matchers and test contextNot selected No matcher result was recorded.
Ambiguous task: first response
not selected
first-task.runner-acpx-claude.local.ambiguous-task-first-response
Matchers and test contextNot selected No matcher result was recorded.
Opening card replaced by a message
not selected
first-task.runner-acpx-claude.local.plain-message-first-response
Matchers and test contextNot selected No matcher result was recorded.
Explicit plan: first response
not selected
first-task.runner-acpx-claude.local.plan-first-response
Matchers and test contextNot selected No matcher result was recorded.
Other tasks do not inherit onboarding policy
not selected
first-task.runner-acpx-claude.local.ordinary-task-control
Matchers and test contextNot selected No matcher result was recorded.
Interview, plan, and acceptance
not selected
first-task.runner-acpx-claude.local.interview-plan-accept
Matchers and test contextNot selected No matcher result was recorded.
Subtask accepted through a card
not selected
first-task.runner-acpx-claude.local.task-card-accept
Matchers and test contextNot selected No matcher result was recorded.
Accept a proposal while its agent is still running
not selected
first-task.runner-acpx-claude.local.accept-while-running
Matchers and test contextNot selected No matcher result was recorded.
Subtask accepted in conversation
not selected
first-task.runner-acpx-claude.local.task-reply-accept
Matchers and test contextNot selected No matcher result was recorded.
Clarification, proposal, and acceptance
not selected
first-task.runner-acpx-claude.local.clarify-propose-accept
Matchers and test contextNot selected No matcher result was recorded.
Revise scope before accepting
not selected
first-task.runner-acpx-claude.local.revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Decline proposed work
not selected
first-task.runner-acpx-claude.local.reject-no-execution
Matchers and test contextNot selected No matcher result was recorded. |
Test suite
Task-backed conversations, session resets, and project plan handoff.
| Agent profile | Isolated locallocal · local |
|---|---|
Legacy Codexlegacycodex · gpt-5.6-sol
|
Isolated locallocal · local
Conversation continuity across restart
not selected
agent-chat.legacy-codex.local.continuity-restart
Matchers and test contextNot selected No matcher result was recorded.
Fresh context within preserved history
not selected
agent-chat.legacy-codex.local.new-session
Matchers and test contextNot selected No matcher result was recorded.
Stop, reset, and resume
not selected
agent-chat.legacy-codex.local.stop-new-resume
Matchers and test contextNot selected No matcher result was recorded.
Draft, revise, approve, and hand off a plan
not selected
agent-chat.legacy-codex.local.plan-handoff
Matchers and test contextNot selected No matcher result was recorded.
Clarify and reuse an existing project
not selected
agent-chat.legacy-codex.local.clarify-reuse
Matchers and test contextNot selected No matcher result was recorded.
Create a project with multiple repository URLs
not selected
agent-chat.legacy-codex.local.multi-repository
Matchers and test contextNot selected No matcher result was recorded. |
Legacy Claudelegacyclaude · claude-sonnet-4-6
|
Isolated locallocal · local
Conversation continuity across restart
not selected
agent-chat.legacy-claude.local.continuity-restart
Matchers and test contextNot selected No matcher result was recorded.
Fresh context within preserved history
not selected
agent-chat.legacy-claude.local.new-session
Matchers and test contextNot selected No matcher result was recorded.
Stop, reset, and resume
not selected
agent-chat.legacy-claude.local.stop-new-resume
Matchers and test contextNot selected No matcher result was recorded.
Draft, revise, approve, and hand off a plan
not selected
agent-chat.legacy-claude.local.plan-handoff
Matchers and test contextNot selected No matcher result was recorded.
Clarify and reuse an existing project
not selected
agent-chat.legacy-claude.local.clarify-reuse
Matchers and test contextNot selected No matcher result was recorded.
Create a project with multiple repository URLs
not selected
agent-chat.legacy-claude.local.multi-repository
Matchers and test contextNot selected No matcher result was recorded. |
Runner Codexnativecodex · gpt-5.6-sol
|
Isolated locallocal · local
Save a planned task without starting work
not selected
agent-chat.runner-codex.local.create-backlog
Matchers and test contextNot selected No matcher result was recorded.
Reassign existing work and preserve queued context
not selected
agent-chat.runner-codex.local.reassign-task
Matchers and test contextNot selected No matcher result was recorded.
Conversation continuity across restart
not selected
agent-chat.runner-codex.local.continuity-restart
Matchers and test contextNot selected No matcher result was recorded.
Fresh context within preserved history
not selected
agent-chat.runner-codex.local.new-session
Matchers and test contextNot selected No matcher result was recorded.
Stop, reset, and resume
not selected
agent-chat.runner-codex.local.stop-new-resume
Matchers and test contextNot selected No matcher result was recorded.
Draft, revise, approve, and hand off a plan
not selected
agent-chat.runner-codex.local.plan-handoff
Matchers and test contextNot selected No matcher result was recorded.
Clarify and reuse an existing project
not selected
agent-chat.runner-codex.local.clarify-reuse
Matchers and test contextNot selected No matcher result was recorded.
Create a project with multiple repository URLs
not selected
agent-chat.runner-codex.local.multi-repository
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Claudenativeacpx · claude-sonnet-5
|
Isolated locallocal · local
Save a planned task without starting work
not selected
agent-chat.runner-acpx-claude.local.create-backlog
Matchers and test contextNot selected No matcher result was recorded.
Reassign existing work and preserve queued context
not selected
agent-chat.runner-acpx-claude.local.reassign-task
Matchers and test contextNot selected No matcher result was recorded.
Conversation continuity across restart
not selected
agent-chat.runner-acpx-claude.local.continuity-restart
Matchers and test contextNot selected No matcher result was recorded.
Fresh context within preserved history
not selected
agent-chat.runner-acpx-claude.local.new-session
Matchers and test contextNot selected No matcher result was recorded.
Stop, reset, and resume
not selected
agent-chat.runner-acpx-claude.local.stop-new-resume
Matchers and test contextNot selected No matcher result was recorded.
Draft, revise, approve, and hand off a plan
not selected
agent-chat.runner-acpx-claude.local.plan-handoff
Matchers and test contextNot selected No matcher result was recorded.
Clarify and reuse an existing project
not selected
agent-chat.runner-acpx-claude.local.clarify-reuse
Matchers and test contextNot selected No matcher result was recorded.
Create a project with multiple repository URLs
not selected
agent-chat.runner-acpx-claude.local.multi-repository
Matchers and test contextNot selected No matcher result was recorded. |
Test suite
Native chat startup cancellation, committed sends, hiring, grounded status, and remote continuity.
| Agent profile | Isolated locallocal · local | Daytona warm reusable sandboxdaytona · remote |
|---|---|---|
Runner Codexnativecodex · gpt-5.6-sol
|
Isolated locallocal · local
Stop during startup, reset, and resume
not selected
agent-chat-hardening.runner-codex.local.stop-startup-new-resume
Matchers and test contextNot selected No matcher result was recorded.
Hire through chat, delegate, and reuse the same teammate
not selected
agent-chat-hardening.runner-codex.local.hire-delegate-reuse
Matchers and test contextNot selected No matcher result was recorded.
Read the actual blocker and hand source material to a reviewer
not selected
agent-chat-hardening.runner-codex.local.blocked-status-review
Matchers and test contextNot selected No matcher result was recorded.
Recover a lost send acknowledgement without repeating committed work
not selected
agent-chat-hardening.runner-codex.local.committed-send-retry
Matchers and test contextNot selected No matcher result was recorded.
Conversation continuity across restart
not selected
agent-chat-hardening.runner-codex.local.continuity-restart
Matchers and test contextNot selected No matcher result was recorded.
Stop, reset, and resume
not selected
agent-chat-hardening.runner-codex.local.stop-new-resume
Matchers and test contextNot selected No matcher result was recorded. |
Daytona warm reusable sandboxdaytona · remote
Recover a lost send acknowledgement without repeating committed work
not selected
agent-chat-hardening.runner-codex.daytona.committed-send-retry
Matchers and test contextNot selected No matcher result was recorded.
Conversation continuity across restart
not selected
agent-chat-hardening.runner-codex.daytona.continuity-restart
Matchers and test contextNot selected No matcher result was recorded.
Stop, reset, and resume
not selected
agent-chat-hardening.runner-codex.daytona.stop-new-resume
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Claudenativeacpx · claude-sonnet-5
|
Isolated locallocal · local
Stop during startup, reset, and resume
not selected
agent-chat-hardening.runner-acpx-claude.local.stop-startup-new-resume
Matchers and test contextNot selected No matcher result was recorded.
Hire through chat, delegate, and reuse the same teammate
not selected
agent-chat-hardening.runner-acpx-claude.local.hire-delegate-reuse
Matchers and test contextNot selected No matcher result was recorded.
Read the actual blocker and hand source material to a reviewer
not selected
agent-chat-hardening.runner-acpx-claude.local.blocked-status-review
Matchers and test contextNot selected No matcher result was recorded.
Recover a lost send acknowledgement without repeating committed work
not selected
agent-chat-hardening.runner-acpx-claude.local.committed-send-retry
Matchers and test contextNot selected No matcher result was recorded.
Conversation continuity across restart
not selected
agent-chat-hardening.runner-acpx-claude.local.continuity-restart
Matchers and test contextNot selected No matcher result was recorded.
Stop, reset, and resume
not selected
agent-chat-hardening.runner-acpx-claude.local.stop-new-resume
Matchers and test contextNot selected No matcher result was recorded. |
Daytona warm reusable sandboxdaytona · remote
Recover a lost send acknowledgement without repeating committed work
not selected
agent-chat-hardening.runner-acpx-claude.daytona.committed-send-retry
Matchers and test contextNot selected No matcher result was recorded.
Conversation continuity across restart
not selected
agent-chat-hardening.runner-acpx-claude.daytona.continuity-restart
Matchers and test contextNot selected No matcher result was recorded.
Stop, reset, and resume
not selected
agent-chat-hardening.runner-acpx-claude.daytona.stop-new-resume
Matchers and test contextNot selected No matcher result was recorded. |
Test suite
Experimental settings lifecycle and user follow-ups during active native work.
| Agent profile | Isolated locallocal · local |
|---|---|
Runner Codexnativecodex · gpt-5.6-sol
|
Isolated locallocal · local
Enable Agent Chat, pause access, and resume preserved history
not selected
agent-chat-stories.runner-codex.local.enable-disable-resume
Matchers and test contextNot selected No matcher result was recorded.
Deliver a follow-up while a provider turn is running
not selected
agent-chat-stories.runner-codex.local.followup-while-running
Matchers and test contextNot selected No matcher result was recorded.
Change instructions during active work and save the updated plan
not selected
agent-chat-stories.runner-codex.local.revise-while-running
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Claudenativeacpx · claude-sonnet-5
|
Isolated locallocal · local
Enable Agent Chat, pause access, and resume preserved history
not selected
agent-chat-stories.runner-acpx-claude.local.enable-disable-resume
Matchers and test contextNot selected No matcher result was recorded.
Deliver a follow-up while a provider turn is running
not selected
agent-chat-stories.runner-acpx-claude.local.followup-while-running
Matchers and test contextNot selected No matcher result was recorded.
Change instructions during active work and save the updated plan
not selected
agent-chat-stories.runner-acpx-claude.local.revise-while-running
Matchers and test contextNot selected No matcher result was recorded. |
Test suite
Active ownership transfer, user recovery after worker loss, and grounded answer quality.
| Agent profile | Isolated locallocal · local |
|---|---|
Runner Codexnativecodex · gpt-5.6-sol
|
Isolated locallocal · local
Reassign an executing task and preserve its saved work
not selected
agent-chat-qualification.runner-codex.local.active-reassignment
Matchers and test contextNot selected No matcher result was recorded.
Recover from worker process loss through visible Retry
not selected
agent-chat-qualification.runner-codex.local.worker-crash-retry
Matchers and test contextNot selected No matcher result was recorded.
Ground status, correct stale claims, and acknowledge uncertainty
not selected
agent-chat-qualification.runner-codex.local.grounded-answer-quality
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Claudenativeacpx · claude-sonnet-5
|
Isolated locallocal · local
Reassign an executing task and preserve its saved work
not selected
agent-chat-qualification.runner-acpx-claude.local.active-reassignment
Matchers and test contextNot selected No matcher result was recorded.
Recover from worker process loss through visible Retry
not selected
agent-chat-qualification.runner-acpx-claude.local.worker-crash-retry
Matchers and test contextNot selected No matcher result was recorded.
Ground status, correct stale claims, and acknowledge uncertainty
not selected
agent-chat-qualification.runner-acpx-claude.local.grounded-answer-quality
Matchers and test contextNot selected No matcher result was recorded. |
Test suite
Major provider, runtime generation, and execution-environment compatibility.
| Agent profile | Isolated locallocal · local | Daytona sandboxdaytona · remote |
|---|---|---|
Legacy Codexlegacycodex · gpt-5.6-sol
|
Isolated locallocal · local
Basic response
not selected
core-compatibility.legacy-codex.local.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.legacy-codex.local.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.legacy-codex.local.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Daytona sandboxdaytona · remote
Basic response
not selected
core-compatibility.legacy-codex.daytona.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.legacy-codex.daytona.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.legacy-codex.daytona.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Legacy Claudelegacyclaude · claude-sonnet-4-6
|
Isolated locallocal · local
Basic response
not selected
core-compatibility.legacy-claude.local.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.legacy-claude.local.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.legacy-claude.local.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Daytona sandboxdaytona · remote
Basic response
not selected
core-compatibility.legacy-claude.daytona.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.legacy-claude.daytona.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.legacy-claude.daytona.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Legacy OpenCodelegacyopencode · openrouter/deepseek/deepseek-v4-flash-0731
|
Isolated locallocal · local
Basic response
not selected
core-compatibility.legacy-opencode.local.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.legacy-opencode.local.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.legacy-opencode.local.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Daytona sandboxdaytona · remote
Basic response
not selected
core-compatibility.legacy-opencode.daytona.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.legacy-opencode.daytona.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.legacy-opencode.daytona.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Runner Codexnativecodex · gpt-5.6-sol
|
Isolated locallocal · local
Basic response
not selected
core-compatibility.runner-codex.local.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.runner-codex.local.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.runner-codex.local.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Daytona sandboxdaytona · remote
Basic response
not selected
core-compatibility.runner-codex.daytona.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.runner-codex.daytona.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.runner-codex.daytona.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Runner OpenCodenativeopencode · openrouter/deepseek/deepseek-v4-flash-0731
|
Isolated locallocal · local
Basic response
not selected
core-compatibility.runner-opencode.local.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.runner-opencode.local.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.runner-opencode.local.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Daytona sandboxdaytona · remote
Basic response
not selected
core-compatibility.runner-opencode.daytona.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.runner-opencode.daytona.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.runner-opencode.daytona.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Claudenativeacpx · claude-sonnet-5
|
Isolated locallocal · local
Basic response
not selected
core-compatibility.runner-acpx-claude.local.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.runner-acpx-claude.local.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.runner-acpx-claude.local.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Daytona sandboxdaytona · remote
Basic response
not selected
core-compatibility.runner-acpx-claude.daytona.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.runner-acpx-claude.daytona.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.runner-acpx-claude.daytona.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Codexnativeacpx · gpt-5.6-sol
|
Isolated locallocal · local
Basic response
not selected
core-compatibility.runner-acpx-codex.local.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.runner-acpx-codex.local.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.runner-acpx-codex.local.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Daytona sandboxdaytona · remote
Basic response
not selected
core-compatibility.runner-acpx-codex.daytona.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.runner-acpx-codex.daytona.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.runner-acpx-codex.daytona.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Test suite
Structured interaction and continuation qualification for every supported local profile.
| Agent profile | Isolated locallocal · local |
|---|---|
Legacy Codexlegacycodex · gpt-5.6-sol
|
Isolated locallocal · local
Structured question, answer, resume
not selected
local-session-integrity.legacy-codex.local.structured-question-resume
Matchers and test contextNot selected No matcher result was recorded.
Structured question, server restart, answer, resume
not selected
local-session-integrity.legacy-codex.local.structured-question-restart-resume
Matchers and test contextNot selected No matcher result was recorded. |
Legacy Claudelegacyclaude · claude-sonnet-4-6
|
Isolated locallocal · local
Structured question, answer, resume
not selected
local-session-integrity.legacy-claude.local.structured-question-resume
Matchers and test contextNot selected No matcher result was recorded.
Structured question, server restart, answer, resume
not selected
local-session-integrity.legacy-claude.local.structured-question-restart-resume
Matchers and test contextNot selected No matcher result was recorded. |
Legacy OpenCodelegacyopencode · openrouter/deepseek/deepseek-v4-flash-0731
|
Isolated locallocal · local
Structured question, answer, resume
not selected
local-session-integrity.legacy-opencode.local.structured-question-resume
Matchers and test contextNot selected No matcher result was recorded.
Structured question, server restart, answer, resume
not selected
local-session-integrity.legacy-opencode.local.structured-question-restart-resume
Matchers and test contextNot selected No matcher result was recorded. |
Runner Codexnativecodex · gpt-5.6-sol
|
Isolated locallocal · local
Structured question, answer, resume
not selected
local-session-integrity.runner-codex.local.structured-question-resume
Matchers and test contextNot selected No matcher result was recorded.
Structured question, server restart, answer, resume
not selected
local-session-integrity.runner-codex.local.structured-question-restart-resume
Matchers and test contextNot selected No matcher result was recorded. |
Runner OpenCodenativeopencode · openrouter/deepseek/deepseek-v4-flash-0731
|
Isolated locallocal · local
Structured question, answer, resume
not selected
local-session-integrity.runner-opencode.local.structured-question-resume
Matchers and test contextNot selected No matcher result was recorded.
Structured question, server restart, answer, resume
not selected
local-session-integrity.runner-opencode.local.structured-question-restart-resume
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Claudenativeacpx · claude-sonnet-5
|
Isolated locallocal · local
Structured question, answer, resume
not selected
local-session-integrity.runner-acpx-claude.local.structured-question-resume
Matchers and test contextNot selected No matcher result was recorded.
Structured question, server restart, answer, resume
not selected
local-session-integrity.runner-acpx-claude.local.structured-question-restart-resume
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Codexnativeacpx · gpt-5.6-sol
|
Isolated locallocal · local
Structured question, answer, resume
not selected
local-session-integrity.runner-acpx-codex.local.structured-question-resume
Matchers and test contextNot selected No matcher result was recorded.
Structured question, server restart, answer, resume
not selected
local-session-integrity.runner-acpx-codex.local.structured-question-restart-resume
Matchers and test contextNot selected No matcher result was recorded. |
Test suite
Weekly-ranked tool-capable OpenRouter models through native OpenCode on isolated local workspaces.
| Agent profile | Isolated locallocal · local |
|---|---|
#1 DeepSeek V4 Flash 0731nativeopencode · openrouter/deepseek/deepseek-v4-flash-0731
|
Isolated locallocal · local
Hello and complete
not selected
openrouter-model-breadth.openrouter-deepseek-deepseek-v4-flash-0731.local.hello-complete
Matchers and test contextNot selected No matcher result was recorded.
Ask, answer, resume
not selected
openrouter-model-breadth.openrouter-deepseek-deepseek-v4-flash-0731.local.question-resume-complete
Matchers and test contextNot selected No matcher result was recorded. |
#3 Tencent HY 3nativeopencode · openrouter/tencent/hy3
|
Isolated locallocal · local
Hello and complete
not selected
openrouter-model-breadth.openrouter-tencent-hy3.local.hello-complete
Matchers and test contextNot selected No matcher result was recorded.
Ask, answer, resume
not selected
openrouter-model-breadth.openrouter-tencent-hy3.local.question-resume-complete
Matchers and test contextNot selected No matcher result was recorded. |
#4 Nemotron 3 Ultra 550B A55B (free)nativeopencode · openrouter/nvidia/nemotron-3-ultra-550b-a55b:free
|
Isolated locallocal · local
Hello and complete
not selected
openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.hello-complete
Matchers and test contextNot selected No matcher result was recorded.
Ask, answer, resume
not selected
openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.question-resume-complete
Matchers and test contextNot selected No matcher result was recorded.
Plan, approve, complete
not selected
openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.plan-approve-complete
Matchers and test contextNot selected No matcher result was recorded. |
#5 GPT-5.6 Lunanativeopencode · openrouter/openai/gpt-5.6-luna
|
Isolated locallocal · local
Hello and complete
not selected
openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.hello-complete
Matchers and test contextNot selected No matcher result was recorded.
Ask, answer, resume
not selected
openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.question-resume-complete
Matchers and test contextNot selected No matcher result was recorded.
Plan, approve, complete
not selected
openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.plan-approve-complete
Matchers and test contextNot selected No matcher result was recorded. |
Test suite
Three browser-driven turns on one reusable Daytona sandbox for legacy and native Codex.
| Agent profile | Daytona warm reusable sandboxdaytona · remote |
|---|---|
Legacy Codexlegacycodex · gpt-5.6-sol
|
Daytona warm reusable sandboxdaytona · remote
Warm three-turn workspace continuity
not selected
daytona-warm-continuity.legacy-codex.daytona.warm-three-turn
Matchers and test contextNot selected No matcher result was recorded. |
Runner Codexnativecodex · gpt-5.6-sol
|
Daytona warm reusable sandboxdaytona · remote
Warm three-turn workspace continuity
not selected
daytona-warm-continuity.runner-codex.daytona.warm-three-turn
Matchers and test contextNot selected No matcher result was recorded. |
Test suite
Suite discovered from retained campaign identities; full suite size is not known to this publisher.
| Agent profile | Isolated locallocal · local | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Legacy Codexlegacycodex · gpt-5.6-sol
|
Isolated locallocal · local
lifecycle-completion-neutral
passed
No behavioral matcher failed. See all behavioral checks (8)
Tokens55,357 in · 649 out34,621 cached · 1/1 runs covered
LLM spendunpriced0/1 runs provider-priced
ExecutionLocal · not metered12s agent
lifecycle-baseline.legacy-codex.local.lifecycle-completion-neutral
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 1,
"runsWithTokenUsage": 1,
"runsWithReportedCost": 0,
"inputTokens": 55357,
"outputTokens": 649,
"cachedInputTokens": 34621,
"totalTokens": 90627,
"reportedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 12144,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 55357,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 649,
"sessionReused": false,
"rawInputTokens": 55357,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:5a169abfe165312892526d8994384d7303843197ac8a2ef4365b9056d309a205",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:52d4141bda6af7719527ec994dc754d7fd2934b31c0196dd8be6cd909c882505",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 649,
"cachedInputTokens": 34621,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-78c7-7231-ba6e-a2989f343c92",
"rawCachedInputTokens": 34621,
"sessionRotationReason": null
}
}
lifecycle-completion-challenge
passed
No behavioral matcher failed. See all behavioral checks (8)
Tokens77,151 in · 998 out55,682 cached · 1/1 runs covered
LLM spendunpriced0/1 runs provider-priced
ExecutionLocal · not metered18s agent
lifecycle-baseline.legacy-codex.local.lifecycle-completion-challenge
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 1,
"runsWithTokenUsage": 1,
"runsWithReportedCost": 0,
"inputTokens": 77151,
"outputTokens": 998,
"cachedInputTokens": 55682,
"totalTokens": 133831,
"reportedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 17667,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 77151,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 998,
"sessionReused": false,
"rawInputTokens": 77151,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:20dd3f86b82d3732917845dd4c0e714766a9359b8e95cee98dc05d45dd40b61e",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:2f6c907341c1f3b35138f4ca24fefdd46232cb3f74e2f4a5b775ba790bcf95f2",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 998,
"cachedInputTokens": 55682,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-4b7b-7f60-9312-4239f72f1c3e",
"rawCachedInputTokens": 55682,
"sessionRotationReason": null
}
}
lifecycle-blocker-neutral
passed
No behavioral matcher failed. See all behavioral checks (8)
Tokens56,537 in · 793 out35,321 cached · 1/1 runs covered
LLM spendunpriced0/1 runs provider-priced
ExecutionLocal · not metered13s agent
lifecycle-baseline.legacy-codex.local.lifecycle-blocker-neutral
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 1,
"runsWithTokenUsage": 1,
"runsWithReportedCost": 0,
"inputTokens": 56537,
"outputTokens": 793,
"cachedInputTokens": 35321,
"totalTokens": 92651,
"reportedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 13047,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 56537,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 793,
"sessionReused": false,
"rawInputTokens": 56537,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:27f4ddc8c9e2137ff5b346a07fc72401d10bd1ce7c9ddbd2ad962404fb7b3fb2",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:5f2480107171da8bf0c36c12ba3a6448312cbd6028d6051b252a9475cd77ba9a",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 793,
"cachedInputTokens": 35321,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-6604-79b2-8234-93a3796f736b",
"rawCachedInputTokens": 35321,
"sessionRotationReason": null
}
}
lifecycle-blocker-challenge
passed
No behavioral matcher failed. See all behavioral checks (8)
Tokens56,461 in · 661 out35,328 cached · 1/1 runs covered
LLM spendunpriced0/1 runs provider-priced
ExecutionLocal · not metered17s agent
lifecycle-baseline.legacy-codex.local.lifecycle-blocker-challenge
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 1,
"runsWithTokenUsage": 1,
"runsWithReportedCost": 0,
"inputTokens": 56461,
"outputTokens": 661,
"cachedInputTokens": 35328,
"totalTokens": 92450,
"reportedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 17392,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 56461,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 661,
"sessionReused": false,
"rawInputTokens": 56461,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:ba2b179833e952f72c27f9552e3941639596d6c243d9dc7ca44eb49d17ae41ec",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:12e53e6baeb0c08bd2015298378d595b438224a5175558820b9be3ef510252f7",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 661,
"cachedInputTokens": 35328,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-4817-7611-ac32-cc91be467172",
"rawCachedInputTokens": 35328,
"sessionRotationReason": null
}
}
lifecycle-question-neutral
passed
No behavioral matcher failed. See all behavioral checks (13)
Tokens674,541 in · 5,657 out604,017 cached · 2/2 runs covered
LLM spendunpriced0/2 runs provider-priced
ExecutionLocal · not metered1m 1s agent
lifecycle-baseline.legacy-codex.local.lifecycle-question-neutral
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 2,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 0,
"inputTokens": 674541,
"outputTokens": 5657,
"cachedInputTokens": 604017,
"totalTokens": 1284215,
"reportedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 61301,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "1691669f-dc3f-462c-a691-083170223d1b",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 449797,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 3608,
"sessionReused": true,
"rawInputTokens": 449797,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:b8e83fdeb3d2f8e0c9a494295d2719147758ea11347ece3be60854f98514b1df",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:325619f3f01be20fb8f15dc349259ff7ca82eb6ec660bc545def117dd8c685e2",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 3608,
"cachedInputTokens": 409830,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-6626-7662-876b-681075af810f",
"rawCachedInputTokens": 409830,
"sessionRotationReason": null
}
},
{
"runId": "b52d23ef-3f16-4dbb-91b3-2bd9aa3476d9",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 224744,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 2049,
"sessionReused": false,
"rawInputTokens": 224744,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:b8e83fdeb3d2f8e0c9a494295d2719147758ea11347ece3be60854f98514b1df",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:325619f3f01be20fb8f15dc349259ff7ca82eb6ec660bc545def117dd8c685e2",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 2049,
"cachedInputTokens": 194187,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-6626-7662-876b-681075af810f",
"rawCachedInputTokens": 194187,
"sessionRotationReason": null
}
}
]
}
}
lifecycle-question-challenge
passed
No behavioral matcher failed. See all behavioral checks (13)
Tokens517,108 in · 5,371 out455,052 cached · 2/2 runs covered
LLM spendunpriced0/2 runs provider-priced
ExecutionLocal · not metered53s agent
lifecycle-baseline.legacy-codex.local.lifecycle-question-challenge
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 2,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 0,
"inputTokens": 517108,
"outputTokens": 5371,
"cachedInputTokens": 455052,
"totalTokens": 977531,
"reportedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 52730,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "d61d16d1-5edf-448a-a009-07b2bb10296f",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 343191,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 3369,
"sessionReused": true,
"rawInputTokens": 343191,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:ce9c701a8f2f27c837726c56383e32a733feaf9165a99db22bfef923424e2800",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:65bd13b366e3ec0b8e448f8c05d01ca0e41320d81a291604fb45d389c4a969b5",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 3369,
"cachedInputTokens": 306285,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-7648-75b0-bd16-aad8086bf920",
"rawCachedInputTokens": 306285,
"sessionRotationReason": null
}
},
{
"runId": "7cc4a3a9-bd27-49e4-ae92-66710b8b0793",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 173917,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 2002,
"sessionReused": false,
"rawInputTokens": 173917,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:ce9c701a8f2f27c837726c56383e32a733feaf9165a99db22bfef923424e2800",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:65bd13b366e3ec0b8e448f8c05d01ca0e41320d81a291604fb45d389c4a969b5",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 2002,
"cachedInputTokens": 148767,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-7648-75b0-bd16-aad8086bf920",
"rawCachedInputTokens": 148767,
"sessionRotationReason": null
}
}
]
}
}
lifecycle-approval-neutral
passed
No behavioral matcher failed. See all behavioral checks (17)
Tokens1,148,550 in · 8,842 out1,049,077 cached · 3/3 runs covered
LLM spendunpriced0/3 runs provider-priced
ExecutionLocal · not metered1m 45s agent
lifecycle-baseline.legacy-codex.local.lifecycle-approval-neutral
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 3,
"runsWithTokenUsage": 3,
"runsWithReportedCost": 0,
"inputTokens": 1148550,
"outputTokens": 8842,
"cachedInputTokens": 1049077,
"totalTokens": 2206469,
"reportedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 104627,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "ca91b72f-fe34-489f-9fee-edb79bb16378",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 540587,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 3885,
"sessionReused": true,
"rawInputTokens": 540587,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:6dae9e12212810779e819c2dc716b7a6c767d68224a65cecbcc1078140471a53",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:6ede192135f1276fd2f5dfa42a49c8a5ec76ba936b19f84e99657947fcf73f64",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 3885,
"cachedInputTokens": 501971,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-4d50-76d0-9769-0046f68a6363",
"rawCachedInputTokens": 501971,
"sessionRotationReason": null
}
},
{
"runId": "a1b76ecd-342b-41dd-a1c0-92f9d42d72fa",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 428406,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 3266,
"sessionReused": true,
"rawInputTokens": 428406,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:6dae9e12212810779e819c2dc716b7a6c767d68224a65cecbcc1078140471a53",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:6ede192135f1276fd2f5dfa42a49c8a5ec76ba936b19f84e99657947fcf73f64",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 3266,
"cachedInputTokens": 394624,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-4d50-76d0-9769-0046f68a6363",
"rawCachedInputTokens": 394624,
"sessionRotationReason": null
}
},
{
"runId": "17d13d21-8f26-4002-b0d0-a2f40c4bac92",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 179557,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 1691,
"sessionReused": false,
"rawInputTokens": 179557,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:6dae9e12212810779e819c2dc716b7a6c767d68224a65cecbcc1078140471a53",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:6ede192135f1276fd2f5dfa42a49c8a5ec76ba936b19f84e99657947fcf73f64",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 1691,
"cachedInputTokens": 152482,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-4d50-76d0-9769-0046f68a6363",
"rawCachedInputTokens": 152482,
"sessionRotationReason": null
}
}
]
}
}
lifecycle-approval-challenge
passed
No behavioral matcher failed. See all behavioral checks (17)
Tokens1,417,495 in · 11,229 out1,308,924 cached · 3/3 runs covered
LLM spendunpriced0/3 runs provider-priced
ExecutionLocal · not metered1m 17s agent
lifecycle-baseline.legacy-codex.local.lifecycle-approval-challenge
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 3,
"runsWithTokenUsage": 3,
"runsWithReportedCost": 0,
"inputTokens": 1417495,
"outputTokens": 11229,
"cachedInputTokens": 1308924,
"totalTokens": 2737648,
"reportedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 76834,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "a2d74b41-dd8f-4a91-8bf6-d454c115ddfd",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 711795,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 5242,
"sessionReused": true,
"rawInputTokens": 711795,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:726960cff0786647f161dedeca23c4ea8f236ea43e2565501b0dab7edaaf35c4",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:e63857db921746a5529948d67413c113d9f471723cd68380d6ad4301c96f4670",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 5242,
"cachedInputTokens": 668733,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-6bf8-7d32-a266-9af30c1cc77c",
"rawCachedInputTokens": 668733,
"sessionRotationReason": null
}
},
{
"runId": "6086456a-3ea8-45bf-8fa0-c78cc3fc666c",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 502013,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 4060,
"sessionReused": true,
"rawInputTokens": 502013,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:726960cff0786647f161dedeca23c4ea8f236ea43e2565501b0dab7edaaf35c4",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:e63857db921746a5529948d67413c113d9f471723cd68380d6ad4301c96f4670",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 4060,
"cachedInputTokens": 464376,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-6bf8-7d32-a266-9af30c1cc77c",
"rawCachedInputTokens": 464376,
"sessionRotationReason": null
}
},
{
"runId": "5c7c00f9-70bf-4364-8dcb-f2aa391cbeb1",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 203687,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 1927,
"sessionReused": false,
"rawInputTokens": 203687,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:726960cff0786647f161dedeca23c4ea8f236ea43e2565501b0dab7edaaf35c4",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:e63857db921746a5529948d67413c113d9f471723cd68380d6ad4301c96f4670",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 1927,
"cachedInputTokens": 175815,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-6bf8-7d32-a266-9af30c1cc77c",
"rawCachedInputTokens": 175815,
"sessionRotationReason": null
}
}
]
}
}
lifecycle-plan-revision-neutral
passed
No behavioral matcher failed. See all behavioral checks (17)
Tokens2,007,637 in · 16,018 out1,893,157 cached · 3/3 runs covered
LLM spendunpriced0/3 runs provider-priced
ExecutionLocal · not metered1m 50s agent
lifecycle-baseline.legacy-codex.local.lifecycle-plan-revision-neutral
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 3,
"runsWithTokenUsage": 3,
"runsWithReportedCost": 0,
"inputTokens": 2007637,
"outputTokens": 16018,
"cachedInputTokens": 1893157,
"totalTokens": 3916812,
"reportedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 110426,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "f6035902-121f-4849-9106-b694ccb36340",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 870826,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 6830,
"sessionReused": true,
"rawInputTokens": 870826,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:556ed07c01135622b2d8c8783ea205e3462e78d1b7d4a6bb19ea38b0bd2f91b9",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:2e68fc8266b9dccc605a97c6dd507f2e8991bb9c93adcc6f72a47d047391122c",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 6830,
"cachedInputTokens": 827888,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-6cc3-78a3-b297-b9caf08b7772",
"rawCachedInputTokens": 827888,
"sessionRotationReason": null
}
},
{
"runId": "5c7e4c4c-769e-43b4-885b-ce7e6e147a42",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 660924,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 5445,
"sessionReused": true,
"rawInputTokens": 660924,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:556ed07c01135622b2d8c8783ea205e3462e78d1b7d4a6bb19ea38b0bd2f91b9",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:2e68fc8266b9dccc605a97c6dd507f2e8991bb9c93adcc6f72a47d047391122c",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 5445,
"cachedInputTokens": 622521,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-6cc3-78a3-b297-b9caf08b7772",
"rawCachedInputTokens": 622521,
"sessionRotationReason": null
}
},
{
"runId": "5c33e2bf-be9f-4887-a977-16ac70a022c8",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 475887,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 3743,
"sessionReused": false,
"rawInputTokens": 475887,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:556ed07c01135622b2d8c8783ea205e3462e78d1b7d4a6bb19ea38b0bd2f91b9",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:2e68fc8266b9dccc605a97c6dd507f2e8991bb9c93adcc6f72a47d047391122c",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 3743,
"cachedInputTokens": 442748,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-6cc3-78a3-b297-b9caf08b7772",
"rawCachedInputTokens": 442748,
"sessionRotationReason": null
}
}
]
}
}
lifecycle-plan-revision-challenge
passed
No behavioral matcher failed. See all behavioral checks (17)
Tokens1,555,290 in · 12,033 out1,448,604 cached · 3/3 runs covered
LLM spendunpriced0/3 runs provider-priced
ExecutionLocal · not metered1m 27s agent
lifecycle-baseline.legacy-codex.local.lifecycle-plan-revision-challenge
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 3,
"runsWithTokenUsage": 3,
"runsWithReportedCost": 0,
"inputTokens": 1555290,
"outputTokens": 12033,
"cachedInputTokens": 1448604,
"totalTokens": 3015927,
"reportedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 87353,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "396cbf7f-d6eb-4570-9bc6-d018847eca13",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 707957,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 5137,
"sessionReused": true,
"rawInputTokens": 707957,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:70eb2dccbd801ea04a1e22d0553b1ad2f565653dae20307ff8cd27c1446eceed",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:0a30a77928c72ccf0db03da3bddf5caf291c909996e9ef251230859c1555cff1",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 5137,
"cachedInputTokens": 666428,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-9b2e-7ed0-99b3-49d40531c0ab",
"rawCachedInputTokens": 666428,
"sessionRotationReason": null
}
},
{
"runId": "5d0b7e50-97c1-48ee-9dcc-945bfc8178b1",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 508167,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 4040,
"sessionReused": true,
"rawInputTokens": 508167,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:70eb2dccbd801ea04a1e22d0553b1ad2f565653dae20307ff8cd27c1446eceed",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:0a30a77928c72ccf0db03da3bddf5caf291c909996e9ef251230859c1555cff1",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 4040,
"cachedInputTokens": 472386,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-9b2e-7ed0-99b3-49d40531c0ab",
"rawCachedInputTokens": 472386,
"sessionRotationReason": null
}
},
{
"runId": "1c2ae3de-6950-4532-9b1a-f794d3a19f9a",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 339166,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 2856,
"sessionReused": false,
"rawInputTokens": 339166,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:70eb2dccbd801ea04a1e22d0553b1ad2f565653dae20307ff8cd27c1446eceed",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:0a30a77928c72ccf0db03da3bddf5caf291c909996e9ef251230859c1555cff1",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 2856,
"cachedInputTokens": 309790,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-9b2e-7ed0-99b3-49d40531c0ab",
"rawCachedInputTokens": 309790,
"sessionRotationReason": null
}
}
]
}
}
lifecycle-untrusted-evidence-neutral
passed
No behavioral matcher failed. See all behavioral checks (14)
Tokens901,846 in · 5,964 out835,281 cached · 2/2 runs covered
LLM spendunpriced0/2 runs provider-priced
ExecutionLocal · not metered1m 11s agent
lifecycle-baseline.legacy-codex.local.lifecycle-untrusted-evidence-neutral
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 2,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 0,
"inputTokens": 901846,
"outputTokens": 5964,
"cachedInputTokens": 835281,
"totalTokens": 1743091,
"reportedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 70844,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "46872fb4-177c-41db-9f8a-15b2912723dd",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 653142,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 3904,
"sessionReused": true,
"rawInputTokens": 653142,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:b19511b973308235ac9097884da1f9bfcdb58337ed79a5effdc1be4883835b83",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:a2f901dc819ea1a323277bb973a030be61d5dbb375d5e50deeb130a6da88002b",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 3904,
"cachedInputTokens": 616343,
"taskSessionReused": true,
"persistedSessionId": "01a0c70c-34ef-7c71-9127-bf360de37e38",
"rawCachedInputTokens": 616343,
"sessionRotationReason": null
}
},
{
"runId": "90dd1801-5a5f-4436-9c24-2d068e4b55ed",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 248704,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 2060,
"sessionReused": false,
"rawInputTokens": 248704,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:b19511b973308235ac9097884da1f9bfcdb58337ed79a5effdc1be4883835b83",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:a2f901dc819ea1a323277bb973a030be61d5dbb375d5e50deeb130a6da88002b",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 2060,
"cachedInputTokens": 218938,
"taskSessionReused": false,
"persistedSessionId": "01a0c70c-34ef-7c71-9127-bf360de37e38",
"rawCachedInputTokens": 218938,
"sessionRotationReason": null
}
}
]
}
}
lifecycle-untrusted-evidence-challenge
passed
No behavioral matcher failed. See all behavioral checks (14)
Tokens814,868 in · 6,198 out753,440 cached · 2/2 runs covered
LLM spendunpriced0/2 runs provider-priced
ExecutionLocal · not metered1m 6s agent
lifecycle-baseline.legacy-codex.local.lifecycle-untrusted-evidence-challenge
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 2,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 0,
"inputTokens": 814868,
"outputTokens": 6198,
"cachedInputTokens": 753440,
"totalTokens": 1574506,
"reportedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 66167,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "8e28182e-8a0a-4f1d-84dc-109c222bc8ec",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 597795,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 4296,
"sessionReused": true,
"rawInputTokens": 597795,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:6ed4617350eb3f99f25468ac78b1afea2021a728854ca4c1dc1bcbefc75ecad7",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:c9eada7a8c0d0058c631679e76fb96c9d703de99931bc632dbfa84b9f33a6f18",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 4296,
"cachedInputTokens": 563902,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-7504-7551-b6c1-daee062f7b07",
"rawCachedInputTokens": 563902,
"sessionRotationReason": null
}
},
{
"runId": "9166e67c-f5a8-45e0-bd31-9a80b2500fc0",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 217073,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 1902,
"sessionReused": false,
"rawInputTokens": 217073,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:6ed4617350eb3f99f25468ac78b1afea2021a728854ca4c1dc1bcbefc75ecad7",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:c9eada7a8c0d0058c631679e76fb96c9d703de99931bc632dbfa84b9f33a6f18",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 1902,
"cachedInputTokens": 189538,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-7504-7551-b6c1-daee062f7b07",
"rawCachedInputTokens": 189538,
"sessionRotationReason": null
}
}
]
}
}
lifecycle-dependency-restart-neutral
passed
No behavioral matcher failed. See all behavioral checks (13)
Tokens1,240,024 in · 10,054 out1,142,113 cached · 3/3 runs covered
LLM spendunpriced0/3 runs provider-priced
ExecutionLocal · not metered2m 20s agent
lifecycle-baseline.legacy-codex.local.lifecycle-dependency-restart-neutral
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 3,
"runsWithTokenUsage": 3,
"runsWithReportedCost": 0,
"inputTokens": 1240024,
"outputTokens": 10054,
"cachedInputTokens": 1142113,
"totalTokens": 2392191,
"reportedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 140498,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "e7e6a4cd-4de2-41d7-8519-b3291158451b",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 757685,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 5520,
"sessionReused": true,
"rawInputTokens": 757685,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:cf3763f8ef24417cd3561edbc708f01124988bae495e9c6aa7247d1e4ec9bc4d",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:2444ff2889d09e4a3a213775a250f6f370f623eb8657c300c9aa75b77d141d2b",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 5520,
"cachedInputTokens": 713532,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-6fa3-7971-b72a-3035c66134f9",
"rawCachedInputTokens": 713532,
"sessionRotationReason": null
}
},
{
"runId": "3faaf195-327a-4519-b2ed-cd7b3e1c8720",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 75292,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 958,
"sessionReused": false,
"rawInputTokens": 75292,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:cf3763f8ef24417cd3561edbc708f01124988bae495e9c6aa7247d1e4ec9bc4d",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:2444ff2889d09e4a3a213775a250f6f370f623eb8657c300c9aa75b77d141d2b",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 958,
"cachedInputTokens": 54467,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-db7c-7e01-8fda-16afb6bd9023",
"rawCachedInputTokens": 54467,
"sessionRotationReason": null
}
},
{
"runId": "25c2f6de-f574-4f27-9a03-fa0a95a78a51",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 407047,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 3576,
"sessionReused": false,
"rawInputTokens": 407047,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:cf3763f8ef24417cd3561edbc708f01124988bae495e9c6aa7247d1e4ec9bc4d",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:2444ff2889d09e4a3a213775a250f6f370f623eb8657c300c9aa75b77d141d2b",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 3576,
"cachedInputTokens": 374114,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-6fa3-7971-b72a-3035c66134f9",
"rawCachedInputTokens": 374114,
"sessionRotationReason": null
}
}
]
}
}
lifecycle-dependency-restart-challenge
passed
No behavioral matcher failed. See all behavioral checks (13)
Tokens917,673 in · 7,509 out830,630 cached · 3/3 runs covered
LLM spendunpriced0/3 runs provider-priced
ExecutionLocal · not metered1m 37s agent
lifecycle-baseline.legacy-codex.local.lifecycle-dependency-restart-challenge
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 3,
"runsWithTokenUsage": 3,
"runsWithReportedCost": 0,
"inputTokens": 917673,
"outputTokens": 7509,
"cachedInputTokens": 830630,
"totalTokens": 1755812,
"reportedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 97324,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "7ff4463b-4071-46f7-a528-7ed09318a535",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 551795,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 4017,
"sessionReused": true,
"rawInputTokens": 551795,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:d023cddee0b6896ca90c102e9365b62cc29b81a491a5ec5ecb1c2c6ae5c42831",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:1d08265a4bf8b1fae15067ff25165c2a1aa9319210e07cea6786d0f1330ce900",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 4017,
"cachedInputTokens": 516041,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-4ef0-73b2-ac74-74386a210d41",
"rawCachedInputTokens": 516041,
"sessionRotationReason": null
}
},
{
"runId": "8f041dad-9752-401e-830f-7d2a5b8a4341",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 54681,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 726,
"sessionReused": false,
"rawInputTokens": 54681,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:d023cddee0b6896ca90c102e9365b62cc29b81a491a5ec5ecb1c2c6ae5c42831",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:1d08265a4bf8b1fae15067ff25165c2a1aa9319210e07cea6786d0f1330ce900",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 726,
"cachedInputTokens": 34053,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-9de4-7bb1-9c5d-977ffa5aa972",
"rawCachedInputTokens": 34053,
"sessionRotationReason": null
}
},
{
"runId": "efdf724f-e34d-4874-be55-ed050cdc3071",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 311197,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 2766,
"sessionReused": false,
"rawInputTokens": 311197,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:d023cddee0b6896ca90c102e9365b62cc29b81a491a5ec5ecb1c2c6ae5c42831",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:1d08265a4bf8b1fae15067ff25165c2a1aa9319210e07cea6786d0f1330ce900",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 2766,
"cachedInputTokens": 280536,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-4ef0-73b2-ac74-74386a210d41",
"rawCachedInputTokens": 280536,
"sessionRotationReason": null
}
}
]
}
}
stop-new-resume
passed
No behavioral matcher failed. See all behavioral checks (1)
Tokens28,570 in · 92 out0 cached · 2/4 runs covered
LLM spendunpriced0/4 runs provider-priced
ExecutionLocal · not metered9s agent
lifecycle-baseline.legacy-codex.local.stop-new-resume
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 4,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 0,
"inputTokens": 28570,
"outputTokens": 92,
"cachedInputTokens": 0,
"totalTokens": 28662,
"reportedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 8838,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "e4be3996-f528-466e-b828-71e9ec3e1f06",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 14292,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 12,
"sessionReused": false,
"rawInputTokens": 14292,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:b065a2692ca6c0a753250fdbf2b868b5f446a9fa137585669cff11aab7a6b8ee",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:f7070dabe7e31e5265396c1163f69143522695771abe020c1d3ce06a583a8485",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 12,
"cachedInputTokens": 0,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-9eea-7232-bd9e-735100035e6f",
"rawCachedInputTokens": 0,
"sessionRotationReason": null
}
},
{
"runId": "5d4d8b32-f61a-4481-8207-39c8c09f67b3",
"usage": null
},
{
"runId": "e01e97e1-8174-4c91-bdfe-867acfdda9a8",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "reported",
"billingType": "metered_api",
"inputTokens": 0,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 0,
"sessionReused": true,
"rawInputTokens": 0,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:b065a2692ca6c0a753250fdbf2b868b5f446a9fa137585669cff11aab7a6b8ee",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:f7070dabe7e31e5265396c1163f69143522695771abe020c1d3ce06a583a8485",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 0,
"cachedInputTokens": 0,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-5e95-7852-9318-2fc1913fad16",
"rawCachedInputTokens": 0,
"sessionRotationReason": null
}
},
{
"runId": "ca5959d9-74c2-4d4c-9fc3-51664c948c42",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 14278,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 80,
"sessionReused": false,
"rawInputTokens": 14278,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:b065a2692ca6c0a753250fdbf2b868b5f446a9fa137585669cff11aab7a6b8ee",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:f7070dabe7e31e5265396c1163f69143522695771abe020c1d3ce06a583a8485",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 80,
"cachedInputTokens": 0,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-5e95-7852-9318-2fc1913fad16",
"rawCachedInputTokens": 0,
"sessionRotationReason": null
}
}
]
}
}
clarify-reuse
passed
No behavioral matcher failed. See all behavioral checks (1)
Tokens838,713 in · 9,865 out756,201 cached · 3/3 runs covered
LLM spendunpriced0/3 runs provider-priced
ExecutionLocal · not metered1m 50s agent
lifecycle-baseline.legacy-codex.local.clarify-reuse
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 3,
"runsWithTokenUsage": 3,
"runsWithReportedCost": 0,
"inputTokens": 838713,
"outputTokens": 9865,
"cachedInputTokens": 756201,
"totalTokens": 1604779,
"reportedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 110368,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "fc76d865-fa22-4025-b7dd-063cc514a773",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 254417,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 2999,
"sessionReused": false,
"rawInputTokens": 254417,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:567d08d64342a8f882dbed04888719681dfef41381249123f874dccef89c6401",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:141768ba6e0563284826b5228b5d458005826bbac8565a43b125f028d97d67ff",
"workspaceReused": false,
"activeWorkspaceId": "cd5193f2-d8f4-407f-9a60-58b9e0d04ca0",
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 2999,
"cachedInputTokens": 227609,
"taskSessionReused": false,
"persistedSessionId": "01a0c70c-257d-7a52-8b61-b40039427a8a",
"rawCachedInputTokens": 227609,
"sessionRotationReason": null
}
},
{
"runId": "3e46919c-e147-4ad1-8b07-9cad9e60ec50",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 437850,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 5091,
"sessionReused": true,
"rawInputTokens": 437850,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:9321d5e63934983493b2ce0d6cc5d1e6715b057e2f1c8e5a540aaaabcd4e8a0a",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:21645bd39cf7df2de3739368581561cab6824e63d11499210ef17ef59cc2aa8f",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 5091,
"cachedInputTokens": 405834,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-35a5-7450-a096-4d75bcc484ae",
"rawCachedInputTokens": 405834,
"sessionRotationReason": null
}
},
{
"runId": "06ed03af-f768-42d6-b04c-cb9f72544b3d",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 146446,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 1775,
"sessionReused": false,
"rawInputTokens": 146446,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:9321d5e63934983493b2ce0d6cc5d1e6715b057e2f1c8e5a540aaaabcd4e8a0a",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:21645bd39cf7df2de3739368581561cab6824e63d11499210ef17ef59cc2aa8f",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 1775,
"cachedInputTokens": 122758,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-35a5-7450-a096-4d75bcc484ae",
"rawCachedInputTokens": 122758,
"sessionRotationReason": null
}
}
]
}
}
tool-review-approve
passed
No behavioral matcher failed. See all behavioral checks (6)
Tokens1,314,496 in · 10,066 out1,237,668 cached · 2/2 runs covered
LLM spendunpriced0/2 runs provider-priced
ExecutionLocal · not metered1m 41s agent
lifecycle-baseline.legacy-codex.local.tool-review-approve
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 2,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 0,
"inputTokens": 1314496,
"outputTokens": 10066,
"cachedInputTokens": 1237668,
"totalTokens": 2562230,
"reportedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 101115,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "279393ac-21bd-4d9f-96df-2f72f8f21187",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 617398,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 4659,
"sessionReused": false,
"rawInputTokens": 617398,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:e06c887161dbbb5fc9aceca2d7a2b5fa8bab50d6f9a9955299f7c8596826db9b",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:0a5871ff7d43e0d6bfe598ec81e3645a1374008c2c83bdc28eac36ad2d41ee0d",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 4659,
"cachedInputTokens": 580884,
"taskSessionReused": false,
"persistedSessionId": "01a0c70c-21c5-7243-bdf9-96bb7149fbc2",
"rawCachedInputTokens": 580884,
"sessionRotationReason": null
}
},
{
"runId": "db8ba16b-526a-4536-ae61-c71446159086",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 697098,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 5407,
"sessionReused": true,
"rawInputTokens": 697098,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:e06c887161dbbb5fc9aceca2d7a2b5fa8bab50d6f9a9955299f7c8596826db9b",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:0a5871ff7d43e0d6bfe598ec81e3645a1374008c2c83bdc28eac36ad2d41ee0d",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 5407,
"cachedInputTokens": 656784,
"taskSessionReused": true,
"persistedSessionId": "01a0c70c-21c5-7243-bdf9-96bb7149fbc2",
"rawCachedInputTokens": 656784,
"sessionRotationReason": null
}
}
]
}
}
tool-review-decline
passed
No behavioral matcher failed. See all behavioral checks (6)
Tokens976,175 in · 9,460 out897,862 cached · 2/2 runs covered
LLM spendunpriced0/2 runs provider-priced
ExecutionLocal · not metered1m 19s agent
lifecycle-baseline.legacy-codex.local.tool-review-decline
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 2,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 0,
"inputTokens": 976175,
"outputTokens": 9460,
"cachedInputTokens": 897862,
"totalTokens": 1883497,
"reportedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 78857,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "addbf81c-2771-4f0b-a3d8-bd3737cab28e",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 447588,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 4406,
"sessionReused": false,
"rawInputTokens": 447588,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:44ea852cb7aba5d64a536c1786e908e0645c10aacc3698753274d8b7b444e690",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:98b01c53b1c3e4ec712444327ce0ee71ff8b7748c5c800af10224b8bbf0a2bb6",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 4406,
"cachedInputTokens": 410168,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-b293-7623-bccd-3a62a21fc652",
"rawCachedInputTokens": 410168,
"sessionRotationReason": null
}
},
{
"runId": "5db75d4f-d695-4f40-828f-592c54785342",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 528587,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 5054,
"sessionReused": true,
"rawInputTokens": 528587,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:44ea852cb7aba5d64a536c1786e908e0645c10aacc3698753274d8b7b444e690",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:98b01c53b1c3e4ec712444327ce0ee71ff8b7748c5c800af10224b8bbf0a2bb6",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 5054,
"cachedInputTokens": 487694,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-b293-7623-bccd-3a62a21fc652",
"rawCachedInputTokens": 487694,
"sessionRotationReason": null
}
}
]
}
}
tool-review-always
passed
No behavioral matcher failed. See all behavioral checks (6)
Tokens1,191,605 in · 9,881 out1,114,078 cached · 2/2 runs covered
LLM spendunpriced0/2 runs provider-priced
ExecutionLocal · not metered1m 17s agent
lifecycle-baseline.legacy-codex.local.tool-review-always
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 2,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 0,
"inputTokens": 1191605,
"outputTokens": 9881,
"cachedInputTokens": 1114078,
"totalTokens": 2315564,
"reportedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 77165,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "e6b7c98b-cd72-4af2-be1b-eb8fcc107cf1",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 535496,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 4202,
"sessionReused": false,
"rawInputTokens": 535496,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:c2e345b7ca184632f1cdfa45562a18bf5a04726c30dcd7d24a90559c02b3adb1",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:e6d57e49a01d31c2d2201f2d111ca231574d197a4674d55d26bd46fb015b426d",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 4202,
"cachedInputTokens": 499020,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-6501-75c3-8ad9-0105fbf95dd4",
"rawCachedInputTokens": 499020,
"sessionRotationReason": null
}
},
{
"runId": "98714a6d-e476-4aba-bf17-16646f608a6f",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 656109,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 5679,
"sessionReused": true,
"rawInputTokens": 656109,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:c2e345b7ca184632f1cdfa45562a18bf5a04726c30dcd7d24a90559c02b3adb1",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:e6d57e49a01d31c2d2201f2d111ca231574d197a4674d55d26bd46fb015b426d",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 5679,
"cachedInputTokens": 615058,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-6501-75c3-8ad9-0105fbf95dd4",
"rawCachedInputTokens": 615058,
"sessionRotationReason": null
}
}
]
}
}
tool-review-restart
passed
No behavioral matcher failed. See all behavioral checks (6)
Tokens1,461,589 in · 10,705 out1,387,809 cached · 2/2 runs covered
LLM spendunpriced0/2 runs provider-priced
ExecutionLocal · not metered1m 42s agent
lifecycle-baseline.legacy-codex.local.tool-review-restart
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 2,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 0,
"inputTokens": 1461589,
"outputTokens": 10705,
"cachedInputTokens": 1387809,
"totalTokens": 2860103,
"reportedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 102390,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "c0d47584-e1e1-4157-8527-ff41aa870d68",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 673201,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 4928,
"sessionReused": false,
"rawInputTokens": 673201,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:739700963f1a3594889fcb23794249ff7f8098ded67c223e945634a4f433261b",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:4d6494b4bebd367ea3f979a5b3cff1cb5846d20df5c0ee4e6c94a54935ab096d",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 4928,
"cachedInputTokens": 638253,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-64a1-7cf0-8bbc-0e137c078997",
"rawCachedInputTokens": 638253,
"sessionRotationReason": null
}
},
{
"runId": "097d9a06-8592-4fb8-b1e3-536d5a393a9e",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"provider": "openai",
"costStatus": "unpriced",
"billingType": "metered_api",
"inputTokens": 788388,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 5777,
"sessionReused": true,
"rawInputTokens": 788388,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:739700963f1a3594889fcb23794249ff7f8098ded67c223e945634a4f433261b",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:4d6494b4bebd367ea3f979a5b3cff1cb5846d20df5c0ee4e6c94a54935ab096d",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 5777,
"cachedInputTokens": 749556,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-64a1-7cf0-8bbc-0e137c078997",
"rawCachedInputTokens": 749556,
"sessionRotationReason": null
}
}
]
}
} | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Runner Codexnativecodex · gpt-5.6-sol
|
Isolated locallocal · local
lifecycle-completion-neutral
passed
No behavioral matcher failed. See all behavioral checks (8)
Tokens35,231 in · 323 out17,426 cached · 1/1 runs covered
LLM spend$0.0000001/1 runs provider-priced
ExecutionLocal · not metered14s agent
lifecycle-baseline.runner-codex.local.lifecycle-completion-neutral
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 1,
"runsWithTokenUsage": 1,
"runsWithReportedCost": 1,
"inputTokens": 35231,
"outputTokens": 323,
"cachedInputTokens": 17426,
"totalTokens": 52980,
"reportedCostUsd": 0,
"costStatus": "reported"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 14349,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": true
},
"rawUsage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 35231,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 323,
"sessionReused": false,
"rawInputTokens": 35231,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:fe207bd591c77007218216d2e52d09d3d2738307d85a12865a149d84b408f248",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:60a13d573425b63be7f0d9f2e8291802fa3bc13be352c66fa6349aa80e11c3a5",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 323,
"cachedInputTokens": 17426,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-8e5b-7d73-b5bf-37d48f48af69",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 17426,
"sessionRotationReason": null
}
}
lifecycle-completion-challenge
passed
No behavioral matcher failed. See all behavioral checks (8)
Tokens35,202 in · 341 out17,403 cached · 1/1 runs covered
LLM spend$0.0000001/1 runs provider-priced
ExecutionLocal · not metered18s agent
lifecycle-baseline.runner-codex.local.lifecycle-completion-challenge
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 1,
"runsWithTokenUsage": 1,
"runsWithReportedCost": 1,
"inputTokens": 35202,
"outputTokens": 341,
"cachedInputTokens": 17403,
"totalTokens": 52946,
"reportedCostUsd": 0,
"costStatus": "reported"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 17576,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": true
},
"rawUsage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 35202,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 341,
"sessionReused": false,
"rawInputTokens": 35202,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:c7f6d8c370048a5cd9a2a2f4676a31a784e5e724b47ac827b2a50e768c1bb997",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:fa7bf45d7b791abfa2ce6f22ca4e4664c46e9f8f4b09a90d234fce5122775cee",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 341,
"cachedInputTokens": 17403,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-c17f-7963-9c5d-60394a0c9693",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 17403,
"sessionRotationReason": null
}
}
lifecycle-blocker-neutral
passed
No behavioral matcher failed. See all behavioral checks (8)
Tokens36,908 in · 283 out18,313 cached · 1/1 runs covered
LLM spend$0.0000001/1 runs provider-priced
ExecutionLocal · not metered13s agent
lifecycle-baseline.runner-codex.local.lifecycle-blocker-neutral
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 1,
"runsWithTokenUsage": 1,
"runsWithReportedCost": 1,
"inputTokens": 36908,
"outputTokens": 283,
"cachedInputTokens": 18313,
"totalTokens": 55504,
"reportedCostUsd": 0,
"costStatus": "reported"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 13234,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": true
},
"rawUsage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 36908,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 283,
"sessionReused": false,
"rawInputTokens": 36908,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:dccd14ded8ed9b4f1661adb12e2800b8c71bb48cebf9d84a5f466c76e1118ce6",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:2002a19e34fc13a20aefa641845e45cf7b30d0cbddd61bd6dde774df154788ad",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 283,
"cachedInputTokens": 18313,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-7a27-7933-82a1-f1198f59f3d6",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 18313,
"sessionRotationReason": null
}
}
lifecycle-blocker-challenge
passed
No behavioral matcher failed. See all behavioral checks (8)
Tokens37,003 in · 275 out18,339 cached · 1/1 runs covered
LLM spend$0.0000001/1 runs provider-priced
ExecutionLocal · not metered15s agent
lifecycle-baseline.runner-codex.local.lifecycle-blocker-challenge
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 1,
"runsWithTokenUsage": 1,
"runsWithReportedCost": 1,
"inputTokens": 37003,
"outputTokens": 275,
"cachedInputTokens": 18339,
"totalTokens": 55617,
"reportedCostUsd": 0,
"costStatus": "reported"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 15442,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": true
},
"rawUsage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 37003,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 275,
"sessionReused": false,
"rawInputTokens": 37003,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:d44769525384586c7cbb77c2f2736899cd2ffb45e8849bcb00e3aa3b72714b01",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:803d74997dc542aa5acaaacb00d4ab5b1acfcec95bbd892abd329a5b7ec6161b",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 275,
"cachedInputTokens": 18339,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-bc17-7640-ba90-fc1863d70c6d",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 18339,
"sessionRotationReason": null
}
}
lifecycle-question-neutral
passed
No behavioral matcher failed. See all behavioral checks (13)
Tokens108,140 in · 1,189 out71,634 cached · 2/2 runs covered
LLM spend$0.0000002/2 runs provider-priced
ExecutionLocal · not metered28s agent
lifecycle-baseline.runner-codex.local.lifecycle-question-neutral
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 2,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 2,
"inputTokens": 108140,
"outputTokens": 1189,
"cachedInputTokens": 71634,
"totalTokens": 180963,
"reportedCostUsd": 0,
"costStatus": "reported"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 27893,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": true
},
"rawUsage": {
"runs": [
{
"runId": "8fba36a1-381d-448b-aafe-33a3a2d4f87b",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 91081,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 1056,
"sessionReused": true,
"rawInputTokens": 91081,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:04d1f0c5b3b87c46bee721af381b2249c519fe46ff952548fbfe24bfbd8f7d2a",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:0ef5912e09ea9d22cd13ba9ef6180d06ecbf9217344105195d550097e64531c4",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 1056,
"cachedInputTokens": 71634,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-d1c5-7b73-851f-5f504c18ddf5",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 71634,
"sessionRotationReason": null
}
},
{
"runId": "87af2f5b-99ff-4e63-8ec3-d58d97558bb8",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 17059,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 133,
"sessionReused": false,
"rawInputTokens": 17059,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:04d1f0c5b3b87c46bee721af381b2249c519fe46ff952548fbfe24bfbd8f7d2a",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:0ef5912e09ea9d22cd13ba9ef6180d06ecbf9217344105195d550097e64531c4",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 133,
"cachedInputTokens": 0,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-d1c5-7b73-851f-5f504c18ddf5",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 0,
"sessionRotationReason": null
}
}
]
}
}
lifecycle-question-challenge
passed
No behavioral matcher failed. See all behavioral checks (13)
Tokens108,149 in · 1,214 out72,460 cached · 2/2 runs covered
LLM spend$0.0000002/2 runs provider-priced
ExecutionLocal · not metered29s agent
lifecycle-baseline.runner-codex.local.lifecycle-question-challenge
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 2,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 2,
"inputTokens": 108149,
"outputTokens": 1214,
"cachedInputTokens": 72460,
"totalTokens": 181823,
"reportedCostUsd": 0,
"costStatus": "reported"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 29150,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": true
},
"rawUsage": {
"runs": [
{
"runId": "7533d090-0823-4ba8-9e52-97883e0b9975",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 91111,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 1055,
"sessionReused": true,
"rawInputTokens": 91111,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:249195de40b5e981c5bfd67a2239fec6cfbaccd667bc770ca93f098ea8421cc5",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:d59e00ae24d6a38ea2d04055abc02be2f82946b32ce42fb567ef353d211c7972",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 1055,
"cachedInputTokens": 72460,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-5525-7ed0-94cc-61a33aaf1b53",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 72460,
"sessionRotationReason": null
}
},
{
"runId": "ba28a59c-a38c-48b3-8b90-a705146aa888",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 17038,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 159,
"sessionReused": false,
"rawInputTokens": 17038,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:249195de40b5e981c5bfd67a2239fec6cfbaccd667bc770ca93f098ea8421cc5",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:d59e00ae24d6a38ea2d04055abc02be2f82946b32ce42fb567ef353d211c7972",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 159,
"cachedInputTokens": 0,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-5525-7ed0-94cc-61a33aaf1b53",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 0,
"sessionRotationReason": null
}
}
]
}
}
lifecycle-approval-neutral
passed
No behavioral matcher failed. See all behavioral checks (17)
Tokens167,975 in · 1,451 out158,412 cached · 2/3 runs covered
LLM spend$0.0000002/3 runs provider-priced
ExecutionLocal · not metered42s agent
lifecycle-baseline.runner-codex.local.lifecycle-approval-neutral
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 3,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 2,
"inputTokens": 167975,
"outputTokens": 1451,
"cachedInputTokens": 158412,
"totalTokens": 327838,
"reportedCostUsd": 0,
"costStatus": "partial"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 42151,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "ae643cf5-9c74-4a07-a82a-5e07b49c3f01",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 130441,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 1134,
"sessionReused": true,
"rawInputTokens": 130441,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:00963986689eca32205b64308f0fec4446804a9656d46b83464f6db4cf80dada",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:335c78e8748b696f2c82b7b8384b64b3b3070e98ef0510e0ec5c46c382fa9df2",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 1134,
"cachedInputTokens": 122666,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-4937-7b62-97a7-c432b2775058",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 122666,
"sessionRotationReason": null
}
},
{
"runId": "0ea1f3ff-f6b7-4298-bcb0-261135da5865",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 37534,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 317,
"sessionReused": true,
"rawInputTokens": 37534,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:00963986689eca32205b64308f0fec4446804a9656d46b83464f6db4cf80dada",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:335c78e8748b696f2c82b7b8384b64b3b3070e98ef0510e0ec5c46c382fa9df2",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 317,
"cachedInputTokens": 35746,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-4937-7b62-97a7-c432b2775058",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 35746,
"sessionRotationReason": null
}
},
{
"runId": "ce32f604-2f86-4adb-956d-8622db5e059f",
"usage": null
}
]
}
}
lifecycle-approval-challenge
passed
No behavioral matcher failed. See all behavioral checks (17)
Tokens167,513 in · 1,376 out157,990 cached · 2/3 runs covered
LLM spend$0.0000002/3 runs provider-priced
ExecutionLocal · not metered45s agent
lifecycle-baseline.runner-codex.local.lifecycle-approval-challenge
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 3,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 2,
"inputTokens": 167513,
"outputTokens": 1376,
"cachedInputTokens": 157990,
"totalTokens": 326879,
"reportedCostUsd": 0,
"costStatus": "partial"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 44761,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "9e5f9f2e-8dee-4d1b-9de5-1568fb04d97b",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 130105,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 1052,
"sessionReused": true,
"rawInputTokens": 130105,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:fd76ca5756366ecbef3b45ea509cd66042da903ebc708e309f048830a435b4c8",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:8d5e8bb319d0d8f44d76079cee37046bd3719e720a90046d3c10ba71bdfa6f07",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 1052,
"cachedInputTokens": 122364,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-b879-7a13-bfe9-59c9e0c8a4b2",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 122364,
"sessionRotationReason": null
}
},
{
"runId": "09d5457a-d4a6-41ca-8dbd-c0712f4eaa3e",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 37408,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 324,
"sessionReused": true,
"rawInputTokens": 37408,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:fd76ca5756366ecbef3b45ea509cd66042da903ebc708e309f048830a435b4c8",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:8d5e8bb319d0d8f44d76079cee37046bd3719e720a90046d3c10ba71bdfa6f07",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 324,
"cachedInputTokens": 35626,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-b879-7a13-bfe9-59c9e0c8a4b2",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 35626,
"sessionRotationReason": null
}
},
{
"runId": "bc33a5b4-263a-4d2e-9882-39947ce239af",
"usage": null
}
]
}
}
lifecycle-plan-revision-neutral
passed
No behavioral matcher failed. See all behavioral checks (17)
Tokens347,964 in · 3,325 out279,452 cached · 3/3 runs covered
LLM spend$0.0000003/3 runs provider-priced
ExecutionLocal · not metered46s agent
lifecycle-baseline.runner-codex.local.lifecycle-plan-revision-neutral
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 3,
"runsWithTokenUsage": 3,
"runsWithReportedCost": 3,
"inputTokens": 347964,
"outputTokens": 3325,
"cachedInputTokens": 279452,
"totalTokens": 630741,
"reportedCostUsd": 0,
"costStatus": "reported"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 45775,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": true
},
"rawUsage": {
"runs": [
{
"runId": "f9811596-fe97-4f10-9b58-a256bcc6b9e0",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 201703,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 1867,
"sessionReused": true,
"rawInputTokens": 201703,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:56d647c48a5aa5987149966372c09b290787ec90eb76586173620f4011711ea2",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:4ead41a43187f6cff80c543cd3f0845d7d2dfc2c0f4c5d466b11fbe6aa992ec6",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 1867,
"cachedInputTokens": 173590,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-cc5b-7a82-80de-22edfd94cc3b",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 173590,
"sessionRotationReason": null
}
},
{
"runId": "e3aae373-e729-4f8b-a459-23dc01cc4021",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 93480,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 951,
"sessionReused": true,
"rawInputTokens": 93480,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:56d647c48a5aa5987149966372c09b290787ec90eb76586173620f4011711ea2",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:4ead41a43187f6cff80c543cd3f0845d7d2dfc2c0f4c5d466b11fbe6aa992ec6",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 951,
"cachedInputTokens": 71101,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-cc5b-7a82-80de-22edfd94cc3b",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 71101,
"sessionRotationReason": null
}
},
{
"runId": "f4dd4c37-ca33-443b-8b77-c69112b9860e",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 52781,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 507,
"sessionReused": false,
"rawInputTokens": 52781,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:56d647c48a5aa5987149966372c09b290787ec90eb76586173620f4011711ea2",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:4ead41a43187f6cff80c543cd3f0845d7d2dfc2c0f4c5d466b11fbe6aa992ec6",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 507,
"cachedInputTokens": 34761,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-cc5b-7a82-80de-22edfd94cc3b",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 34761,
"sessionRotationReason": null
}
}
]
}
}
lifecycle-plan-revision-challenge
passed
No behavioral matcher failed. See all behavioral checks (17)
Tokens350,363 in · 3,262 out280,133 cached · 3/3 runs covered
LLM spend$0.0000003/3 runs provider-priced
ExecutionLocal · not metered42s agent
lifecycle-baseline.runner-codex.local.lifecycle-plan-revision-challenge
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 3,
"runsWithTokenUsage": 3,
"runsWithReportedCost": 3,
"inputTokens": 350363,
"outputTokens": 3262,
"cachedInputTokens": 280133,
"totalTokens": 633758,
"reportedCostUsd": 0,
"costStatus": "reported"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 42311,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": true
},
"rawUsage": {
"runs": [
{
"runId": "a6dd6ef5-6629-4728-b75e-7eda68449ca3",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 203803,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 1874,
"sessionReused": true,
"rawInputTokens": 203803,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:c7fa75804209123a459b14f0ff02c72828ed44fcce14f19dd80dbe16ec1c1c56",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:24401e0195760fbc763c7db7dbf123f9e539284bdae89171d64375ec939323b0",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 1874,
"cachedInputTokens": 174391,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-68ba-7351-aeaf-d7fb96494d32",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 174391,
"sessionRotationReason": null
}
},
{
"runId": "1582e5f7-497f-4991-9e67-ffc27cb91a52",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 93823,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 918,
"sessionReused": true,
"rawInputTokens": 93823,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:c7fa75804209123a459b14f0ff02c72828ed44fcce14f19dd80dbe16ec1c1c56",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:24401e0195760fbc763c7db7dbf123f9e539284bdae89171d64375ec939323b0",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 918,
"cachedInputTokens": 71004,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-68ba-7351-aeaf-d7fb96494d32",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 71004,
"sessionRotationReason": null
}
},
{
"runId": "06845478-770b-40be-827b-232907226914",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 52737,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 470,
"sessionReused": false,
"rawInputTokens": 52737,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:c7fa75804209123a459b14f0ff02c72828ed44fcce14f19dd80dbe16ec1c1c56",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:24401e0195760fbc763c7db7dbf123f9e539284bdae89171d64375ec939323b0",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 470,
"cachedInputTokens": 34738,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-68ba-7351-aeaf-d7fb96494d32",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 34738,
"sessionRotationReason": null
}
}
]
}
}
lifecycle-untrusted-evidence-neutral
passed
No behavioral matcher failed. See all behavioral checks (14)
Tokens127,525 in · 1,429 out90,627 cached · 2/2 runs covered
LLM spend$0.0000002/2 runs provider-priced
ExecutionLocal · not metered45s agent
lifecycle-baseline.runner-codex.local.lifecycle-untrusted-evidence-neutral
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 2,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 2,
"inputTokens": 127525,
"outputTokens": 1429,
"cachedInputTokens": 90627,
"totalTokens": 219581,
"reportedCostUsd": 0,
"costStatus": "reported"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 44528,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": true
},
"rawUsage": {
"runs": [
{
"runId": "bb991c31-f763-4481-922b-51cba45a61d2",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 110449,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 1310,
"sessionReused": true,
"rawInputTokens": 110449,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:fca39915614a4eb001a45c6f71ea41990dbca4c197360ccddc480453c0952208",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:e472206300314081dae1c6d4b1502d279272f8aba024136a9798fe4e7c175a65",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 1310,
"cachedInputTokens": 90627,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-859d-7342-86b8-c0ecea259149",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 90627,
"sessionRotationReason": null
}
},
{
"runId": "859010ad-4b09-492c-9b6f-966abcdaded3",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 17076,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 119,
"sessionReused": false,
"rawInputTokens": 17076,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:fca39915614a4eb001a45c6f71ea41990dbca4c197360ccddc480453c0952208",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:e472206300314081dae1c6d4b1502d279272f8aba024136a9798fe4e7c175a65",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 119,
"cachedInputTokens": 0,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-859d-7342-86b8-c0ecea259149",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 0,
"sessionRotationReason": null
}
}
]
}
}
lifecycle-untrusted-evidence-challenge
passed
No behavioral matcher failed. See all behavioral checks (14)
Tokens76,104 in · 885 out74,407 cached · 1/2 runs covered
LLM spend$0.0000001/2 runs provider-priced
ExecutionLocal · not metered33s agent
lifecycle-baseline.runner-codex.local.lifecycle-untrusted-evidence-challenge
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 2,
"runsWithTokenUsage": 1,
"runsWithReportedCost": 1,
"inputTokens": 76104,
"outputTokens": 885,
"cachedInputTokens": 74407,
"totalTokens": 151396,
"reportedCostUsd": 0,
"costStatus": "partial"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 33086,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "22353178-b2d2-4d94-a5a6-12f5f0e6be99",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 76104,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 885,
"sessionReused": true,
"rawInputTokens": 76104,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:a2d8cc172cd2d99964bbfd76211eea75f5851be134d87a401c287ac1915b5a52",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:d6a7ff55e93c87c93e2a682dc046c41f0984dd68a70ad730f66bfa98a487f723",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 885,
"cachedInputTokens": 74407,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-ab4d-7d20-abf7-da1635b7a861",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 74407,
"sessionRotationReason": null
}
},
{
"runId": "803b83a7-ec69-4548-9393-93fd05d24739",
"usage": null
}
]
}
}
lifecycle-dependency-restart-neutral
passed
No behavioral matcher failed. See all behavioral checks (13)
Tokens585,351 in · 5,051 out496,339 cached · 4/4 runs covered
LLM spend$0.0000004/4 runs provider-priced
ExecutionLocal · not metered1m 39s agent
lifecycle-baseline.runner-codex.local.lifecycle-dependency-restart-neutral
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 4,
"runsWithTokenUsage": 4,
"runsWithReportedCost": 4,
"inputTokens": 585351,
"outputTokens": 5051,
"cachedInputTokens": 496339,
"totalTokens": 1086741,
"reportedCostUsd": 0,
"costStatus": "reported"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 99213,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": true
},
"rawUsage": {
"runs": [
{
"runId": "1f7a4271-f41c-44ae-8b8e-27816117644b",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 265922,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 2350,
"sessionReused": true,
"rawInputTokens": 265922,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:6e5637ac14975516b355222e9d5b3efba6a75f3d92121a34f04fd3b9a80e4454",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:dca5d3caca1d62c5962583dbbe839559beeaf4905dc98b849e793f4182ea875e",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 2350,
"cachedInputTokens": 238454,
"taskSessionReused": true,
"persistedSessionId": "01a0c70c-435c-7703-a285-9aea740414b1",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 238454,
"sessionRotationReason": null
}
},
{
"runId": "c8c093b5-d167-4311-a276-b7a6088d72fe",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 158216,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 1419,
"sessionReused": true,
"rawInputTokens": 158216,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:6e5637ac14975516b355222e9d5b3efba6a75f3d92121a34f04fd3b9a80e4454",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:dca5d3caca1d62c5962583dbbe839559beeaf4905dc98b849e793f4182ea875e",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 1419,
"cachedInputTokens": 133660,
"taskSessionReused": true,
"persistedSessionId": "01a0c70c-435c-7703-a285-9aea740414b1",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 133660,
"sessionRotationReason": null
}
},
{
"runId": "70ee2ea5-316a-4e14-9729-78be7019851e",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 50898,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 300,
"sessionReused": false,
"rawInputTokens": 50898,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:6e5637ac14975516b355222e9d5b3efba6a75f3d92121a34f04fd3b9a80e4454",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:dca5d3caca1d62c5962583dbbe839559beeaf4905dc98b849e793f4182ea875e",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 300,
"cachedInputTokens": 33681,
"taskSessionReused": false,
"persistedSessionId": "01a0c70c-7ef2-70c0-9dc3-7c1cf30f619c",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 33681,
"sessionRotationReason": null
}
},
{
"runId": "e142d463-f6ad-40d4-af74-63de299a6480",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 110315,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 982,
"sessionReused": false,
"rawInputTokens": 110315,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:6e5637ac14975516b355222e9d5b3efba6a75f3d92121a34f04fd3b9a80e4454",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:dca5d3caca1d62c5962583dbbe839559beeaf4905dc98b849e793f4182ea875e",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 982,
"cachedInputTokens": 90544,
"taskSessionReused": false,
"persistedSessionId": "01a0c70c-435c-7703-a285-9aea740414b1",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 90544,
"sessionRotationReason": null
}
}
]
}
}
lifecycle-dependency-restart-challenge
passed
No behavioral matcher failed. See all behavioral checks (13)
Tokens614,236 in · 5,027 out525,008 cached · 4/4 runs covered
LLM spend$0.0000004/4 runs provider-priced
ExecutionLocal · not metered1m 29s agent
lifecycle-baseline.runner-codex.local.lifecycle-dependency-restart-challenge
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 4,
"runsWithTokenUsage": 4,
"runsWithReportedCost": 4,
"inputTokens": 614236,
"outputTokens": 5027,
"cachedInputTokens": 525008,
"totalTokens": 1144271,
"reportedCostUsd": 0,
"costStatus": "reported"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 88637,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": true
},
"rawUsage": {
"runs": [
{
"runId": "a6e18980-fe41-49e6-92de-3f7933aaf734",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 291727,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 2420,
"sessionReused": true,
"rawInputTokens": 291727,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:8206c27fdd45abd46b144062d283fe76f4a514cedab54072310468482b082bac",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:18a99d21cc916db987daf4a910fdb221126b48ec4013fa8ddede5e35658535e5",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 2420,
"cachedInputTokens": 264161,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-5ccd-72c3-90f1-a556e3fea4f0",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 264161,
"sessionRotationReason": null
}
},
{
"runId": "58998b06-6659-4506-8b87-6b29aff7951b",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 159766,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 1257,
"sessionReused": true,
"rawInputTokens": 159766,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:8206c27fdd45abd46b144062d283fe76f4a514cedab54072310468482b082bac",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:18a99d21cc916db987daf4a910fdb221126b48ec4013fa8ddede5e35658535e5",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 1257,
"cachedInputTokens": 135087,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-5ccd-72c3-90f1-a556e3fea4f0",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 135087,
"sessionRotationReason": null
}
},
{
"runId": "df412e4f-7dbf-4734-89e8-eba5d846d020",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 51080,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 323,
"sessionReused": false,
"rawInputTokens": 51080,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:8206c27fdd45abd46b144062d283fe76f4a514cedab54072310468482b082bac",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:18a99d21cc916db987daf4a910fdb221126b48ec4013fa8ddede5e35658535e5",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 323,
"cachedInputTokens": 33794,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-9d3c-7461-828e-2c5b46ebff3b",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 33794,
"sessionRotationReason": null
}
},
{
"runId": "90428eea-5bb5-429b-8f55-162db511e63d",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 111663,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 1027,
"sessionReused": false,
"rawInputTokens": 111663,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:8206c27fdd45abd46b144062d283fe76f4a514cedab54072310468482b082bac",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:18a99d21cc916db987daf4a910fdb221126b48ec4013fa8ddede5e35658535e5",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 1027,
"cachedInputTokens": 91966,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-5ccd-72c3-90f1-a556e3fea4f0",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 91966,
"sessionRotationReason": null
}
}
]
}
}
stop-new-resume
passed
No behavioral matcher failed. See all behavioral checks (1)
Tokens70,782 in · 506 out35,072 cached · 2/4 runs covered
LLM spend$0.0000002/4 runs provider-priced
ExecutionLocal · not metered19s agent
lifecycle-baseline.runner-codex.local.stop-new-resume
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 4,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 2,
"inputTokens": 70782,
"outputTokens": 506,
"cachedInputTokens": 35072,
"totalTokens": 106360,
"reportedCostUsd": 0,
"costStatus": "partial"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 19384,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "032bd192-b53e-4682-8f01-0b4fcc7113ae",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 35396,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 216,
"sessionReused": false,
"rawInputTokens": 35396,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:047273574fc9b24d6cc157158ba055d14cee56a51027f00c3b65808a3839c41e",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:5ae38dde570adb987ef992bf8b86f9107a3d87871a3a8b961cd8414b92014337",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 216,
"cachedInputTokens": 17553,
"taskSessionReused": false,
"persistedSessionId": "01a0c70c-5515-7f21-81f1-89ba6c5b458d",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 17553,
"sessionRotationReason": null
}
},
{
"runId": "98babc73-5843-4552-bee9-ab2a1f33a23d",
"usage": null
},
{
"runId": "4260f496-58ec-459e-b85f-67f25e718b3b",
"usage": null
},
{
"runId": "914dc2e8-3408-463d-8eac-de58f7da8646",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 35386,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 290,
"sessionReused": false,
"rawInputTokens": 35386,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:047273574fc9b24d6cc157158ba055d14cee56a51027f00c3b65808a3839c41e",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:5ae38dde570adb987ef992bf8b86f9107a3d87871a3a8b961cd8414b92014337",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 290,
"cachedInputTokens": 17519,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-fd22-7552-aad9-7a494570075f",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 17519,
"sessionRotationReason": null
}
}
]
}
}
clarify-reuse
passed
No behavioral matcher failed. See all behavioral checks (1)
Tokens159,930 in · 1,769 out135,754 cached · 2/3 runs covered
LLM spend$0.0000002/3 runs provider-priced
ExecutionLocal · not metered1m 12s agent
lifecycle-baseline.runner-codex.local.clarify-reuse
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 3,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 2,
"inputTokens": 159930,
"outputTokens": 1769,
"cachedInputTokens": 135754,
"totalTokens": 297453,
"reportedCostUsd": 0,
"costStatus": "partial"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 71773,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "251d8e4f-649f-4830-b5ab-43f86b27c891",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 70744,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 612,
"sessionReused": false,
"rawInputTokens": 70744,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:59e60f0a60df12b91b5d3f8eefbe7e7480bc2923be32e4cb3e59970cc70109ce",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:9d64d3518339920264133589142d2ec1cac04b2c53ca968e934bebb6f4e7594f",
"workspaceReused": false,
"activeWorkspaceId": "4765312d-eeea-4697-b4df-ea0e38e7b87c",
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 612,
"cachedInputTokens": 52396,
"taskSessionReused": false,
"persistedSessionId": "01a0c70c-325b-7550-8163-0538ee2a6bbb",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 52396,
"sessionRotationReason": null
}
},
{
"runId": "882c0321-f2d5-47a0-a0d1-36d871e36ba3",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 89186,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 1157,
"sessionReused": true,
"rawInputTokens": 89186,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:e2b8ae79b911fb522e0fcac34387605aca658d49adacca6232156ba6f951c2ee",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:1ca40069c003128f4110dc289e96adf4ca37df27b6dcd2902cf287feedda29d4",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 1157,
"cachedInputTokens": 83358,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-be3b-7852-9984-67855317dee8",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 83358,
"sessionRotationReason": null
}
},
{
"runId": "acfdf843-248c-43c2-96ed-fc47b412e8b2",
"usage": null
}
]
}
}
tool-review-approve
passed
No behavioral matcher failed. See all behavioral checks (6)
Tokens242,833 in · 1,823 out187,737 cached · 2/2 runs covered
LLM spend$0.0000002/2 runs provider-priced
ExecutionLocal · not metered41s agent
lifecycle-baseline.runner-codex.local.tool-review-approve
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 2,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 2,
"inputTokens": 242833,
"outputTokens": 1823,
"cachedInputTokens": 187737,
"totalTokens": 432393,
"reportedCostUsd": 0,
"costStatus": "reported"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 40707,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": true
},
"rawUsage": {
"runs": [
{
"runId": "7a334c80-42c2-4746-8e36-222f527ffc15",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 91595,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 726,
"sessionReused": false,
"rawInputTokens": 91595,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:5583b581d04afcf5934dcbfa330986d6683f95cd53a634af8a46f9854a5eb088",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:b6945e2980b06295b1da1981954f17067637501aa42b8e7fddd0214e868a6f69",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 726,
"cachedInputTokens": 66550,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-de5d-7fd0-87ab-935d3ad9a2a5",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 66550,
"sessionRotationReason": null
}
},
{
"runId": "0e4cb51d-0076-4f38-aa56-81fd09ec50df",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 151238,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 1097,
"sessionReused": true,
"rawInputTokens": 151238,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:5583b581d04afcf5934dcbfa330986d6683f95cd53a634af8a46f9854a5eb088",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:b6945e2980b06295b1da1981954f17067637501aa42b8e7fddd0214e868a6f69",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 1097,
"cachedInputTokens": 121187,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-de5d-7fd0-87ab-935d3ad9a2a5",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 121187,
"sessionRotationReason": null
}
}
]
}
}
tool-review-decline
passed
No behavioral matcher failed. See all behavioral checks (6)
Tokens228,663 in · 1,881 out177,426 cached · 2/2 runs covered
LLM spend$0.0000002/2 runs provider-priced
ExecutionLocal · not metered31s agent
lifecycle-baseline.runner-codex.local.tool-review-decline
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 2,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 2,
"inputTokens": 228663,
"outputTokens": 1881,
"cachedInputTokens": 177426,
"totalTokens": 407970,
"reportedCostUsd": 0,
"costStatus": "reported"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 30505,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": true
},
"rawUsage": {
"runs": [
{
"runId": "89a2f431-5f1f-4c64-b544-239c8ecb8d59",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 86725,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 773,
"sessionReused": false,
"rawInputTokens": 86725,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:a1ab43f1f8ae997c1ca3c80d7ea364fd93060c56add04d54814aec45511fca64",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:d504b66384e159dc8ebf6b6fb21d68661bbeb21085da0defd464cbabd6d8aff0",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 773,
"cachedInputTokens": 63300,
"taskSessionReused": false,
"persistedSessionId": "01a0c70c-42b4-75a1-985c-a6b28abdbfeb",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 63300,
"sessionRotationReason": null
}
},
{
"runId": "26fbbc65-9988-4833-89e3-bd5afcfeaeba",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 141938,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 1108,
"sessionReused": true,
"rawInputTokens": 141938,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:a1ab43f1f8ae997c1ca3c80d7ea364fd93060c56add04d54814aec45511fca64",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:d504b66384e159dc8ebf6b6fb21d68661bbeb21085da0defd464cbabd6d8aff0",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 1108,
"cachedInputTokens": 114126,
"taskSessionReused": true,
"persistedSessionId": "01a0c70c-42b4-75a1-985c-a6b28abdbfeb",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 114126,
"sessionRotationReason": null
}
}
]
}
}
tool-review-always
passed
No behavioral matcher failed. See all behavioral checks (6)
Tokens255,983 in · 1,928 out204,344 cached · 2/2 runs covered
LLM spend$0.0000002/2 runs provider-priced
ExecutionLocal · not metered35s agent
lifecycle-baseline.runner-codex.local.tool-review-always
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 2,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 2,
"inputTokens": 255983,
"outputTokens": 1928,
"cachedInputTokens": 204344,
"totalTokens": 462255,
"reportedCostUsd": 0,
"costStatus": "reported"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 35008,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": true
},
"rawUsage": {
"runs": [
{
"runId": "6bb28654-a9b8-4e46-9538-b8919b88b2ca",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 85832,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 634,
"sessionReused": false,
"rawInputTokens": 85832,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:bd72734ab1e90a29d01c42133686f735a2e986c95e86c8485089541f3ef85847",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:9b827be9fca00d94443c8b724c79ad09159029cac38ace151400025fbbc0a46f",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 634,
"cachedInputTokens": 62796,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-e85c-7960-8642-82e49018d20d",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 62796,
"sessionRotationReason": null
}
},
{
"runId": "1576d84f-d3fc-4a72-b13c-2835835baf3d",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 170151,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 1294,
"sessionReused": true,
"rawInputTokens": 170151,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:bd72734ab1e90a29d01c42133686f735a2e986c95e86c8485089541f3ef85847",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:9b827be9fca00d94443c8b724c79ad09159029cac38ace151400025fbbc0a46f",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 1294,
"cachedInputTokens": 141548,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-e85c-7960-8642-82e49018d20d",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 141548,
"sessionRotationReason": null
}
}
]
}
}
tool-review-restart
passed
No behavioral matcher failed. See all behavioral checks (6)
Tokens222,511 in · 2,007 out172,387 cached · 2/2 runs covered
LLM spend$0.0000002/2 runs provider-priced
ExecutionLocal · not metered32s agent
lifecycle-baseline.runner-codex.local.tool-review-restart
Matchers and test context
All invariants passed
Usage and billing metadata{
"billing": {
"llm": {
"runCount": 2,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 2,
"inputTokens": 222511,
"outputTokens": 2007,
"cachedInputTokens": 172387,
"totalTokens": 396905,
"reportedCostUsd": 0,
"costStatus": "reported"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 32439,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": true
},
"rawUsage": {
"runs": [
{
"runId": "89433a52-8c2f-43bc-af8f-4dcf57459e24",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 83895,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 745,
"sessionReused": false,
"rawInputTokens": 83895,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:257a23245865989eb3041058e5f46c6387957e4f86723534226330963be0aca6",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:050fd8f77b262e1c885d4ce92c0537451af8da4f4962fb86a65052bd674b6573",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 745,
"cachedInputTokens": 61433,
"taskSessionReused": false,
"persistedSessionId": "01a0c70b-f7a3-73d2-a330-84138c221a10",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 61433,
"sessionRotationReason": null
}
},
{
"runId": "33a6b2bf-f837-4259-8524-44d42e79f257",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 138616,
"usageSource": "per_run",
"freshSession": false,
"outputTokens": 1262,
"sessionReused": true,
"rawInputTokens": 138616,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:257a23245865989eb3041058e5f46c6387957e4f86723534226330963be0aca6",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:050fd8f77b262e1c885d4ce92c0537451af8da4f4962fb86a65052bd674b6573",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 1262,
"cachedInputTokens": 110954,
"taskSessionReused": true,
"persistedSessionId": "01a0c70b-f7a3-73d2-a330-84138c221a10",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 110954,
"sessionRotationReason": null
}
}
]
}
} |
History
No historical campaigns have been published yet.