continuation.legacy-codex.local.answer-updates-scope
Matchers and test context
Not selected
No matcher result was recorded.
Full-stack acceptance campaign
A browser-verified matrix of runner profiles, execution environments, and deterministic task contracts. Declared PNG screenshots and sanitized structured evidence are retained with every published campaign; additional diagnostic evidence remains in the access-controlled workflow artifact.

Model spend is the provider-reported subtotal; unpriced or unavailable runs are excluded, never counted as free. Daytona runtime is a public-list-price estimate from captured lease time and pinned resources, before credits, discounts, storage allowance, or invoice adjustments. Local execution has no external runtime meter.
Test suite
Human direction, approval boundaries, untrusted evidence, and completed actions across turns.
| Agent profile | Isolated locallocal · local |
|---|---|
Legacy Codexlegacycodex · gpt-5.6-sol
|
Isolated locallocal · local
answer updates scope
not selected
continuation.legacy-codex.local.answer-updates-scope
Matchers and test contextNot selected No matcher result was recorded.
clarification not approval
not selected
continuation.legacy-codex.local.clarification-not-approval
Matchers and test contextNot selected No matcher result was recorded.
revision preserves approval
not selected
continuation.legacy-codex.local.revision-preserves-approval
Matchers and test contextNot selected No matcher result was recorded.
untrusted evidence
not selected
continuation.legacy-codex.local.untrusted-evidence
Matchers and test contextNot selected No matcher result was recorded.
completed action resume
not selected
continuation.legacy-codex.local.completed-action-resume
Matchers and test contextNot selected No matcher result was recorded. |
Legacy Claudelegacyclaude · claude-sonnet-4-6
|
Isolated locallocal · local
answer updates scope
not selected
continuation.legacy-claude.local.answer-updates-scope
Matchers and test contextNot selected No matcher result was recorded.
clarification not approval
not selected
continuation.legacy-claude.local.clarification-not-approval
Matchers and test contextNot selected No matcher result was recorded.
revision preserves approval
not selected
continuation.legacy-claude.local.revision-preserves-approval
Matchers and test contextNot selected No matcher result was recorded.
untrusted evidence
not selected
continuation.legacy-claude.local.untrusted-evidence
Matchers and test contextNot selected No matcher result was recorded.
completed action resume
not selected
continuation.legacy-claude.local.completed-action-resume
Matchers and test contextNot selected No matcher result was recorded. |
Runner Codexnativecodex · gpt-5.6-sol
|
Isolated locallocal · local
answer updates scope
not selected
continuation.runner-codex.local.answer-updates-scope
Matchers and test contextNot selected No matcher result was recorded.
clarification not approval
not selected
continuation.runner-codex.local.clarification-not-approval
Matchers and test contextNot selected No matcher result was recorded.
revision preserves approval
not selected
continuation.runner-codex.local.revision-preserves-approval
Matchers and test contextNot selected No matcher result was recorded.
untrusted evidence
not selected
continuation.runner-codex.local.untrusted-evidence
Matchers and test contextNot selected No matcher result was recorded.
completed action resume
not selected
continuation.runner-codex.local.completed-action-resume
Matchers and test contextNot selected No matcher result was recorded.
question tool documentation
not selected
continuation.runner-codex.local.question-tool-documentation
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Claudenativeacpx · claude-sonnet-5
|
Isolated locallocal · local
answer updates scope
not selected
continuation.runner-acpx-claude.local.answer-updates-scope
Matchers and test contextNot selected No matcher result was recorded.
clarification not approval
not selected
continuation.runner-acpx-claude.local.clarification-not-approval
Matchers and test contextNot selected No matcher result was recorded.
revision preserves approval
not selected
continuation.runner-acpx-claude.local.revision-preserves-approval
Matchers and test contextNot selected No matcher result was recorded.
untrusted evidence
not selected
continuation.runner-acpx-claude.local.untrusted-evidence
Matchers and test contextNot selected No matcher result was recorded.
completed action resume
not selected
continuation.runner-acpx-claude.local.completed-action-resume
Matchers and test contextNot selected No matcher result was recorded.
question tool documentation
not selected
continuation.runner-acpx-claude.local.question-tool-documentation
Matchers and test contextNot selected No matcher result was recorded.
provider question bridge
not selected
continuation.runner-acpx-claude.local.provider-question-bridge
Matchers and test contextNot selected No matcher result was recorded. |
Test suite
Real user requests, useful downloaded work, and durable continuation using production instructions.
| Agent profile | Isolated locallocal · local | Daytona warm reusable sandboxdaytona · remote |
|---|---|---|
Runner Codexnativecodex · gpt-5.6-sol
|
Isolated locallocal · local
Build, download, and revise a project
not selected
everyday-workflows.runner-codex.local.build-revise
Matchers and test contextNot selected No matcher result was recorded.
Delegate implementation and preserve late feedback
not selected
everyday-workflows.runner-codex.local.delegate-feedback
Matchers and test contextNot selected No matcher result was recorded.
Delegate work through an agent review handoff
not selected
everyday-workflows.runner-codex.local.agent-review-handoff
Matchers and test contextNot selected No matcher result was recorded.
Hire one teammate, then reuse that agent
not selected
everyday-workflows.runner-codex.local.hire-reuse
Matchers and test contextNot selected No matcher result was recorded.
Use a connection after approval
not selected
everyday-workflows.runner-codex.local.service-approve
Matchers and test contextNot selected No matcher result was recorded.
Respect a declined tool action
not selected
everyday-workflows.runner-codex.local.service-decline
Matchers and test contextNot selected No matcher result was recorded.
Respect Not now on a new connection
not selected
everyday-workflows.runner-codex.local.connection-decline
Matchers and test contextNot selected No matcher result was recorded.
Recover work after the server restarts
not selected
everyday-workflows.runner-codex.local.recover-controller
Matchers and test contextNot selected No matcher result was recorded.
Stop a task and send a new direction once
not selected
everyday-workflows.runner-codex.local.stop-redirect
Matchers and test contextNot selected No matcher result was recorded.
Create and edit a company skill
not selected
everyday-workflows.runner-codex.local.create-skill-studio
Matchers and test contextNot selected No matcher result was recorded. |
Daytona warm reusable sandboxdaytona · remote
Build, download, and revise a project
not selected
everyday-workflows.runner-codex.daytona.build-revise
Matchers and test contextNot selected No matcher result was recorded.
Delegate implementation and preserve late feedback
not selected
everyday-workflows.runner-codex.daytona.delegate-feedback
Matchers and test contextNot selected No matcher result was recorded.
Recover work after the server restarts
not selected
everyday-workflows.runner-codex.daytona.recover-controller
Matchers and test contextNot selected No matcher result was recorded.
Create and edit a company skill
not selected
everyday-workflows.runner-codex.daytona.create-skill-studio
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Claudenativeacpx · claude-sonnet-5
|
Isolated locallocal · local
Build, download, and revise a project
not selected
everyday-workflows.runner-acpx-claude.local.build-revise
Matchers and test contextNot selected No matcher result was recorded.
Delegate implementation and preserve late feedback
not selected
everyday-workflows.runner-acpx-claude.local.delegate-feedback
Matchers and test contextNot selected No matcher result was recorded.
Delegate work through an agent review handoff
not selected
everyday-workflows.runner-acpx-claude.local.agent-review-handoff
Matchers and test contextNot selected No matcher result was recorded.
Hire one teammate, then reuse that agent
not selected
everyday-workflows.runner-acpx-claude.local.hire-reuse
Matchers and test contextNot selected No matcher result was recorded.
Use a connection after approval
not selected
everyday-workflows.runner-acpx-claude.local.service-approve
Matchers and test contextNot selected No matcher result was recorded.
Respect a declined tool action
not selected
everyday-workflows.runner-acpx-claude.local.service-decline
Matchers and test contextNot selected No matcher result was recorded.
Respect Not now on a new connection
not selected
everyday-workflows.runner-acpx-claude.local.connection-decline
Matchers and test contextNot selected No matcher result was recorded.
Recover work after the server restarts
not selected
everyday-workflows.runner-acpx-claude.local.recover-controller
Matchers and test contextNot selected No matcher result was recorded.
Stop a task and send a new direction once
not selected
everyday-workflows.runner-acpx-claude.local.stop-redirect
Matchers and test contextNot selected No matcher result was recorded.
Create and edit a company skill
not selected
everyday-workflows.runner-acpx-claude.local.create-skill-studio
Matchers and test contextNot selected No matcher result was recorded. |
Daytona warm reusable sandboxdaytona · remote
Build, download, and revise a project
not selected
everyday-workflows.runner-acpx-claude.daytona.build-revise
Matchers and test contextNot selected No matcher result was recorded.
Delegate implementation and preserve late feedback
not selected
everyday-workflows.runner-acpx-claude.daytona.delegate-feedback
Matchers and test contextNot selected No matcher result was recorded.
Recover work after the server restarts
not selected
everyday-workflows.runner-acpx-claude.daytona.recover-controller
Matchers and test contextNot selected No matcher result was recorded.
Create and edit a company skill
not selected
everyday-workflows.runner-acpx-claude.daytona.create-skill-studio
Matchers and test contextNot selected No matcher result was recorded. |
Runner Codex Mininativecodex · gpt-5.4-mini
|
Isolated locallocal · local
Build, download, and revise a project
not selected
everyday-workflows.runner-codex-mini.local.build-revise
Matchers and test contextNot selected No matcher result was recorded.
Delegate implementation and preserve late feedback
not selected
everyday-workflows.runner-codex-mini.local.delegate-feedback
Matchers and test contextNot selected No matcher result was recorded.
Delegate work through an agent review handoff
not selected
everyday-workflows.runner-codex-mini.local.agent-review-handoff
Matchers and test contextNot selected No matcher result was recorded.
Hire one teammate, then reuse that agent
not selected
everyday-workflows.runner-codex-mini.local.hire-reuse
Matchers and test contextNot selected No matcher result was recorded.
Use a connection after approval
not selected
everyday-workflows.runner-codex-mini.local.service-approve
Matchers and test contextNot selected No matcher result was recorded.
Respect a declined tool action
not selected
everyday-workflows.runner-codex-mini.local.service-decline
Matchers and test contextNot selected No matcher result was recorded.
Respect Not now on a new connection
not selected
everyday-workflows.runner-codex-mini.local.connection-decline
Matchers and test contextNot selected No matcher result was recorded.
Recover work after the server restarts
not selected
everyday-workflows.runner-codex-mini.local.recover-controller
Matchers and test contextNot selected No matcher result was recorded.
Stop a task and send a new direction once
not selected
everyday-workflows.runner-codex-mini.local.stop-redirect
Matchers and test contextNot selected No matcher result was recorded.
Create and edit a company skill
not selected
everyday-workflows.runner-codex-mini.local.create-skill-studio
Matchers and test contextNot selected No matcher result was recorded. |
Daytona warm reusable sandboxdaytona · remote
|
Test suite
Production onboarding, first replies, approval, and durable task execution.
| Agent profile | Isolated locallocal · local |
|---|---|
Legacy Codexlegacycodex · Production onboarding default
|
Isolated locallocal · local
Interview: first response
not selected
first-task.legacy-codex.local.interview-first-response
Matchers and test contextNot selected No matcher result was recorded.
Clear task: first response
not selected
first-task.legacy-codex.local.clear-task-first-response
Matchers and test contextNot selected No matcher result was recorded.
Ambiguous task: first response
not selected
first-task.legacy-codex.local.ambiguous-task-first-response
Matchers and test contextNot selected No matcher result was recorded.
Opening card replaced by a message
not selected
first-task.legacy-codex.local.plain-message-first-response
Matchers and test contextNot selected No matcher result was recorded.
Explicit plan: first response
not selected
first-task.legacy-codex.local.plan-first-response
Matchers and test contextNot selected No matcher result was recorded.
Other tasks do not inherit onboarding policy
not selected
first-task.legacy-codex.local.ordinary-task-control
Matchers and test contextNot selected No matcher result was recorded.
Interview, plan, and acceptance
not selected
first-task.legacy-codex.local.interview-plan-accept
Matchers and test contextNot selected No matcher result was recorded.
Subtask accepted through a card
not selected
first-task.legacy-codex.local.task-card-accept
Matchers and test contextNot selected No matcher result was recorded.
Accept a proposal while its agent is still running
not selected
first-task.legacy-codex.local.accept-while-running
Matchers and test contextNot selected No matcher result was recorded.
Subtask accepted in conversation
not selected
first-task.legacy-codex.local.task-reply-accept
Matchers and test contextNot selected No matcher result was recorded.
Clarification, proposal, and acceptance
not selected
first-task.legacy-codex.local.clarify-propose-accept
Matchers and test contextNot selected No matcher result was recorded.
Revise scope before accepting
not selected
first-task.legacy-codex.local.revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Decline proposed work
not selected
first-task.legacy-codex.local.reject-no-execution
Matchers and test contextNot selected No matcher result was recorded. |
Legacy Claudelegacyclaude · Production onboarding default
|
Isolated locallocal · local
Interview: first response
not selected
first-task.legacy-claude.local.interview-first-response
Matchers and test contextNot selected No matcher result was recorded.
Clear task: first response
not selected
first-task.legacy-claude.local.clear-task-first-response
Matchers and test contextNot selected No matcher result was recorded.
Ambiguous task: first response
not selected
first-task.legacy-claude.local.ambiguous-task-first-response
Matchers and test contextNot selected No matcher result was recorded.
Opening card replaced by a message
not selected
first-task.legacy-claude.local.plain-message-first-response
Matchers and test contextNot selected No matcher result was recorded.
Explicit plan: first response
not selected
first-task.legacy-claude.local.plan-first-response
Matchers and test contextNot selected No matcher result was recorded.
Other tasks do not inherit onboarding policy
not selected
first-task.legacy-claude.local.ordinary-task-control
Matchers and test contextNot selected No matcher result was recorded.
Interview, plan, and acceptance
not selected
first-task.legacy-claude.local.interview-plan-accept
Matchers and test contextNot selected No matcher result was recorded.
Subtask accepted through a card
not selected
first-task.legacy-claude.local.task-card-accept
Matchers and test contextNot selected No matcher result was recorded.
Accept a proposal while its agent is still running
not selected
first-task.legacy-claude.local.accept-while-running
Matchers and test contextNot selected No matcher result was recorded.
Subtask accepted in conversation
not selected
first-task.legacy-claude.local.task-reply-accept
Matchers and test contextNot selected No matcher result was recorded.
Clarification, proposal, and acceptance
not selected
first-task.legacy-claude.local.clarify-propose-accept
Matchers and test contextNot selected No matcher result was recorded.
Revise scope before accepting
not selected
first-task.legacy-claude.local.revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Decline proposed work
not selected
first-task.legacy-claude.local.reject-no-execution
Matchers and test contextNot selected No matcher result was recorded. |
Runner Codexnativecodex · Production onboarding default
|
Isolated locallocal · local
Interview: first response
not selected
first-task.runner-codex.local.interview-first-response
Matchers and test contextNot selected No matcher result was recorded.
Clear task: first response
not selected
first-task.runner-codex.local.clear-task-first-response
Matchers and test contextNot selected No matcher result was recorded.
Ambiguous task: first response
not selected
first-task.runner-codex.local.ambiguous-task-first-response
Matchers and test contextNot selected No matcher result was recorded.
Opening card replaced by a message
not selected
first-task.runner-codex.local.plain-message-first-response
Matchers and test contextNot selected No matcher result was recorded.
Explicit plan: first response
not selected
first-task.runner-codex.local.plan-first-response
Matchers and test contextNot selected No matcher result was recorded.
Other tasks do not inherit onboarding policy
not selected
first-task.runner-codex.local.ordinary-task-control
Matchers and test contextNot selected No matcher result was recorded.
Interview, plan, and acceptance
not selected
first-task.runner-codex.local.interview-plan-accept
Matchers and test contextNot selected No matcher result was recorded.
Subtask accepted through a card
not selected
first-task.runner-codex.local.task-card-accept
Matchers and test contextNot selected No matcher result was recorded.
Accept a proposal while its agent is still running
not selected
first-task.runner-codex.local.accept-while-running
Matchers and test contextNot selected No matcher result was recorded.
Subtask accepted in conversation
not selected
first-task.runner-codex.local.task-reply-accept
Matchers and test contextNot selected No matcher result was recorded.
Clarification, proposal, and acceptance
not selected
first-task.runner-codex.local.clarify-propose-accept
Matchers and test contextNot selected No matcher result was recorded.
Revise scope before accepting
not selected
first-task.runner-codex.local.revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Decline proposed work
not selected
first-task.runner-codex.local.reject-no-execution
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Claudenativeacpx · Production onboarding default
|
Isolated locallocal · local
Interview: first response
not selected
first-task.runner-acpx-claude.local.interview-first-response
Matchers and test contextNot selected No matcher result was recorded.
Clear task: first response
not selected
first-task.runner-acpx-claude.local.clear-task-first-response
Matchers and test contextNot selected No matcher result was recorded.
Ambiguous task: first response
not selected
first-task.runner-acpx-claude.local.ambiguous-task-first-response
Matchers and test contextNot selected No matcher result was recorded.
Opening card replaced by a message
not selected
first-task.runner-acpx-claude.local.plain-message-first-response
Matchers and test contextNot selected No matcher result was recorded.
Explicit plan: first response
not selected
first-task.runner-acpx-claude.local.plan-first-response
Matchers and test contextNot selected No matcher result was recorded.
Other tasks do not inherit onboarding policy
not selected
first-task.runner-acpx-claude.local.ordinary-task-control
Matchers and test contextNot selected No matcher result was recorded.
Interview, plan, and acceptance
not selected
first-task.runner-acpx-claude.local.interview-plan-accept
Matchers and test contextNot selected No matcher result was recorded.
Subtask accepted through a card
not selected
first-task.runner-acpx-claude.local.task-card-accept
Matchers and test contextNot selected No matcher result was recorded.
Accept a proposal while its agent is still running
not selected
first-task.runner-acpx-claude.local.accept-while-running
Matchers and test contextNot selected No matcher result was recorded.
Subtask accepted in conversation
not selected
first-task.runner-acpx-claude.local.task-reply-accept
Matchers and test contextNot selected No matcher result was recorded.
Clarification, proposal, and acceptance
not selected
first-task.runner-acpx-claude.local.clarify-propose-accept
Matchers and test contextNot selected No matcher result was recorded.
Revise scope before accepting
not selected
first-task.runner-acpx-claude.local.revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Decline proposed work
not selected
first-task.runner-acpx-claude.local.reject-no-execution
Matchers and test contextNot selected No matcher result was recorded. |
Test suite
Task-backed conversations, session resets, and project plan handoff.
| Agent profile | Isolated locallocal · local |
|---|---|
Legacy Codexlegacycodex · gpt-5.6-sol
|
Isolated locallocal · local
Conversation continuity across restart
not selected
agent-chat.legacy-codex.local.continuity-restart
Matchers and test contextNot selected No matcher result was recorded.
Fresh context within preserved history
not selected
agent-chat.legacy-codex.local.new-session
Matchers and test contextNot selected No matcher result was recorded.
Stop, reset, and resume
not selected
agent-chat.legacy-codex.local.stop-new-resume
Matchers and test contextNot selected No matcher result was recorded.
Draft, revise, approve, and hand off a plan
not selected
agent-chat.legacy-codex.local.plan-handoff
Matchers and test contextNot selected No matcher result was recorded.
Clarify and reuse an existing project
not selected
agent-chat.legacy-codex.local.clarify-reuse
Matchers and test contextNot selected No matcher result was recorded.
Create a project with multiple repository URLs
not selected
agent-chat.legacy-codex.local.multi-repository
Matchers and test contextNot selected No matcher result was recorded. |
Legacy Claudelegacyclaude · claude-sonnet-4-6
|
Isolated locallocal · local
Conversation continuity across restart
not selected
agent-chat.legacy-claude.local.continuity-restart
Matchers and test contextNot selected No matcher result was recorded.
Fresh context within preserved history
not selected
agent-chat.legacy-claude.local.new-session
Matchers and test contextNot selected No matcher result was recorded.
Stop, reset, and resume
not selected
agent-chat.legacy-claude.local.stop-new-resume
Matchers and test contextNot selected No matcher result was recorded.
Draft, revise, approve, and hand off a plan
not selected
agent-chat.legacy-claude.local.plan-handoff
Matchers and test contextNot selected No matcher result was recorded.
Clarify and reuse an existing project
not selected
agent-chat.legacy-claude.local.clarify-reuse
Matchers and test contextNot selected No matcher result was recorded.
Create a project with multiple repository URLs
not selected
agent-chat.legacy-claude.local.multi-repository
Matchers and test contextNot selected No matcher result was recorded. |
Runner Codexnativecodex · gpt-5.6-sol
|
Isolated locallocal · local
Save a planned task without starting work
not selected
agent-chat.runner-codex.local.create-backlog
Matchers and test contextNot selected No matcher result was recorded.
Reassign existing work and preserve queued context
not selected
agent-chat.runner-codex.local.reassign-task
Matchers and test contextNot selected No matcher result was recorded.
Conversation continuity across restart
not selected
agent-chat.runner-codex.local.continuity-restart
Matchers and test contextNot selected No matcher result was recorded.
Fresh context within preserved history
not selected
agent-chat.runner-codex.local.new-session
Matchers and test contextNot selected No matcher result was recorded.
Stop, reset, and resume
not selected
agent-chat.runner-codex.local.stop-new-resume
Matchers and test contextNot selected No matcher result was recorded.
Draft, revise, approve, and hand off a plan
not selected
agent-chat.runner-codex.local.plan-handoff
Matchers and test contextNot selected No matcher result was recorded.
Clarify and reuse an existing project
not selected
agent-chat.runner-codex.local.clarify-reuse
Matchers and test contextNot selected No matcher result was recorded.
Create a project with multiple repository URLs
not selected
agent-chat.runner-codex.local.multi-repository
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Claudenativeacpx · claude-sonnet-5
|
Isolated locallocal · local
Save a planned task without starting work
not selected
agent-chat.runner-acpx-claude.local.create-backlog
Matchers and test contextNot selected No matcher result was recorded.
Reassign existing work and preserve queued context
not selected
agent-chat.runner-acpx-claude.local.reassign-task
Matchers and test contextNot selected No matcher result was recorded.
Conversation continuity across restart
not selected
agent-chat.runner-acpx-claude.local.continuity-restart
Matchers and test contextNot selected No matcher result was recorded.
Fresh context within preserved history
not selected
agent-chat.runner-acpx-claude.local.new-session
Matchers and test contextNot selected No matcher result was recorded.
Stop, reset, and resume
not selected
agent-chat.runner-acpx-claude.local.stop-new-resume
Matchers and test contextNot selected No matcher result was recorded.
Draft, revise, approve, and hand off a plan
not selected
agent-chat.runner-acpx-claude.local.plan-handoff
Matchers and test contextNot selected No matcher result was recorded.
Clarify and reuse an existing project
not selected
agent-chat.runner-acpx-claude.local.clarify-reuse
Matchers and test contextNot selected No matcher result was recorded.
Create a project with multiple repository URLs
not selected
agent-chat.runner-acpx-claude.local.multi-repository
Matchers and test contextNot selected No matcher result was recorded. |
Test suite
Native chat startup cancellation, committed sends, hiring, grounded status, and remote continuity.
| Agent profile | Isolated locallocal · local | Daytona warm reusable sandboxdaytona · remote |
|---|---|---|
Runner Codexnativecodex · gpt-5.6-sol
|
Isolated locallocal · local
Stop during startup, reset, and resume
not selected
agent-chat-hardening.runner-codex.local.stop-startup-new-resume
Matchers and test contextNot selected No matcher result was recorded.
Hire through chat, delegate, and reuse the same teammate
not selected
agent-chat-hardening.runner-codex.local.hire-delegate-reuse
Matchers and test contextNot selected No matcher result was recorded.
Read the actual blocker and hand source material to a reviewer
not selected
agent-chat-hardening.runner-codex.local.blocked-status-review
Matchers and test contextNot selected No matcher result was recorded.
Recover a lost send acknowledgement without repeating committed work
not selected
agent-chat-hardening.runner-codex.local.committed-send-retry
Matchers and test contextNot selected No matcher result was recorded.
Conversation continuity across restart
not selected
agent-chat-hardening.runner-codex.local.continuity-restart
Matchers and test contextNot selected No matcher result was recorded.
Stop, reset, and resume
not selected
agent-chat-hardening.runner-codex.local.stop-new-resume
Matchers and test contextNot selected No matcher result was recorded. |
Daytona warm reusable sandboxdaytona · remote
Recover a lost send acknowledgement without repeating committed work
not selected
agent-chat-hardening.runner-codex.daytona.committed-send-retry
Matchers and test contextNot selected No matcher result was recorded.
Conversation continuity across restart
not selected
agent-chat-hardening.runner-codex.daytona.continuity-restart
Matchers and test contextNot selected No matcher result was recorded.
Stop, reset, and resume
not selected
agent-chat-hardening.runner-codex.daytona.stop-new-resume
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Claudenativeacpx · claude-sonnet-5
|
Isolated locallocal · local
Stop during startup, reset, and resume
not selected
agent-chat-hardening.runner-acpx-claude.local.stop-startup-new-resume
Matchers and test contextNot selected No matcher result was recorded.
Hire through chat, delegate, and reuse the same teammate
not selected
agent-chat-hardening.runner-acpx-claude.local.hire-delegate-reuse
Matchers and test contextNot selected No matcher result was recorded.
Read the actual blocker and hand source material to a reviewer
not selected
agent-chat-hardening.runner-acpx-claude.local.blocked-status-review
Matchers and test contextNot selected No matcher result was recorded.
Recover a lost send acknowledgement without repeating committed work
not selected
agent-chat-hardening.runner-acpx-claude.local.committed-send-retry
Matchers and test contextNot selected No matcher result was recorded.
Conversation continuity across restart
not selected
agent-chat-hardening.runner-acpx-claude.local.continuity-restart
Matchers and test contextNot selected No matcher result was recorded.
Stop, reset, and resume
not selected
agent-chat-hardening.runner-acpx-claude.local.stop-new-resume
Matchers and test contextNot selected No matcher result was recorded. |
Daytona warm reusable sandboxdaytona · remote
Recover a lost send acknowledgement without repeating committed work
not selected
agent-chat-hardening.runner-acpx-claude.daytona.committed-send-retry
Matchers and test contextNot selected No matcher result was recorded.
Conversation continuity across restart
not selected
agent-chat-hardening.runner-acpx-claude.daytona.continuity-restart
Matchers and test contextNot selected No matcher result was recorded.
Stop, reset, and resume
not selected
agent-chat-hardening.runner-acpx-claude.daytona.stop-new-resume
Matchers and test contextNot selected No matcher result was recorded. |
Test suite
Experimental settings lifecycle and user follow-ups during active native work.
| Agent profile | Isolated locallocal · local |
|---|---|
Runner Codexnativecodex · gpt-5.6-sol
|
Isolated locallocal · local
Enable Agent Chat, pause access, and resume preserved history
not selected
agent-chat-stories.runner-codex.local.enable-disable-resume
Matchers and test contextNot selected No matcher result was recorded.
Deliver a follow-up while a provider turn is running
not selected
agent-chat-stories.runner-codex.local.followup-while-running
Matchers and test contextNot selected No matcher result was recorded.
Change instructions during active work and save the updated plan
not selected
agent-chat-stories.runner-codex.local.revise-while-running
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Claudenativeacpx · claude-sonnet-5
|
Isolated locallocal · local
Enable Agent Chat, pause access, and resume preserved history
not selected
agent-chat-stories.runner-acpx-claude.local.enable-disable-resume
Matchers and test contextNot selected No matcher result was recorded.
Deliver a follow-up while a provider turn is running
not selected
agent-chat-stories.runner-acpx-claude.local.followup-while-running
Matchers and test contextNot selected No matcher result was recorded.
Change instructions during active work and save the updated plan
not selected
agent-chat-stories.runner-acpx-claude.local.revise-while-running
Matchers and test contextNot selected No matcher result was recorded. |
Test suite
Major provider, runtime generation, and execution-environment compatibility.
| Agent profile | Isolated locallocal · local | Daytona sandboxdaytona · remote |
|---|---|---|
Legacy Codexlegacycodex · gpt-5.6-sol
|
Isolated locallocal · local
Basic response
not selected
core-compatibility.legacy-codex.local.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.legacy-codex.local.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.legacy-codex.local.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Daytona sandboxdaytona · remote
Basic response
not selected
core-compatibility.legacy-codex.daytona.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.legacy-codex.daytona.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.legacy-codex.daytona.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Legacy Claudelegacyclaude · claude-sonnet-4-6
|
Isolated locallocal · local
Basic response
not selected
core-compatibility.legacy-claude.local.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.legacy-claude.local.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.legacy-claude.local.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Daytona sandboxdaytona · remote
Basic response
not selected
core-compatibility.legacy-claude.daytona.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.legacy-claude.daytona.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.legacy-claude.daytona.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Legacy OpenCodelegacyopencode · openrouter/deepseek/deepseek-v4-flash-0731
|
Isolated locallocal · local
Basic response
not selected
core-compatibility.legacy-opencode.local.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.legacy-opencode.local.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.legacy-opencode.local.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Daytona sandboxdaytona · remote
Basic response
not selected
core-compatibility.legacy-opencode.daytona.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.legacy-opencode.daytona.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.legacy-opencode.daytona.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Runner Codexnativecodex · gpt-5.6-sol
|
Isolated locallocal · local
Basic response
not selected
core-compatibility.runner-codex.local.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.runner-codex.local.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.runner-codex.local.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Daytona sandboxdaytona · remote
Basic response
not selected
core-compatibility.runner-codex.daytona.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.runner-codex.daytona.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.runner-codex.daytona.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Runner OpenCodenativeopencode · openrouter/deepseek/deepseek-v4-flash-0731
|
Isolated locallocal · local
Basic response
not selected
core-compatibility.runner-opencode.local.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.runner-opencode.local.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.runner-opencode.local.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Daytona sandboxdaytona · remote
Basic response
not selected
core-compatibility.runner-opencode.daytona.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.runner-opencode.daytona.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.runner-opencode.daytona.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Claudenativeacpx · claude-sonnet-5
|
Isolated locallocal · local
Basic response
not selected
core-compatibility.runner-acpx-claude.local.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.runner-acpx-claude.local.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.runner-acpx-claude.local.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Daytona sandboxdaytona · remote
Basic response
not selected
core-compatibility.runner-acpx-claude.daytona.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.runner-acpx-claude.daytona.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.runner-acpx-claude.daytona.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Codexnativeacpx · gpt-5.6-sol
|
Isolated locallocal · local
Basic response
not selected
core-compatibility.runner-acpx-codex.local.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.runner-acpx-codex.local.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.runner-acpx-codex.local.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Daytona sandboxdaytona · remote
Basic response
not selected
core-compatibility.runner-acpx-codex.daytona.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.runner-acpx-codex.daytona.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.runner-acpx-codex.daytona.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Test suite
Structured interaction and continuation qualification for every supported local profile.
| Agent profile | Isolated locallocal · local |
|---|---|
Legacy Codexlegacycodex · gpt-5.6-sol
|
Isolated locallocal · local
Structured question, answer, resume
not selected
local-session-integrity.legacy-codex.local.structured-question-resume
Matchers and test contextNot selected No matcher result was recorded.
Structured question, server restart, answer, resume
not selected
local-session-integrity.legacy-codex.local.structured-question-restart-resume
Matchers and test contextNot selected No matcher result was recorded. |
Legacy Claudelegacyclaude · claude-sonnet-4-6
|
Isolated locallocal · local
Structured question, answer, resume
not selected
local-session-integrity.legacy-claude.local.structured-question-resume
Matchers and test contextNot selected No matcher result was recorded.
Structured question, server restart, answer, resume
not selected
local-session-integrity.legacy-claude.local.structured-question-restart-resume
Matchers and test contextNot selected No matcher result was recorded. |
Legacy OpenCodelegacyopencode · openrouter/deepseek/deepseek-v4-flash-0731
|
Isolated locallocal · local
Structured question, answer, resume
not selected
local-session-integrity.legacy-opencode.local.structured-question-resume
Matchers and test contextNot selected No matcher result was recorded.
Structured question, server restart, answer, resume
not selected
local-session-integrity.legacy-opencode.local.structured-question-restart-resume
Matchers and test contextNot selected No matcher result was recorded. |
Runner Codexnativecodex · gpt-5.6-sol
|
Isolated locallocal · local
Structured question, answer, resume
not selected
local-session-integrity.runner-codex.local.structured-question-resume
Matchers and test contextNot selected No matcher result was recorded.
Structured question, server restart, answer, resume
not selected
local-session-integrity.runner-codex.local.structured-question-restart-resume
Matchers and test contextNot selected No matcher result was recorded. |
Runner OpenCodenativeopencode · openrouter/deepseek/deepseek-v4-flash-0731
|
Isolated locallocal · local
Structured question, answer, resume
not selected
local-session-integrity.runner-opencode.local.structured-question-resume
Matchers and test contextNot selected No matcher result was recorded.
Structured question, server restart, answer, resume
not selected
local-session-integrity.runner-opencode.local.structured-question-restart-resume
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Claudenativeacpx · claude-sonnet-5
|
Isolated locallocal · local
Structured question, answer, resume
not selected
local-session-integrity.runner-acpx-claude.local.structured-question-resume
Matchers and test contextNot selected No matcher result was recorded.
Structured question, server restart, answer, resume
not selected
local-session-integrity.runner-acpx-claude.local.structured-question-restart-resume
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Codexnativeacpx · gpt-5.6-sol
|
Isolated locallocal · local
Structured question, answer, resume
not selected
local-session-integrity.runner-acpx-codex.local.structured-question-resume
Matchers and test contextNot selected No matcher result was recorded.
Structured question, server restart, answer, resume
not selected
local-session-integrity.runner-acpx-codex.local.structured-question-restart-resume
Matchers and test contextNot selected No matcher result was recorded. |
Test suite
Weekly-ranked tool-capable OpenRouter models through native OpenCode on isolated local workspaces.
| Agent profile | Isolated locallocal · local |
|---|---|
#1 DeepSeek V4 Flash 0731nativeopencode · openrouter/deepseek/deepseek-v4-flash-0731
|
Isolated locallocal · local
Hello and complete
not selected
openrouter-model-breadth.openrouter-deepseek-deepseek-v4-flash-0731.local.hello-complete
Matchers and test contextNot selected No matcher result was recorded.
Ask, answer, resume
not selected
openrouter-model-breadth.openrouter-deepseek-deepseek-v4-flash-0731.local.question-resume-complete
Matchers and test contextNot selected No matcher result was recorded. |
#3 Tencent HY 3nativeopencode · openrouter/tencent/hy3
|
Isolated locallocal · local
Hello and complete
not selected
openrouter-model-breadth.openrouter-tencent-hy3.local.hello-complete
Matchers and test contextNot selected No matcher result was recorded.
Ask, answer, resume
not selected
openrouter-model-breadth.openrouter-tencent-hy3.local.question-resume-complete
Matchers and test contextNot selected No matcher result was recorded. |
#4 Nemotron 3 Ultra 550B A55B (free)nativeopencode · openrouter/nvidia/nemotron-3-ultra-550b-a55b:free
|
Isolated locallocal · local
Hello and complete
not selected
openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.hello-complete
Matchers and test contextNot selected No matcher result was recorded.
Ask, answer, resume
not selected
openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.question-resume-complete
Matchers and test contextNot selected No matcher result was recorded.
Plan, approve, complete
not selected
openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.plan-approve-complete
Matchers and test contextNot selected No matcher result was recorded. |
#5 GPT-5.6 Lunanativeopencode · openrouter/openai/gpt-5.6-luna
|
Isolated locallocal · local
Hello and complete
not selected
openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.hello-complete
Matchers and test contextNot selected No matcher result was recorded.
Ask, answer, resume
not selected
openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.question-resume-complete
Matchers and test contextNot selected No matcher result was recorded.
Plan, approve, complete
not selected
openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.plan-approve-complete
Matchers and test contextNot selected No matcher result was recorded. |
Test suite
Three browser-driven turns on one reusable Daytona sandbox for legacy and native Codex.
| Agent profile | Daytona warm reusable sandboxdaytona · remote |
|---|---|
Legacy Codexlegacycodex · gpt-5.6-sol
|
Daytona warm reusable sandboxdaytona · remote
Warm three-turn workspace continuity
not selected
daytona-warm-continuity.legacy-codex.daytona.warm-three-turn
Matchers and test contextNot selected No matcher result was recorded. |
Runner Codexnativecodex · gpt-5.6-sol
|
Daytona warm reusable sandboxdaytona · remote
Warm three-turn workspace continuity
not selected
daytona-warm-continuity.runner-codex.daytona.warm-three-turn
Matchers and test contextNot selected No matcher result was recorded. |
Test suite
Suite discovered from retained campaign identities; full suite size is not known to this publisher.
| Agent profile | Isolated locallocal · local |
|---|---|
Runner Codexnativecodex · gpt-5.6-sol
|
Isolated locallocal · local
active-reassignment
failed
candidate failure Full failure details (1,640 characters)[2mexpect([22m[31mreceived[39m[2m).[22mtoEqual[2m([22m[32mexpected[39m[2m) // deep equality[22m
[32m- Expected - 5[39m
[31m+ Received + 7[39m
[33m@@ -1,9 +1,11 @@[39m
[2m Object {[22m
[32m- "body": "# Launch Checklist (Draft)[39m
[31m+ "body": "# Launch Checklist[39m
[2m Plan reference: `REFERENCE92d42a7a585a41a9856763bda0c82814`[22m
[31m+[39m
[31m+ Chat reference: `CHAT4e166deeb3871`[39m
[2m - [ ] Welcome beginners.[22m
[2m - [ ] Confirm the free meetup is ready for Friday.",[22m
[2m "companyId": "58eccc3e-dbe9-405c-9dc8-6c66e7e11ce1",[22m
[2m "createdAt": "2026-09-21T21:41:37.452Z",[22m
[33m@@ -11,16 +13,16 @@[39m
[2m "createdByUserId": null,[22m
[2m "format": "markdown",[22m
[2m "id": "0768099f-c0d7-43c7-a8d5-32cb4623735b",[22m
[2m "issueId": "74a08d74-24c8-4088-a44c-4efe67ef369d",[22m
[2m "key": "launch-checklist",[22m
[32m- "latestRevisionId": "4eb16cf5-5f21-4b66-bd11-301d5303272a",[39m
[32m- "latestRevisionNumber": 1,[39m
[31m+ "latestRevisionId": "403af94e-c275-454c-bc76-e21e593c2a4b",[39m
[31m+ "latestRevisionNumber": 2,[39m
[2m "lockedAt": null,[22m
[2m "lockedByAgentId": null,[22m
[2m "lockedByUserId": null,[22m
[2m "sourceTrust": null,[22m
[2m "title": "Launch Checklist",[22m
[32m- "updatedAt": "2026-09-21T21:41:37.452Z",[39m
[32m- "updatedByAgentId": "bc5aab60-6a0c-455b-8969-08cfd6d493b7",[39m
[31m+ "updatedAt": "2026-09-21T21:42:23.015Z",[39m
[31m+ "updatedByAgentId": "30f842f7-e1b7-42d8-b3bb-30c3f739ab81",[39m
[2m "updatedByUserId": null,[22m
[2m }[22m Tokens204,246 in · 1,890 out164,835 cached · 2/3 runs covered
LLM spend$0.0000002/3 runs provider-priced
ExecutionLocal · not metered1m 58s agent
agent-chat-qualification.runner-codex.local.active-reassignment
Matchers and test context
No result artifact was uploaded No matcher result was recorded. Usage and billing metadata{
"billing": {
"llm": {
"runCount": 3,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 2,
"inputTokens": 204246,
"outputTokens": 1890,
"cachedInputTokens": 164835,
"totalTokens": 370971,
"reportedCostUsd": 0,
"costStatus": "partial"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 117949,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "eb053874-2298-4d8c-a5de-ffffa814881d",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 91173,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 739,
"sessionReused": false,
"rawInputTokens": 91173,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:b6d778d092672dcd64b3b04d8a59f07c45b75bd759542bf66f78d9a9ca2d2825",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:9e666ca1e8189d2da1ba509081f5013baa6a5f22b8c5f38c96d3aece86139a7c",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 739,
"cachedInputTokens": 71772,
"taskSessionReused": false,
"persistedSessionId": "01a0c5eb-67dd-75c1-9008-8c14702995e7",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 71772,
"sessionRotationReason": null
}
},
{
"runId": "a5f51b01-bbb8-4049-b0c2-b2229c783a52",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 113073,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 1151,
"sessionReused": false,
"rawInputTokens": 113073,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:af5be81cff672e7cfc7a1e5de52a34f91ef2eda762316c516690dbdf08a09392",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:9e666ca1e8189d2da1ba509081f5013baa6a5f22b8c5f38c96d3aece86139a7c",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 1151,
"cachedInputTokens": 93063,
"taskSessionReused": false,
"persistedSessionId": "01a0c5ea-f94c-74b0-9771-cfde72a516d0",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 93063,
"sessionRotationReason": null
}
},
{
"runId": "c95b649e-1a0f-4306-a4ae-526bfdbc01c8",
"usage": null
}
]
}
}
worker-crash-retry
failed
cleanup failure Stopped waiting for chat turn settles to waiting: run 2083ebfa-16a4-4e85-bbe3-c4671b44380c failed (native_session_cleanup_quarantined): native_session_cleanup_quarantined: prior session cleanup requires operator recovery; verify its retained process ownership and checkpoint before a controlled restart. Clearing a task session does not resolve this quarantine.
Tokens0 in · 0 out0 cached · 0/2 runs covered
LLM spendunavailable0/2 runs provider-priced
ExecutionLocal · not metered59s agent
agent-chat-qualification.runner-codex.local.worker-crash-retry
Matchers and test context
No result artifact was uploaded No matcher result was recorded. Usage and billing metadata{
"billing": {
"llm": {
"runCount": 2,
"runsWithTokenUsage": 0,
"runsWithReportedCost": 0,
"inputTokens": 0,
"outputTokens": 0,
"cachedInputTokens": 0,
"totalTokens": 0,
"reportedCostUsd": 0,
"costStatus": "unavailable"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 59432,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "2083ebfa-16a4-4e85-bbe3-c4671b44380c",
"usage": null
},
{
"runId": "3d6b12b6-3096-4f76-b779-bb3359f6cbe8",
"usage": null
}
]
}
} |
Runner ACPX Claudenativeacpx · claude-sonnet-5
|
Isolated locallocal · local
active-reassignment
failed
candidate failure Full failure details (2,026 characters)[2mexpect([22m[31mreceived[39m[2m).[22mtoEqual[2m([22m[32mexpected[39m[2m) // deep equality[22m
[32m- Expected - 7[39m
[31m+ Received + 8[39m
[2m Object {[22m
[32m- "body": "## Launch Checklist (Draft)[39m
[31m+ "body": "## Launch Checklist[39m
[32m- Reference: REFERENCEf6c6ca2e5cae4e949534a2bb23f298ca[39m
[31m+ Plan reference: REFERENCEf6c6ca2e5cae4e949534a2bb23f298ca (plan document 831ec831-0182-4eb1-9e75-b50af5a8fe83)[39m
[31m+ Source chat: CHAT908cb04766e41[39m
[2m - [ ] Confirm Friday meetup date/time and venue[22m
[2m - [ ] Confirm event is free and open to beginners[22m
[2m - [ ] Post announcement / invite[22m
[2m - [ ] Prepare beginner-friendly materials[22m
[2m - [ ] On-site/online logistics check[22m
[32m- _Draft — pending final brief._",[39m
[31m+ _Finalized from draft — ready for launch._",[39m
[2m "companyId": "c766b972-e285-4291-97e2-19e39b7c4ba3",[22m
[2m "createdAt": "2026-09-21T21:42:00.169Z",[22m
[2m "createdByAgentId": "001aeab6-c8be-41b0-ba27-2bf4368c0e34",[22m
[2m "createdByUserId": null,[22m
[2m "format": "markdown",[22m
[2m "id": "005b331e-f1a9-4d91-8672-1237842a9da1",[22m
[2m "issueId": "873e1ed7-5517-4491-aeaa-0820adab6b69",[22m
[2m "key": "launch-checklist",[22m
[32m- "latestRevisionId": "fa51e517-cd3a-46aa-88b6-1492340bdd7f",[39m
[32m- "latestRevisionNumber": 1,[39m
[31m+ "latestRevisionId": "72f58605-125c-4bd4-84d2-068115b21935",[39m
[31m+ "latestRevisionNumber": 2,[39m
[2m "lockedAt": null,[22m
[2m "lockedByAgentId": null,[22m
[2m "lockedByUserId": null,[22m
[2m "sourceTrust": null,[22m
[2m "title": "Launch Checklist",[22m
[32m- "updatedAt": "2026-09-21T21:42:00.169Z",[39m
[32m- "updatedByAgentId": "001aeab6-c8be-41b0-ba27-2bf4368c0e34",[39m
[31m+ "updatedAt": "2026-09-21T21:43:12.401Z",[39m
[31m+ "updatedByAgentId": "3bc13f0a-7a5f-42dd-8967-6320a90d2f69",[39m
[2m "updatedByUserId": null,[22m
[2m }[22m Tokens24 in · 7,512 out418,253 cached · 2/3 runs covered
LLM spend$0.0000002/3 runs provider-priced
ExecutionLocal · not metered2m 55s agent
agent-chat-qualification.runner-acpx-claude.local.active-reassignment
Matchers and test context
No result artifact was uploaded No matcher result was recorded. Usage and billing metadata{
"billing": {
"llm": {
"runCount": 3,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 2,
"inputTokens": 24,
"outputTokens": 7512,
"cachedInputTokens": 418253,
"totalTokens": 425789,
"reportedCostUsd": 0,
"costStatus": "partial"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 174641,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "8df282d9-22b8-4336-840b-6b90272a15cd",
"usage": {
"model": "claude-sonnet-5",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 10,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 3618,
"sessionReused": false,
"rawInputTokens": 10,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:590c27ac3df4eb02dff4977ee74fcced784dea5c63872e05577cf8888d58268d",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:aac5030e1aada8a33e342c92573906ddb442e0a3f212f59359f24d955a5c081b",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 3618,
"cachedInputTokens": 172099,
"taskSessionReused": false,
"persistedSessionId": "b988aad6-6e2a-4baa-9edc-45236f17e01d",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 172099,
"sessionRotationReason": null
}
},
{
"runId": "8e7d9e08-7615-4cad-98c7-a303d71da897",
"usage": {
"model": "claude-sonnet-5",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 14,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 3894,
"sessionReused": false,
"rawInputTokens": 14,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:3ebea7594beaeb43f4e24b370e3f2419cd39dece06b87202993e01594306987b",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:aac5030e1aada8a33e342c92573906ddb442e0a3f212f59359f24d955a5c081b",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 3894,
"cachedInputTokens": 246154,
"taskSessionReused": false,
"persistedSessionId": "408757b4-763a-42bb-8982-bd6a78f98a63",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 246154,
"sessionRotationReason": null
}
},
{
"runId": "ce0aa5a7-7298-45d6-bf42-ef469c91f295",
"usage": null
}
]
}
}
worker-crash-retry
failed
cleanup failure Stopped waiting for chat turn settles to waiting: run 4546b237-fcb8-4dbe-89ea-f0fd04f06918 failed (native_session_cleanup_quarantined): native_session_cleanup_quarantined: prior session cleanup requires operator recovery; verify its retained process ownership and checkpoint before a controlled restart. Clearing a task session does not resolve this quarantine.
Tokens0 in · 0 out0 cached · 0/2 runs covered
LLM spendunavailable0/2 runs provider-priced
ExecutionLocal · not metered1m 10s agent
agent-chat-qualification.runner-acpx-claude.local.worker-crash-retry
Matchers and test context
No result artifact was uploaded No matcher result was recorded. Usage and billing metadata{
"billing": {
"llm": {
"runCount": 2,
"runsWithTokenUsage": 0,
"runsWithReportedCost": 0,
"inputTokens": 0,
"outputTokens": 0,
"cachedInputTokens": 0,
"totalTokens": 0,
"reportedCostUsd": 0,
"costStatus": "unavailable"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 69815,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "4546b237-fcb8-4dbe-89ea-f0fd04f06918",
"usage": null
},
{
"runId": "99e6be33-dc5a-4cf1-bb67-a19e85265066",
"usage": null
}
]
}
} |
History
No historical campaigns have been published yet.