Runner Full-Stack E2E

Test suite

Task continuation

Human direction, approval boundaries, untrusted evidence, and completed actions across turns.

Configuration matrix4 profiles · 1 environments · 0 selected

Agent profile	Isolated locallocal · local
Legacy Codexlegacycodex · gpt-5.6-sol	Isolated locallocal · local answer updates scope not selected `continuation.legacy-codex.local.answer-updates-scope` Matchers and test context Not selected No matcher result was recorded. clarification not approval not selected `continuation.legacy-codex.local.clarification-not-approval` Matchers and test context Not selected No matcher result was recorded. revision preserves approval not selected `continuation.legacy-codex.local.revision-preserves-approval` Matchers and test context Not selected No matcher result was recorded. untrusted evidence not selected `continuation.legacy-codex.local.untrusted-evidence` Matchers and test context Not selected No matcher result was recorded. completed action resume not selected `continuation.legacy-codex.local.completed-action-resume` Matchers and test context Not selected No matcher result was recorded.
Legacy Claudelegacyclaude · claude-sonnet-4-6	Isolated locallocal · local answer updates scope not selected `continuation.legacy-claude.local.answer-updates-scope` Matchers and test context Not selected No matcher result was recorded. clarification not approval not selected `continuation.legacy-claude.local.clarification-not-approval` Matchers and test context Not selected No matcher result was recorded. revision preserves approval not selected `continuation.legacy-claude.local.revision-preserves-approval` Matchers and test context Not selected No matcher result was recorded. untrusted evidence not selected `continuation.legacy-claude.local.untrusted-evidence` Matchers and test context Not selected No matcher result was recorded. completed action resume not selected `continuation.legacy-claude.local.completed-action-resume` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local answer updates scope not selected `continuation.runner-codex.local.answer-updates-scope` Matchers and test context Not selected No matcher result was recorded. clarification not approval not selected `continuation.runner-codex.local.clarification-not-approval` Matchers and test context Not selected No matcher result was recorded. revision preserves approval not selected `continuation.runner-codex.local.revision-preserves-approval` Matchers and test context Not selected No matcher result was recorded. untrusted evidence not selected `continuation.runner-codex.local.untrusted-evidence` Matchers and test context Not selected No matcher result was recorded. completed action resume not selected `continuation.runner-codex.local.completed-action-resume` Matchers and test context Not selected No matcher result was recorded. question tool documentation not selected `continuation.runner-codex.local.question-tool-documentation` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local answer updates scope not selected `continuation.runner-acpx-claude.local.answer-updates-scope` Matchers and test context Not selected No matcher result was recorded. clarification not approval not selected `continuation.runner-acpx-claude.local.clarification-not-approval` Matchers and test context Not selected No matcher result was recorded. revision preserves approval not selected `continuation.runner-acpx-claude.local.revision-preserves-approval` Matchers and test context Not selected No matcher result was recorded. untrusted evidence not selected `continuation.runner-acpx-claude.local.untrusted-evidence` Matchers and test context Not selected No matcher result was recorded. completed action resume not selected `continuation.runner-acpx-claude.local.completed-action-resume` Matchers and test context Not selected No matcher result was recorded. question tool documentation not selected `continuation.runner-acpx-claude.local.question-tool-documentation` Matchers and test context Not selected No matcher result was recorded. provider question bridge not selected `continuation.runner-acpx-claude.local.provider-question-bridge` Matchers and test context Not selected No matcher result was recorded.

Test suite

Everyday Paperclip Work

Real user requests, useful downloaded work, and durable continuation using production instructions.

Configuration matrix3 profiles · 2 environments · 0 selected

Agent profile	Isolated locallocal · local	Daytona warm reusable sandboxdaytona · remote
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Build, download, and revise a project not selected `everyday-workflows.runner-codex.local.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-codex.local.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Delegate work through an agent review handoff not selected `everyday-workflows.runner-codex.local.agent-review-handoff` Matchers and test context Not selected No matcher result was recorded. Hire one teammate, then reuse that agent not selected `everyday-workflows.runner-codex.local.hire-reuse` Matchers and test context Not selected No matcher result was recorded. Use a connection after approval not selected `everyday-workflows.runner-codex.local.service-approve` Matchers and test context Not selected No matcher result was recorded. Respect a declined tool action not selected `everyday-workflows.runner-codex.local.service-decline` Matchers and test context Not selected No matcher result was recorded. Respect Not now on a new connection not selected `everyday-workflows.runner-codex.local.connection-decline` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-codex.local.recover-controller` Matchers and test context Not selected No matcher result was recorded. Stop a task and send a new direction once not selected `everyday-workflows.runner-codex.local.stop-redirect` Matchers and test context Not selected No matcher result was recorded. Create and edit a company skill not selected `everyday-workflows.runner-codex.local.create-skill-studio` Matchers and test context Not selected No matcher result was recorded.	Daytona warm reusable sandboxdaytona · remote Build, download, and revise a project not selected `everyday-workflows.runner-codex.daytona.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-codex.daytona.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-codex.daytona.recover-controller` Matchers and test context Not selected No matcher result was recorded. Create and edit a company skill not selected `everyday-workflows.runner-codex.daytona.create-skill-studio` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Build, download, and revise a project not selected `everyday-workflows.runner-acpx-claude.local.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-acpx-claude.local.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Delegate work through an agent review handoff not selected `everyday-workflows.runner-acpx-claude.local.agent-review-handoff` Matchers and test context Not selected No matcher result was recorded. Hire one teammate, then reuse that agent not selected `everyday-workflows.runner-acpx-claude.local.hire-reuse` Matchers and test context Not selected No matcher result was recorded. Use a connection after approval not selected `everyday-workflows.runner-acpx-claude.local.service-approve` Matchers and test context Not selected No matcher result was recorded. Respect a declined tool action not selected `everyday-workflows.runner-acpx-claude.local.service-decline` Matchers and test context Not selected No matcher result was recorded. Respect Not now on a new connection not selected `everyday-workflows.runner-acpx-claude.local.connection-decline` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-acpx-claude.local.recover-controller` Matchers and test context Not selected No matcher result was recorded. Stop a task and send a new direction once not selected `everyday-workflows.runner-acpx-claude.local.stop-redirect` Matchers and test context Not selected No matcher result was recorded. Create and edit a company skill not selected `everyday-workflows.runner-acpx-claude.local.create-skill-studio` Matchers and test context Not selected No matcher result was recorded.	Daytona warm reusable sandboxdaytona · remote Build, download, and revise a project not selected `everyday-workflows.runner-acpx-claude.daytona.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-acpx-claude.daytona.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-acpx-claude.daytona.recover-controller` Matchers and test context Not selected No matcher result was recorded. Create and edit a company skill not selected `everyday-workflows.runner-acpx-claude.daytona.create-skill-studio` Matchers and test context Not selected No matcher result was recorded.
Runner Codex Mininativecodex · gpt-5.4-mini	Isolated locallocal · local Build, download, and revise a project not selected `everyday-workflows.runner-codex-mini.local.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-codex-mini.local.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Delegate work through an agent review handoff not selected `everyday-workflows.runner-codex-mini.local.agent-review-handoff` Matchers and test context Not selected No matcher result was recorded. Hire one teammate, then reuse that agent not selected `everyday-workflows.runner-codex-mini.local.hire-reuse` Matchers and test context Not selected No matcher result was recorded. Use a connection after approval not selected `everyday-workflows.runner-codex-mini.local.service-approve` Matchers and test context Not selected No matcher result was recorded. Respect a declined tool action not selected `everyday-workflows.runner-codex-mini.local.service-decline` Matchers and test context Not selected No matcher result was recorded. Respect Not now on a new connection not selected `everyday-workflows.runner-codex-mini.local.connection-decline` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-codex-mini.local.recover-controller` Matchers and test context Not selected No matcher result was recorded. Stop a task and send a new direction once not selected `everyday-workflows.runner-codex-mini.local.stop-redirect` Matchers and test context Not selected No matcher result was recorded. Create and edit a company skill not selected `everyday-workflows.runner-codex-mini.local.create-skill-studio` Matchers and test context Not selected No matcher result was recorded.	Daytona warm reusable sandboxdaytona · remote

Test suite

First-task onboarding

Production onboarding, first replies, approval, and durable task execution.

Configuration matrix4 profiles · 1 environments · 0 selected

Agent profile	Isolated locallocal · local
Legacy Codexlegacycodex · Production onboarding default	Isolated locallocal · local Interview: first response not selected `first-task.legacy-codex.local.interview-first-response` Matchers and test context Not selected No matcher result was recorded. Clear task: first response not selected `first-task.legacy-codex.local.clear-task-first-response` Matchers and test context Not selected No matcher result was recorded. Ambiguous task: first response not selected `first-task.legacy-codex.local.ambiguous-task-first-response` Matchers and test context Not selected No matcher result was recorded. Opening card replaced by a message not selected `first-task.legacy-codex.local.plain-message-first-response` Matchers and test context Not selected No matcher result was recorded. Explicit plan: first response not selected `first-task.legacy-codex.local.plan-first-response` Matchers and test context Not selected No matcher result was recorded. Other tasks do not inherit onboarding policy not selected `first-task.legacy-codex.local.ordinary-task-control` Matchers and test context Not selected No matcher result was recorded. Interview, plan, and acceptance not selected `first-task.legacy-codex.local.interview-plan-accept` Matchers and test context Not selected No matcher result was recorded. Subtask accepted through a card not selected `first-task.legacy-codex.local.task-card-accept` Matchers and test context Not selected No matcher result was recorded. Accept a proposal while its agent is still running not selected `first-task.legacy-codex.local.accept-while-running` Matchers and test context Not selected No matcher result was recorded. Subtask accepted in conversation not selected `first-task.legacy-codex.local.task-reply-accept` Matchers and test context Not selected No matcher result was recorded. Clarification, proposal, and acceptance not selected `first-task.legacy-codex.local.clarify-propose-accept` Matchers and test context Not selected No matcher result was recorded. Revise scope before accepting not selected `first-task.legacy-codex.local.revise-accept` Matchers and test context Not selected No matcher result was recorded. Decline proposed work not selected `first-task.legacy-codex.local.reject-no-execution` Matchers and test context Not selected No matcher result was recorded.
Legacy Claudelegacyclaude · Production onboarding default	Isolated locallocal · local Interview: first response not selected `first-task.legacy-claude.local.interview-first-response` Matchers and test context Not selected No matcher result was recorded. Clear task: first response not selected `first-task.legacy-claude.local.clear-task-first-response` Matchers and test context Not selected No matcher result was recorded. Ambiguous task: first response not selected `first-task.legacy-claude.local.ambiguous-task-first-response` Matchers and test context Not selected No matcher result was recorded. Opening card replaced by a message not selected `first-task.legacy-claude.local.plain-message-first-response` Matchers and test context Not selected No matcher result was recorded. Explicit plan: first response not selected `first-task.legacy-claude.local.plan-first-response` Matchers and test context Not selected No matcher result was recorded. Other tasks do not inherit onboarding policy not selected `first-task.legacy-claude.local.ordinary-task-control` Matchers and test context Not selected No matcher result was recorded. Interview, plan, and acceptance not selected `first-task.legacy-claude.local.interview-plan-accept` Matchers and test context Not selected No matcher result was recorded. Subtask accepted through a card not selected `first-task.legacy-claude.local.task-card-accept` Matchers and test context Not selected No matcher result was recorded. Accept a proposal while its agent is still running not selected `first-task.legacy-claude.local.accept-while-running` Matchers and test context Not selected No matcher result was recorded. Subtask accepted in conversation not selected `first-task.legacy-claude.local.task-reply-accept` Matchers and test context Not selected No matcher result was recorded. Clarification, proposal, and acceptance not selected `first-task.legacy-claude.local.clarify-propose-accept` Matchers and test context Not selected No matcher result was recorded. Revise scope before accepting not selected `first-task.legacy-claude.local.revise-accept` Matchers and test context Not selected No matcher result was recorded. Decline proposed work not selected `first-task.legacy-claude.local.reject-no-execution` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · Production onboarding default	Isolated locallocal · local Interview: first response not selected `first-task.runner-codex.local.interview-first-response` Matchers and test context Not selected No matcher result was recorded. Clear task: first response not selected `first-task.runner-codex.local.clear-task-first-response` Matchers and test context Not selected No matcher result was recorded. Ambiguous task: first response not selected `first-task.runner-codex.local.ambiguous-task-first-response` Matchers and test context Not selected No matcher result was recorded. Opening card replaced by a message not selected `first-task.runner-codex.local.plain-message-first-response` Matchers and test context Not selected No matcher result was recorded. Explicit plan: first response not selected `first-task.runner-codex.local.plan-first-response` Matchers and test context Not selected No matcher result was recorded. Other tasks do not inherit onboarding policy not selected `first-task.runner-codex.local.ordinary-task-control` Matchers and test context Not selected No matcher result was recorded. Interview, plan, and acceptance not selected `first-task.runner-codex.local.interview-plan-accept` Matchers and test context Not selected No matcher result was recorded. Subtask accepted through a card not selected `first-task.runner-codex.local.task-card-accept` Matchers and test context Not selected No matcher result was recorded. Accept a proposal while its agent is still running not selected `first-task.runner-codex.local.accept-while-running` Matchers and test context Not selected No matcher result was recorded. Subtask accepted in conversation not selected `first-task.runner-codex.local.task-reply-accept` Matchers and test context Not selected No matcher result was recorded. Clarification, proposal, and acceptance not selected `first-task.runner-codex.local.clarify-propose-accept` Matchers and test context Not selected No matcher result was recorded. Revise scope before accepting not selected `first-task.runner-codex.local.revise-accept` Matchers and test context Not selected No matcher result was recorded. Decline proposed work not selected `first-task.runner-codex.local.reject-no-execution` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · Production onboarding default	Isolated locallocal · local Interview: first response not selected `first-task.runner-acpx-claude.local.interview-first-response` Matchers and test context Not selected No matcher result was recorded. Clear task: first response not selected `first-task.runner-acpx-claude.local.clear-task-first-response` Matchers and test context Not selected No matcher result was recorded. Ambiguous task: first response not selected `first-task.runner-acpx-claude.local.ambiguous-task-first-response` Matchers and test context Not selected No matcher result was recorded. Opening card replaced by a message not selected `first-task.runner-acpx-claude.local.plain-message-first-response` Matchers and test context Not selected No matcher result was recorded. Explicit plan: first response not selected `first-task.runner-acpx-claude.local.plan-first-response` Matchers and test context Not selected No matcher result was recorded. Other tasks do not inherit onboarding policy not selected `first-task.runner-acpx-claude.local.ordinary-task-control` Matchers and test context Not selected No matcher result was recorded. Interview, plan, and acceptance not selected `first-task.runner-acpx-claude.local.interview-plan-accept` Matchers and test context Not selected No matcher result was recorded. Subtask accepted through a card not selected `first-task.runner-acpx-claude.local.task-card-accept` Matchers and test context Not selected No matcher result was recorded. Accept a proposal while its agent is still running not selected `first-task.runner-acpx-claude.local.accept-while-running` Matchers and test context Not selected No matcher result was recorded. Subtask accepted in conversation not selected `first-task.runner-acpx-claude.local.task-reply-accept` Matchers and test context Not selected No matcher result was recorded. Clarification, proposal, and acceptance not selected `first-task.runner-acpx-claude.local.clarify-propose-accept` Matchers and test context Not selected No matcher result was recorded. Revise scope before accepting not selected `first-task.runner-acpx-claude.local.revise-accept` Matchers and test context Not selected No matcher result was recorded. Decline proposed work not selected `first-task.runner-acpx-claude.local.reject-no-execution` Matchers and test context Not selected No matcher result was recorded.

Test suite

Persistent Agent Chat

Task-backed conversations, session resets, and project plan handoff.

Configuration matrix4 profiles · 1 environments · 0 selected

Agent profile	Isolated locallocal · local
Legacy Codexlegacycodex · gpt-5.6-sol	Isolated locallocal · local Conversation continuity across restart not selected `agent-chat.legacy-codex.local.continuity-restart` Matchers and test context Not selected No matcher result was recorded. Fresh context within preserved history not selected `agent-chat.legacy-codex.local.new-session` Matchers and test context Not selected No matcher result was recorded. Stop, reset, and resume not selected `agent-chat.legacy-codex.local.stop-new-resume` Matchers and test context Not selected No matcher result was recorded. Draft, revise, approve, and hand off a plan not selected `agent-chat.legacy-codex.local.plan-handoff` Matchers and test context Not selected No matcher result was recorded. Clarify and reuse an existing project not selected `agent-chat.legacy-codex.local.clarify-reuse` Matchers and test context Not selected No matcher result was recorded. Create a project with multiple repository URLs not selected `agent-chat.legacy-codex.local.multi-repository` Matchers and test context Not selected No matcher result was recorded.
Legacy Claudelegacyclaude · claude-sonnet-4-6	Isolated locallocal · local Conversation continuity across restart not selected `agent-chat.legacy-claude.local.continuity-restart` Matchers and test context Not selected No matcher result was recorded. Fresh context within preserved history not selected `agent-chat.legacy-claude.local.new-session` Matchers and test context Not selected No matcher result was recorded. Stop, reset, and resume not selected `agent-chat.legacy-claude.local.stop-new-resume` Matchers and test context Not selected No matcher result was recorded. Draft, revise, approve, and hand off a plan not selected `agent-chat.legacy-claude.local.plan-handoff` Matchers and test context Not selected No matcher result was recorded. Clarify and reuse an existing project not selected `agent-chat.legacy-claude.local.clarify-reuse` Matchers and test context Not selected No matcher result was recorded. Create a project with multiple repository URLs not selected `agent-chat.legacy-claude.local.multi-repository` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Save a planned task without starting work not selected `agent-chat.runner-codex.local.create-backlog` Matchers and test context Not selected No matcher result was recorded. Reassign existing work and preserve queued context not selected `agent-chat.runner-codex.local.reassign-task` Matchers and test context Not selected No matcher result was recorded. Conversation continuity across restart not selected `agent-chat.runner-codex.local.continuity-restart` Matchers and test context Not selected No matcher result was recorded. Fresh context within preserved history not selected `agent-chat.runner-codex.local.new-session` Matchers and test context Not selected No matcher result was recorded. Stop, reset, and resume not selected `agent-chat.runner-codex.local.stop-new-resume` Matchers and test context Not selected No matcher result was recorded. Draft, revise, approve, and hand off a plan not selected `agent-chat.runner-codex.local.plan-handoff` Matchers and test context Not selected No matcher result was recorded. Clarify and reuse an existing project not selected `agent-chat.runner-codex.local.clarify-reuse` Matchers and test context Not selected No matcher result was recorded. Create a project with multiple repository URLs not selected `agent-chat.runner-codex.local.multi-repository` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Save a planned task without starting work not selected `agent-chat.runner-acpx-claude.local.create-backlog` Matchers and test context Not selected No matcher result was recorded. Reassign existing work and preserve queued context not selected `agent-chat.runner-acpx-claude.local.reassign-task` Matchers and test context Not selected No matcher result was recorded. Conversation continuity across restart not selected `agent-chat.runner-acpx-claude.local.continuity-restart` Matchers and test context Not selected No matcher result was recorded. Fresh context within preserved history not selected `agent-chat.runner-acpx-claude.local.new-session` Matchers and test context Not selected No matcher result was recorded. Stop, reset, and resume not selected `agent-chat.runner-acpx-claude.local.stop-new-resume` Matchers and test context Not selected No matcher result was recorded. Draft, revise, approve, and hand off a plan not selected `agent-chat.runner-acpx-claude.local.plan-handoff` Matchers and test context Not selected No matcher result was recorded. Clarify and reuse an existing project not selected `agent-chat.runner-acpx-claude.local.clarify-reuse` Matchers and test context Not selected No matcher result was recorded. Create a project with multiple repository URLs not selected `agent-chat.runner-acpx-claude.local.multi-repository` Matchers and test context Not selected No matcher result was recorded.

Test suite

Core Runner Compatibility

Major provider, runtime generation, and execution-environment compatibility.

Configuration matrix7 profiles · 2 environments · 0 selected

Agent profile	Isolated locallocal · local	Daytona sandboxdaytona · remote
Legacy Codexlegacycodex · gpt-5.6-sol	Isolated locallocal · local Basic response not selected `core-compatibility.legacy-codex.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-codex.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-codex.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.legacy-codex.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-codex.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-codex.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Legacy Claudelegacyclaude · claude-sonnet-4-6	Isolated locallocal · local Basic response not selected `core-compatibility.legacy-claude.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-claude.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-claude.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.legacy-claude.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-claude.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-claude.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Legacy OpenCodelegacyopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Basic response not selected `core-compatibility.legacy-opencode.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-opencode.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-opencode.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.legacy-opencode.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-opencode.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-opencode.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Basic response not selected `core-compatibility.runner-codex.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-codex.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-codex.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.runner-codex.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-codex.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-codex.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Runner OpenCodenativeopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Basic response not selected `core-compatibility.runner-opencode.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-opencode.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-opencode.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.runner-opencode.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-opencode.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-opencode.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Basic response not selected `core-compatibility.runner-acpx-claude.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-acpx-claude.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-acpx-claude.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.runner-acpx-claude.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-acpx-claude.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-acpx-claude.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Codexnativeacpx · gpt-5.6-sol	Isolated locallocal · local Basic response not selected `core-compatibility.runner-acpx-codex.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-acpx-codex.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-acpx-codex.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.runner-acpx-codex.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-acpx-codex.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-acpx-codex.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.

Test suite

Local Session Integrity

Structured interaction and continuation qualification for every supported local profile.

Configuration matrix7 profiles · 1 environments · 0 selected

Agent profile	Isolated locallocal · local
Legacy Codexlegacycodex · gpt-5.6-sol	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.legacy-codex.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.legacy-codex.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Legacy Claudelegacyclaude · claude-sonnet-4-6	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.legacy-claude.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.legacy-claude.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Legacy OpenCodelegacyopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.legacy-opencode.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.legacy-opencode.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.runner-codex.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.runner-codex.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Runner OpenCodenativeopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.runner-opencode.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.runner-opencode.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.runner-acpx-claude.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.runner-acpx-claude.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Codexnativeacpx · gpt-5.6-sol	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.runner-acpx-codex.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.runner-acpx-codex.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.

Test suite

OpenRouter Model Breadth

Weekly-ranked tool-capable OpenRouter models through native OpenCode on isolated local workspaces.

Configuration matrix4 profiles · 1 environments · 0 selected

Agent profile	Isolated locallocal · local
#1 DeepSeek V4 Flash 0731nativeopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-deepseek-deepseek-v4-flash-0731.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-deepseek-deepseek-v4-flash-0731.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded.
#3 Tencent HY 3nativeopencode · openrouter/tencent/hy3	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-tencent-hy3.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-tencent-hy3.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded.
#4 Nemotron 3 Ultra 550B A55B (free)nativeopencode · openrouter/nvidia/nemotron-3-ultra-550b-a55b:free	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded. Plan, approve, complete not selected `openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.plan-approve-complete` Matchers and test context Not selected No matcher result was recorded.
#5 GPT-5.6 Lunanativeopencode · openrouter/openai/gpt-5.6-luna	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded. Plan, approve, complete not selected `openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.plan-approve-complete` Matchers and test context Not selected No matcher result was recorded.

Test suite

Daytona Warm Continuity

Three browser-driven turns on one reusable Daytona sandbox for legacy and native Codex.

Configuration matrix2 profiles · 1 environments · 0 selected

Agent profile	Daytona warm reusable sandboxdaytona · remote
Legacy Codexlegacycodex · gpt-5.6-sol	Daytona warm reusable sandboxdaytona · remote Warm three-turn workspace continuity not selected `daytona-warm-continuity.legacy-codex.daytona.warm-three-turn` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Daytona warm reusable sandboxdaytona · remote Warm three-turn workspace continuity not selected `daytona-warm-continuity.runner-codex.daytona.warm-three-turn` Matchers and test context Not selected No matcher result was recorded.

Test suite

agent-chat-hardening

Suite discovered from retained campaign identities; full suite size is not known to this publisher.

Pass rate75.0%3/4 passed

Tokens1,505,693383,638 input · 10,658 output

Cost$0.0257reported LLM + runtime estimate

Agent time8m 30s5m 47s lease

Execution4/40 retries · cleanup passed

Configuration matrix2 profiles · 2 environments · 4 selected

Agent profile Isolated locallocal · local Daytona warm reusable sandboxdaytona · remote

Runner Codexnativecodex · gpt-5.6-sol

Isolated locallocal · local

hire-delegate-reuse failed

Overall failed · No behavioral checks recorded

candidate failure

Execution task 60733d18-746e-4e9e-a593-34528e743398 has no non-plan output document containing CHATfd041d7f6a411; document keys: launch-checklist, plan

Tokens383,592 in · 4,147 out334,548 cached · 2/2 runs covered

LLM spend$0.0000002/2 runs provider-priced

ExecutionLocal · not metered3m 16s agent

agent-chat-hardening.runner-codex.local.hire-delegate-reuse

Matchers and test context

Attempt: 1
Duration: 2m 49s
Agent runtime: 3m 16s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: RUN-1

No result artifact was uploaded

No matcher result was recorded.

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 383592,
      "outputTokens": 4147,
      "cachedInputTokens": 334548,
      "totalTokens": 722287,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 196253,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "0ed21ade-d3bd-4e89-ab73-d57632ee560e",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 71779,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 812,
          "sessionReused": false,
          "rawInputTokens": 71779,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:250e2b4c6a0774fa69a0c8554df6f103c600fe7ea8710e33d9c9758d728bfb16",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:d5ab9d4f87caece467f6b2fda9976f2e41b2ff5191389bd74df00717460cc328",
              "workspaceReused": false,
              "activeWorkspaceId": "fabba8ef-996c-437e-bcfe-cb4395dcc8f8",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 812,
          "cachedInputTokens": 52978,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c494-1ac1-7e92-8ad3-4210e0448990",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 52978,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "7ddbedea-5951-47b7-855b-77bc9797b911",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 311813,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 3335,
          "sessionReused": false,
          "rawInputTokens": 311813,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:108d44de74f3b7d35bbd680f1818623baa1b512bed537c628d869b50d94dbaba",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:7681a86b45b83d2ccdb7a013588c1146b9629814f756ee58c8d909b8dba2b5b1",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 3335,
          "cachedInputTokens": 281570,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c492-5b64-78f2-bc61-cc0e520f8a83",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 281570,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Daytona warm reusable sandboxdaytona · remote

Runner ACPX Claudenativeacpx · claude-sonnet-5

Isolated locallocal · local

Daytona warm reusable sandboxdaytona · remote

committed-send-retry passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens20 in · 3,808 out362,182 cached · 2/2 runs covered

LLM spend$0.0000002/2 runs provider-priced

Execution$0.009493 est.1m 49s agent · 2m 8s lease

agent-chat-hardening.runner-acpx-claude.daytona.committed-send-retry

Matchers and test context

Attempt: 1
Duration: 2m 42s
Agent runtime: 1m 49s
Environment lease: 2m 8s
Runtime: native
Provider: acpx
Model: claude-sonnet-5
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 20,
      "outputTokens": 3808,
      "cachedInputTokens": 362182,
      "totalTokens": 366010,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "daytona",
      "agentRunDurationMs": 109087,
      "leaseDurationMs": 127766,
      "leaseCount": 2,
      "cpuCores": 4,
      "memoryGiB": 4,
      "diskGiB": 10,
      "estimatedListCostUsd": 0.009493013799999998,
      "costStatus": "estimated",
      "costSource": "daytona_public_list_price",
      "pricingAsOf": "2026-08-27",
      "pricingUrl": "https://www.daytona.io/pricing"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0.009493013799999998,
    "observedAndEstimatedCostUsd": 0.009493013799999998,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "dc52e8b9-fd76-4557-95e3-ba2d2394568b",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 8,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 989,
          "sessionReused": true,
          "rawInputTokens": 8,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:84c998cfd13e4d4e419aa01020218b0c642fae8dc41379f56c9ebb1a5800acb6",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:a78dbe198c6e262225a835d16bc6fb3292971063ee711d95c1d37ea08a8f7660",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 989,
          "cachedInputTokens": 163537,
          "taskSessionReused": true,
          "persistedSessionId": "884e14ef-8141-4401-be7b-40a58d8055a3",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 163537,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "7dbc6c79-8e93-4127-a718-0d4e1eb42d72",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 12,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 2819,
          "sessionReused": false,
          "rawInputTokens": 12,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:84c998cfd13e4d4e419aa01020218b0c642fae8dc41379f56c9ebb1a5800acb6",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:a78dbe198c6e262225a835d16bc6fb3292971063ee711d95c1d37ea08a8f7660",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 2819,
          "cachedInputTokens": 198645,
          "taskSessionReused": false,
          "persistedSessionId": "884e14ef-8141-4401-be7b-40a58d8055a3",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 198645,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

continuity-restart passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens14 in · 1,225 out234,525 cached · 3/3 runs covered

LLM spend$0.0000003/3 runs provider-priced

Execution$0.008738 est.1m 40s agent · 1m 58s lease

agent-chat-hardening.runner-acpx-claude.daytona.continuity-restart

Matchers and test context

Attempt: 1
Duration: 2m 40s
Agent runtime: 1m 40s
Environment lease: 1m 58s
Runtime: native
Provider: acpx
Model: claude-sonnet-5
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 3,
      "runsWithReportedCost": 3,
      "inputTokens": 14,
      "outputTokens": 1225,
      "cachedInputTokens": 234525,
      "totalTokens": 235764,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "daytona",
      "agentRunDurationMs": 100411,
      "leaseDurationMs": 117610,
      "leaseCount": 3,
      "cpuCores": 4,
      "memoryGiB": 4,
      "diskGiB": 10,
      "estimatedListCostUsd": 0.008738423,
      "costStatus": "estimated",
      "costSource": "daytona_public_list_price",
      "pricingAsOf": "2026-08-27",
      "pricingUrl": "https://www.daytona.io/pricing"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0.008738423,
    "observedAndEstimatedCostUsd": 0.008738423,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "c007e132-40c1-4e5c-a99c-ecdbcc179591",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 4,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 357,
          "sessionReused": true,
          "rawInputTokens": 4,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:08ab3628cf9d20d28aa892826ba1e4dc0e150cc0f55148711411a2fbf69ad668",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:1704e9853ac171d485444bad96c5b6c31478f3c5dae95dfa1a4f7a4fb322e4f9",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 357,
          "cachedInputTokens": 84619,
          "taskSessionReused": true,
          "persistedSessionId": "2dbd1b02-0d00-4c2f-aa3e-dc8009c44b41",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 84619,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "c8a95611-a027-4af9-8427-d4984d9de2ca",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 4,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 333,
          "sessionReused": true,
          "rawInputTokens": 4,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:08ab3628cf9d20d28aa892826ba1e4dc0e150cc0f55148711411a2fbf69ad668",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:1704e9853ac171d485444bad96c5b6c31478f3c5dae95dfa1a4f7a4fb322e4f9",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 333,
          "cachedInputTokens": 59929,
          "taskSessionReused": true,
          "persistedSessionId": "2dbd1b02-0d00-4c2f-aa3e-dc8009c44b41",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 59929,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "2fd1cd4a-da91-4e37-a8c9-72ab453e4dbb",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 6,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 535,
          "sessionReused": false,
          "rawInputTokens": 6,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:08ab3628cf9d20d28aa892826ba1e4dc0e150cc0f55148711411a2fbf69ad668",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:1704e9853ac171d485444bad96c5b6c31478f3c5dae95dfa1a4f7a4fb322e4f9",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 535,
          "cachedInputTokens": 89977,
          "taskSessionReused": false,
          "persistedSessionId": "2dbd1b02-0d00-4c2f-aa3e-dc8009c44b41",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 89977,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

stop-new-resume passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens12 in · 1,478 out180,142 cached · 2/4 runs covered

LLM spend$0.0000002/4 runs provider-priced

Execution$0.007516 est.1m 44s agent · 1m 41s lease

agent-chat-hardening.runner-acpx-claude.daytona.stop-new-resume

Matchers and test context

Attempt: 1
Duration: 2m 27s
Agent runtime: 1m 44s
Environment lease: 1m 41s
Runtime: native
Provider: acpx
Model: claude-sonnet-5
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 4,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 12,
      "outputTokens": 1478,
      "cachedInputTokens": 180142,
      "totalTokens": 181632,
      "reportedCostUsd": 0,
      "costStatus": "partial"
    },
    "runtime": {
      "provider": "daytona",
      "agentRunDurationMs": 103753,
      "leaseDurationMs": 101157,
      "leaseCount": 3,
      "cpuCores": 4,
      "memoryGiB": 4,
      "diskGiB": 10,
      "estimatedListCostUsd": 0.0075159651,
      "costStatus": "estimated",
      "costSource": "daytona_public_list_price",
      "pricingAsOf": "2026-08-27",
      "pricingUrl": "https://www.daytona.io/pricing"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0.0075159651,
    "observedAndEstimatedCostUsd": 0.0075159651,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "a41734be-96ea-4ce2-b59d-9a7fc3de280d",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 6,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 761,
          "sessionReused": false,
          "rawInputTokens": 6,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:e76a4be49ce1c62edfad04f46f0d4b02564c987928027ba8dcf7e619b2488082",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:c836ddda14fac3136e7db1c4dee66c7de151c17da062a3637ebea40c42a77656",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 761,
          "cachedInputTokens": 90097,
          "taskSessionReused": false,
          "persistedSessionId": "08c3fa7f-3fba-4f47-aeb0-ee2e3f1e9aca",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 90097,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "32f8fd23-a175-4f89-98c7-b74c2ca6c0a7",
        "usage": null
      },
      {
        "runId": "9f6e373d-861b-4415-89f9-25910878aaa2",
        "usage": null
      },
      {
        "runId": "2f1ad4d4-092d-4299-a94e-fbf29a16cff9",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 6,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 717,
          "sessionReused": false,
          "rawInputTokens": 6,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:e76a4be49ce1c62edfad04f46f0d4b02564c987928027ba8dcf7e619b2488082",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:c836ddda14fac3136e7db1c4dee66c7de151c17da062a3637ebea40c42a77656",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 717,
          "cachedInputTokens": 90045,
          "taskSessionReused": false,
          "persistedSessionId": "4cbc3810-9388-4852-9837-abb651da90b3",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 90045,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Task continuation

Everyday Paperclip Work

First-task onboarding

Persistent Agent Chat

Core Runner Compatibility

Local Session Integrity

OpenRouter Model Breadth

Daytona Warm Continuity

agent-chat-hardening

Campaign trends