Runner Full-Stack E2E

Test suite

Task continuation

Human direction, approval boundaries, untrusted evidence, and completed actions across turns.

Configuration matrix4 profiles · 1 environments · 0 selected

Agent profile	Isolated locallocal · local
Legacy Codexlegacycodex · gpt-5.6-sol	Isolated locallocal · local answer updates scope not selected `continuation.legacy-codex.local.answer-updates-scope` Matchers and test context Not selected No matcher result was recorded. clarification not approval not selected `continuation.legacy-codex.local.clarification-not-approval` Matchers and test context Not selected No matcher result was recorded. revision preserves approval not selected `continuation.legacy-codex.local.revision-preserves-approval` Matchers and test context Not selected No matcher result was recorded. untrusted evidence not selected `continuation.legacy-codex.local.untrusted-evidence` Matchers and test context Not selected No matcher result was recorded. completed action resume not selected `continuation.legacy-codex.local.completed-action-resume` Matchers and test context Not selected No matcher result was recorded.
Legacy Claudelegacyclaude · claude-sonnet-4-6	Isolated locallocal · local answer updates scope not selected `continuation.legacy-claude.local.answer-updates-scope` Matchers and test context Not selected No matcher result was recorded. clarification not approval not selected `continuation.legacy-claude.local.clarification-not-approval` Matchers and test context Not selected No matcher result was recorded. revision preserves approval not selected `continuation.legacy-claude.local.revision-preserves-approval` Matchers and test context Not selected No matcher result was recorded. untrusted evidence not selected `continuation.legacy-claude.local.untrusted-evidence` Matchers and test context Not selected No matcher result was recorded. completed action resume not selected `continuation.legacy-claude.local.completed-action-resume` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local answer updates scope not selected `continuation.runner-codex.local.answer-updates-scope` Matchers and test context Not selected No matcher result was recorded. clarification not approval not selected `continuation.runner-codex.local.clarification-not-approval` Matchers and test context Not selected No matcher result was recorded. revision preserves approval not selected `continuation.runner-codex.local.revision-preserves-approval` Matchers and test context Not selected No matcher result was recorded. untrusted evidence not selected `continuation.runner-codex.local.untrusted-evidence` Matchers and test context Not selected No matcher result was recorded. completed action resume not selected `continuation.runner-codex.local.completed-action-resume` Matchers and test context Not selected No matcher result was recorded. question tool documentation not selected `continuation.runner-codex.local.question-tool-documentation` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local answer updates scope not selected `continuation.runner-acpx-claude.local.answer-updates-scope` Matchers and test context Not selected No matcher result was recorded. clarification not approval not selected `continuation.runner-acpx-claude.local.clarification-not-approval` Matchers and test context Not selected No matcher result was recorded. revision preserves approval not selected `continuation.runner-acpx-claude.local.revision-preserves-approval` Matchers and test context Not selected No matcher result was recorded. untrusted evidence not selected `continuation.runner-acpx-claude.local.untrusted-evidence` Matchers and test context Not selected No matcher result was recorded. completed action resume not selected `continuation.runner-acpx-claude.local.completed-action-resume` Matchers and test context Not selected No matcher result was recorded. question tool documentation not selected `continuation.runner-acpx-claude.local.question-tool-documentation` Matchers and test context Not selected No matcher result was recorded. provider question bridge not selected `continuation.runner-acpx-claude.local.provider-question-bridge` Matchers and test context Not selected No matcher result was recorded.

Test suite

Everyday Paperclip Work

Real user requests, useful downloaded work, and durable continuation using production instructions.

Configuration matrix3 profiles · 2 environments · 0 selected

Agent profile	Isolated locallocal · local	Daytona warm reusable sandboxdaytona · remote
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Decline external providers not selected `everyday-workflows.runner-codex.local.provider-decline` Matchers and test context Not selected No matcher result was recorded. Choose and reuse the second external provider not selected `everyday-workflows.runner-codex.local.provider-second` Matchers and test context Not selected No matcher result was recorded. Prefer a built-in connection over external providers not selected `everyday-workflows.runner-codex.local.provider-native` Matchers and test context Not selected No matcher result was recorded. Build, download, and revise a project not selected `everyday-workflows.runner-codex.local.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-codex.local.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Delegate work through an agent review handoff not selected `everyday-workflows.runner-codex.local.agent-review-handoff` Matchers and test context Not selected No matcher result was recorded. Hire one teammate, then reuse that agent not selected `everyday-workflows.runner-codex.local.hire-reuse` Matchers and test context Not selected No matcher result was recorded. Use a connection after approval not selected `everyday-workflows.runner-codex.local.service-approve` Matchers and test context Not selected No matcher result was recorded. Respect a declined tool action not selected `everyday-workflows.runner-codex.local.service-decline` Matchers and test context Not selected No matcher result was recorded. Respect Not now on a new connection not selected `everyday-workflows.runner-codex.local.connection-decline` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-codex.local.recover-controller` Matchers and test context Not selected No matcher result was recorded. Stop a task and send a new direction once not selected `everyday-workflows.runner-codex.local.stop-redirect` Matchers and test context Not selected No matcher result was recorded. Create and edit a company skill not selected `everyday-workflows.runner-codex.local.create-skill-studio` Matchers and test context Not selected No matcher result was recorded.	Daytona warm reusable sandboxdaytona · remote Build, download, and revise a project not selected `everyday-workflows.runner-codex.daytona.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-codex.daytona.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-codex.daytona.recover-controller` Matchers and test context Not selected No matcher result was recorded. Create and edit a company skill not selected `everyday-workflows.runner-codex.daytona.create-skill-studio` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Decline external providers not selected `everyday-workflows.runner-acpx-claude.local.provider-decline` Matchers and test context Not selected No matcher result was recorded. Choose and reuse the second external provider not selected `everyday-workflows.runner-acpx-claude.local.provider-second` Matchers and test context Not selected No matcher result was recorded. Prefer a built-in connection over external providers not selected `everyday-workflows.runner-acpx-claude.local.provider-native` Matchers and test context Not selected No matcher result was recorded. Build, download, and revise a project not selected `everyday-workflows.runner-acpx-claude.local.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-acpx-claude.local.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Delegate work through an agent review handoff not selected `everyday-workflows.runner-acpx-claude.local.agent-review-handoff` Matchers and test context Not selected No matcher result was recorded. Hire one teammate, then reuse that agent not selected `everyday-workflows.runner-acpx-claude.local.hire-reuse` Matchers and test context Not selected No matcher result was recorded. Use a connection after approval not selected `everyday-workflows.runner-acpx-claude.local.service-approve` Matchers and test context Not selected No matcher result was recorded. Respect a declined tool action not selected `everyday-workflows.runner-acpx-claude.local.service-decline` Matchers and test context Not selected No matcher result was recorded. Respect Not now on a new connection not selected `everyday-workflows.runner-acpx-claude.local.connection-decline` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-acpx-claude.local.recover-controller` Matchers and test context Not selected No matcher result was recorded. Stop a task and send a new direction once not selected `everyday-workflows.runner-acpx-claude.local.stop-redirect` Matchers and test context Not selected No matcher result was recorded. Create and edit a company skill not selected `everyday-workflows.runner-acpx-claude.local.create-skill-studio` Matchers and test context Not selected No matcher result was recorded.	Daytona warm reusable sandboxdaytona · remote Build, download, and revise a project not selected `everyday-workflows.runner-acpx-claude.daytona.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-acpx-claude.daytona.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-acpx-claude.daytona.recover-controller` Matchers and test context Not selected No matcher result was recorded. Create and edit a company skill not selected `everyday-workflows.runner-acpx-claude.daytona.create-skill-studio` Matchers and test context Not selected No matcher result was recorded.
Runner Codex Mininativecodex · gpt-5.4-mini	Isolated locallocal · local Decline external providers not selected `everyday-workflows.runner-codex-mini.local.provider-decline` Matchers and test context Not selected No matcher result was recorded. Choose and reuse the second external provider not selected `everyday-workflows.runner-codex-mini.local.provider-second` Matchers and test context Not selected No matcher result was recorded. Prefer a built-in connection over external providers not selected `everyday-workflows.runner-codex-mini.local.provider-native` Matchers and test context Not selected No matcher result was recorded. Build, download, and revise a project not selected `everyday-workflows.runner-codex-mini.local.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-codex-mini.local.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Delegate work through an agent review handoff not selected `everyday-workflows.runner-codex-mini.local.agent-review-handoff` Matchers and test context Not selected No matcher result was recorded. Hire one teammate, then reuse that agent not selected `everyday-workflows.runner-codex-mini.local.hire-reuse` Matchers and test context Not selected No matcher result was recorded. Use a connection after approval not selected `everyday-workflows.runner-codex-mini.local.service-approve` Matchers and test context Not selected No matcher result was recorded. Respect a declined tool action not selected `everyday-workflows.runner-codex-mini.local.service-decline` Matchers and test context Not selected No matcher result was recorded. Respect Not now on a new connection not selected `everyday-workflows.runner-codex-mini.local.connection-decline` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-codex-mini.local.recover-controller` Matchers and test context Not selected No matcher result was recorded. Stop a task and send a new direction once not selected `everyday-workflows.runner-codex-mini.local.stop-redirect` Matchers and test context Not selected No matcher result was recorded. Create and edit a company skill not selected `everyday-workflows.runner-codex-mini.local.create-skill-studio` Matchers and test context Not selected No matcher result was recorded.	Daytona warm reusable sandboxdaytona · remote

Test suite

First-task onboarding

Production onboarding, first replies, approval, and durable task execution.

Configuration matrix4 profiles · 1 environments · 0 selected

Agent profile	Isolated locallocal · local
Legacy Codexlegacycodex · Production onboarding default	Isolated locallocal · local Interview: first response not selected `first-task.legacy-codex.local.interview-first-response` Matchers and test context Not selected No matcher result was recorded. Clear task: first response not selected `first-task.legacy-codex.local.clear-task-first-response` Matchers and test context Not selected No matcher result was recorded. Ambiguous task: first response not selected `first-task.legacy-codex.local.ambiguous-task-first-response` Matchers and test context Not selected No matcher result was recorded. Opening card replaced by a message not selected `first-task.legacy-codex.local.plain-message-first-response` Matchers and test context Not selected No matcher result was recorded. Explicit plan: first response not selected `first-task.legacy-codex.local.plan-first-response` Matchers and test context Not selected No matcher result was recorded. Other tasks do not inherit onboarding policy not selected `first-task.legacy-codex.local.ordinary-task-control` Matchers and test context Not selected No matcher result was recorded. Interview, plan, and acceptance not selected `first-task.legacy-codex.local.interview-plan-accept` Matchers and test context Not selected No matcher result was recorded. Subtask accepted through a card not selected `first-task.legacy-codex.local.task-card-accept` Matchers and test context Not selected No matcher result was recorded. Accept a proposal while its agent is still running not selected `first-task.legacy-codex.local.accept-while-running` Matchers and test context Not selected No matcher result was recorded. Subtask accepted in conversation not selected `first-task.legacy-codex.local.task-reply-accept` Matchers and test context Not selected No matcher result was recorded. Clarification, proposal, and acceptance not selected `first-task.legacy-codex.local.clarify-propose-accept` Matchers and test context Not selected No matcher result was recorded. Revise scope before accepting not selected `first-task.legacy-codex.local.revise-accept` Matchers and test context Not selected No matcher result was recorded. Decline proposed work not selected `first-task.legacy-codex.local.reject-no-execution` Matchers and test context Not selected No matcher result was recorded.
Legacy Claudelegacyclaude · Production onboarding default	Isolated locallocal · local Interview: first response not selected `first-task.legacy-claude.local.interview-first-response` Matchers and test context Not selected No matcher result was recorded. Clear task: first response not selected `first-task.legacy-claude.local.clear-task-first-response` Matchers and test context Not selected No matcher result was recorded. Ambiguous task: first response not selected `first-task.legacy-claude.local.ambiguous-task-first-response` Matchers and test context Not selected No matcher result was recorded. Opening card replaced by a message not selected `first-task.legacy-claude.local.plain-message-first-response` Matchers and test context Not selected No matcher result was recorded. Explicit plan: first response not selected `first-task.legacy-claude.local.plan-first-response` Matchers and test context Not selected No matcher result was recorded. Other tasks do not inherit onboarding policy not selected `first-task.legacy-claude.local.ordinary-task-control` Matchers and test context Not selected No matcher result was recorded. Interview, plan, and acceptance not selected `first-task.legacy-claude.local.interview-plan-accept` Matchers and test context Not selected No matcher result was recorded. Subtask accepted through a card not selected `first-task.legacy-claude.local.task-card-accept` Matchers and test context Not selected No matcher result was recorded. Accept a proposal while its agent is still running not selected `first-task.legacy-claude.local.accept-while-running` Matchers and test context Not selected No matcher result was recorded. Subtask accepted in conversation not selected `first-task.legacy-claude.local.task-reply-accept` Matchers and test context Not selected No matcher result was recorded. Clarification, proposal, and acceptance not selected `first-task.legacy-claude.local.clarify-propose-accept` Matchers and test context Not selected No matcher result was recorded. Revise scope before accepting not selected `first-task.legacy-claude.local.revise-accept` Matchers and test context Not selected No matcher result was recorded. Decline proposed work not selected `first-task.legacy-claude.local.reject-no-execution` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · Production onboarding default	Isolated locallocal · local Interview: first response not selected `first-task.runner-codex.local.interview-first-response` Matchers and test context Not selected No matcher result was recorded. Clear task: first response not selected `first-task.runner-codex.local.clear-task-first-response` Matchers and test context Not selected No matcher result was recorded. Ambiguous task: first response not selected `first-task.runner-codex.local.ambiguous-task-first-response` Matchers and test context Not selected No matcher result was recorded. Opening card replaced by a message not selected `first-task.runner-codex.local.plain-message-first-response` Matchers and test context Not selected No matcher result was recorded. Explicit plan: first response not selected `first-task.runner-codex.local.plan-first-response` Matchers and test context Not selected No matcher result was recorded. Other tasks do not inherit onboarding policy not selected `first-task.runner-codex.local.ordinary-task-control` Matchers and test context Not selected No matcher result was recorded. Interview, plan, and acceptance not selected `first-task.runner-codex.local.interview-plan-accept` Matchers and test context Not selected No matcher result was recorded. Subtask accepted through a card not selected `first-task.runner-codex.local.task-card-accept` Matchers and test context Not selected No matcher result was recorded. Accept a proposal while its agent is still running not selected `first-task.runner-codex.local.accept-while-running` Matchers and test context Not selected No matcher result was recorded. Subtask accepted in conversation not selected `first-task.runner-codex.local.task-reply-accept` Matchers and test context Not selected No matcher result was recorded. Clarification, proposal, and acceptance not selected `first-task.runner-codex.local.clarify-propose-accept` Matchers and test context Not selected No matcher result was recorded. Revise scope before accepting not selected `first-task.runner-codex.local.revise-accept` Matchers and test context Not selected No matcher result was recorded. Decline proposed work not selected `first-task.runner-codex.local.reject-no-execution` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · Production onboarding default	Isolated locallocal · local Interview: first response not selected `first-task.runner-acpx-claude.local.interview-first-response` Matchers and test context Not selected No matcher result was recorded. Clear task: first response not selected `first-task.runner-acpx-claude.local.clear-task-first-response` Matchers and test context Not selected No matcher result was recorded. Ambiguous task: first response not selected `first-task.runner-acpx-claude.local.ambiguous-task-first-response` Matchers and test context Not selected No matcher result was recorded. Opening card replaced by a message not selected `first-task.runner-acpx-claude.local.plain-message-first-response` Matchers and test context Not selected No matcher result was recorded. Explicit plan: first response not selected `first-task.runner-acpx-claude.local.plan-first-response` Matchers and test context Not selected No matcher result was recorded. Other tasks do not inherit onboarding policy not selected `first-task.runner-acpx-claude.local.ordinary-task-control` Matchers and test context Not selected No matcher result was recorded. Interview, plan, and acceptance not selected `first-task.runner-acpx-claude.local.interview-plan-accept` Matchers and test context Not selected No matcher result was recorded. Subtask accepted through a card not selected `first-task.runner-acpx-claude.local.task-card-accept` Matchers and test context Not selected No matcher result was recorded. Accept a proposal while its agent is still running not selected `first-task.runner-acpx-claude.local.accept-while-running` Matchers and test context Not selected No matcher result was recorded. Subtask accepted in conversation not selected `first-task.runner-acpx-claude.local.task-reply-accept` Matchers and test context Not selected No matcher result was recorded. Clarification, proposal, and acceptance not selected `first-task.runner-acpx-claude.local.clarify-propose-accept` Matchers and test context Not selected No matcher result was recorded. Revise scope before accepting not selected `first-task.runner-acpx-claude.local.revise-accept` Matchers and test context Not selected No matcher result was recorded. Decline proposed work not selected `first-task.runner-acpx-claude.local.reject-no-execution` Matchers and test context Not selected No matcher result was recorded.

Test suite

Persistent Agent Chat

Task-backed conversations, session resets, and project plan handoff.

Configuration matrix4 profiles · 1 environments · 0 selected

Agent profile	Isolated locallocal · local
Legacy Codexlegacycodex · gpt-5.6-sol	Isolated locallocal · local Conversation continuity across restart not selected `agent-chat.legacy-codex.local.continuity-restart` Matchers and test context Not selected No matcher result was recorded. Fresh context within preserved history not selected `agent-chat.legacy-codex.local.new-session` Matchers and test context Not selected No matcher result was recorded. Stop, reset, and resume not selected `agent-chat.legacy-codex.local.stop-new-resume` Matchers and test context Not selected No matcher result was recorded. Draft, revise, approve, and hand off a plan not selected `agent-chat.legacy-codex.local.plan-handoff` Matchers and test context Not selected No matcher result was recorded. Clarify and reuse an existing project not selected `agent-chat.legacy-codex.local.clarify-reuse` Matchers and test context Not selected No matcher result was recorded. Create a project with multiple repository URLs not selected `agent-chat.legacy-codex.local.multi-repository` Matchers and test context Not selected No matcher result was recorded.
Legacy Claudelegacyclaude · claude-sonnet-4-6	Isolated locallocal · local Conversation continuity across restart not selected `agent-chat.legacy-claude.local.continuity-restart` Matchers and test context Not selected No matcher result was recorded. Fresh context within preserved history not selected `agent-chat.legacy-claude.local.new-session` Matchers and test context Not selected No matcher result was recorded. Stop, reset, and resume not selected `agent-chat.legacy-claude.local.stop-new-resume` Matchers and test context Not selected No matcher result was recorded. Draft, revise, approve, and hand off a plan not selected `agent-chat.legacy-claude.local.plan-handoff` Matchers and test context Not selected No matcher result was recorded. Clarify and reuse an existing project not selected `agent-chat.legacy-claude.local.clarify-reuse` Matchers and test context Not selected No matcher result was recorded. Create a project with multiple repository URLs not selected `agent-chat.legacy-claude.local.multi-repository` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Save a planned task without starting work not selected `agent-chat.runner-codex.local.create-backlog` Matchers and test context Not selected No matcher result was recorded. Reassign existing work and preserve queued context not selected `agent-chat.runner-codex.local.reassign-task` Matchers and test context Not selected No matcher result was recorded. Conversation continuity across restart not selected `agent-chat.runner-codex.local.continuity-restart` Matchers and test context Not selected No matcher result was recorded. Fresh context within preserved history not selected `agent-chat.runner-codex.local.new-session` Matchers and test context Not selected No matcher result was recorded. Stop, reset, and resume not selected `agent-chat.runner-codex.local.stop-new-resume` Matchers and test context Not selected No matcher result was recorded. Draft, revise, approve, and hand off a plan not selected `agent-chat.runner-codex.local.plan-handoff` Matchers and test context Not selected No matcher result was recorded. Clarify and reuse an existing project not selected `agent-chat.runner-codex.local.clarify-reuse` Matchers and test context Not selected No matcher result was recorded. Create a project with multiple repository URLs not selected `agent-chat.runner-codex.local.multi-repository` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Save a planned task without starting work not selected `agent-chat.runner-acpx-claude.local.create-backlog` Matchers and test context Not selected No matcher result was recorded. Reassign existing work and preserve queued context not selected `agent-chat.runner-acpx-claude.local.reassign-task` Matchers and test context Not selected No matcher result was recorded. Conversation continuity across restart not selected `agent-chat.runner-acpx-claude.local.continuity-restart` Matchers and test context Not selected No matcher result was recorded. Fresh context within preserved history not selected `agent-chat.runner-acpx-claude.local.new-session` Matchers and test context Not selected No matcher result was recorded. Stop, reset, and resume not selected `agent-chat.runner-acpx-claude.local.stop-new-resume` Matchers and test context Not selected No matcher result was recorded. Draft, revise, approve, and hand off a plan not selected `agent-chat.runner-acpx-claude.local.plan-handoff` Matchers and test context Not selected No matcher result was recorded. Clarify and reuse an existing project not selected `agent-chat.runner-acpx-claude.local.clarify-reuse` Matchers and test context Not selected No matcher result was recorded. Create a project with multiple repository URLs not selected `agent-chat.runner-acpx-claude.local.multi-repository` Matchers and test context Not selected No matcher result was recorded.

Test suite

Agent Chat Recovery and Coordination

Native chat startup cancellation, committed sends, hiring, grounded status, and remote continuity.

Configuration matrix2 profiles · 2 environments · 0 selected

Agent profile	Isolated locallocal · local	Daytona warm reusable sandboxdaytona · remote
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Stop during startup, reset, and resume not selected `agent-chat-hardening.runner-codex.local.stop-startup-new-resume` Matchers and test context Not selected No matcher result was recorded. Hire through chat, delegate, and reuse the same teammate not selected `agent-chat-hardening.runner-codex.local.hire-delegate-reuse` Matchers and test context Not selected No matcher result was recorded. Read the actual blocker and hand source material to a reviewer not selected `agent-chat-hardening.runner-codex.local.blocked-status-review` Matchers and test context Not selected No matcher result was recorded. Recover a lost send acknowledgement without repeating committed work not selected `agent-chat-hardening.runner-codex.local.committed-send-retry` Matchers and test context Not selected No matcher result was recorded. Conversation continuity across restart not selected `agent-chat-hardening.runner-codex.local.continuity-restart` Matchers and test context Not selected No matcher result was recorded. Stop, reset, and resume not selected `agent-chat-hardening.runner-codex.local.stop-new-resume` Matchers and test context Not selected No matcher result was recorded.	Daytona warm reusable sandboxdaytona · remote Recover a lost send acknowledgement without repeating committed work not selected `agent-chat-hardening.runner-codex.daytona.committed-send-retry` Matchers and test context Not selected No matcher result was recorded. Conversation continuity across restart not selected `agent-chat-hardening.runner-codex.daytona.continuity-restart` Matchers and test context Not selected No matcher result was recorded. Stop, reset, and resume not selected `agent-chat-hardening.runner-codex.daytona.stop-new-resume` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Stop during startup, reset, and resume not selected `agent-chat-hardening.runner-acpx-claude.local.stop-startup-new-resume` Matchers and test context Not selected No matcher result was recorded. Hire through chat, delegate, and reuse the same teammate not selected `agent-chat-hardening.runner-acpx-claude.local.hire-delegate-reuse` Matchers and test context Not selected No matcher result was recorded. Read the actual blocker and hand source material to a reviewer not selected `agent-chat-hardening.runner-acpx-claude.local.blocked-status-review` Matchers and test context Not selected No matcher result was recorded. Recover a lost send acknowledgement without repeating committed work not selected `agent-chat-hardening.runner-acpx-claude.local.committed-send-retry` Matchers and test context Not selected No matcher result was recorded. Conversation continuity across restart not selected `agent-chat-hardening.runner-acpx-claude.local.continuity-restart` Matchers and test context Not selected No matcher result was recorded. Stop, reset, and resume not selected `agent-chat-hardening.runner-acpx-claude.local.stop-new-resume` Matchers and test context Not selected No matcher result was recorded.	Daytona warm reusable sandboxdaytona · remote Recover a lost send acknowledgement without repeating committed work not selected `agent-chat-hardening.runner-acpx-claude.daytona.committed-send-retry` Matchers and test context Not selected No matcher result was recorded. Conversation continuity across restart not selected `agent-chat-hardening.runner-acpx-claude.daytona.continuity-restart` Matchers and test context Not selected No matcher result was recorded. Stop, reset, and resume not selected `agent-chat-hardening.runner-acpx-claude.daytona.stop-new-resume` Matchers and test context Not selected No matcher result was recorded.

Test suite

Agent Chat Setup and Interruptions

Experimental settings lifecycle and user follow-ups during active native work.

Configuration matrix2 profiles · 1 environments · 0 selected

Agent profile Isolated locallocal · local

Agent profile	Isolated locallocal · local
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Enable Agent Chat, pause access, and resume preserved history not selected `agent-chat-stories.runner-codex.local.enable-disable-resume` Matchers and test context Not selected No matcher result was recorded. Deliver a follow-up while a provider turn is running not selected `agent-chat-stories.runner-codex.local.followup-while-running` Matchers and test context Not selected No matcher result was recorded. Change instructions during active work and save the updated plan not selected `agent-chat-stories.runner-codex.local.revise-while-running` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Enable Agent Chat, pause access, and resume preserved history not selected `agent-chat-stories.runner-acpx-claude.local.enable-disable-resume` Matchers and test context Not selected No matcher result was recorded. Deliver a follow-up while a provider turn is running not selected `agent-chat-stories.runner-acpx-claude.local.followup-while-running` Matchers and test context Not selected No matcher result was recorded. Change instructions during active work and save the updated plan not selected `agent-chat-stories.runner-acpx-claude.local.revise-while-running` Matchers and test context Not selected No matcher result was recorded.

Runner Codexnativecodex · gpt-5.6-sol

Isolated locallocal · local

Enable Agent Chat, pause access, and resume preserved history not selected

agent-chat-stories.runner-codex.local.enable-disable-resume

Matchers and test context

Not selected

No matcher result was recorded.

Deliver a follow-up while a provider turn is running not selected

agent-chat-stories.runner-codex.local.followup-while-running

Matchers and test context

Not selected

No matcher result was recorded.

Change instructions during active work and save the updated plan not selected

agent-chat-stories.runner-codex.local.revise-while-running

Matchers and test context

Not selected

No matcher result was recorded.

Runner ACPX Claudenativeacpx · claude-sonnet-5

Isolated locallocal · local

Enable Agent Chat, pause access, and resume preserved history not selected

agent-chat-stories.runner-acpx-claude.local.enable-disable-resume

Matchers and test context

Not selected

No matcher result was recorded.

Deliver a follow-up while a provider turn is running not selected

agent-chat-stories.runner-acpx-claude.local.followup-while-running

Matchers and test context

Not selected

No matcher result was recorded.

Change instructions during active work and save the updated plan not selected

agent-chat-stories.runner-acpx-claude.local.revise-while-running

Matchers and test context

Not selected

No matcher result was recorded.

Test suite

Agent Chat Remaining Qualification

Active ownership transfer, user recovery after worker loss, and grounded answer quality.

Configuration matrix2 profiles · 1 environments · 0 selected

Agent profile Isolated locallocal · local

Agent profile	Isolated locallocal · local
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Reassign an executing task and preserve its saved work not selected `agent-chat-qualification.runner-codex.local.active-reassignment` Matchers and test context Not selected No matcher result was recorded. Recover from worker process loss through visible Retry not selected `agent-chat-qualification.runner-codex.local.worker-crash-retry` Matchers and test context Not selected No matcher result was recorded. Ground status, correct stale claims, and acknowledge uncertainty not selected `agent-chat-qualification.runner-codex.local.grounded-answer-quality` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Reassign an executing task and preserve its saved work not selected `agent-chat-qualification.runner-acpx-claude.local.active-reassignment` Matchers and test context Not selected No matcher result was recorded. Recover from worker process loss through visible Retry not selected `agent-chat-qualification.runner-acpx-claude.local.worker-crash-retry` Matchers and test context Not selected No matcher result was recorded. Ground status, correct stale claims, and acknowledge uncertainty not selected `agent-chat-qualification.runner-acpx-claude.local.grounded-answer-quality` Matchers and test context Not selected No matcher result was recorded.

Runner Codexnativecodex · gpt-5.6-sol

Isolated locallocal · local

Reassign an executing task and preserve its saved work not selected

agent-chat-qualification.runner-codex.local.active-reassignment

Matchers and test context

Not selected

No matcher result was recorded.

Recover from worker process loss through visible Retry not selected

agent-chat-qualification.runner-codex.local.worker-crash-retry

Matchers and test context

Not selected

No matcher result was recorded.

Ground status, correct stale claims, and acknowledge uncertainty not selected

agent-chat-qualification.runner-codex.local.grounded-answer-quality

Matchers and test context

Not selected

No matcher result was recorded.

Runner ACPX Claudenativeacpx · claude-sonnet-5

Isolated locallocal · local

Reassign an executing task and preserve its saved work not selected

agent-chat-qualification.runner-acpx-claude.local.active-reassignment

Matchers and test context

Not selected

No matcher result was recorded.

Recover from worker process loss through visible Retry not selected

agent-chat-qualification.runner-acpx-claude.local.worker-crash-retry

Matchers and test context

Not selected

No matcher result was recorded.

Ground status, correct stale claims, and acknowledge uncertainty not selected

agent-chat-qualification.runner-acpx-claude.local.grounded-answer-quality

Matchers and test context

Not selected

No matcher result was recorded.

Test suite

Core Runner Compatibility

Major provider, runtime generation, and execution-environment compatibility.

Configuration matrix7 profiles · 2 environments · 0 selected

Agent profile	Isolated locallocal · local	Daytona sandboxdaytona · remote
Legacy Codexlegacycodex · gpt-5.6-sol	Isolated locallocal · local Basic response not selected `core-compatibility.legacy-codex.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-codex.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-codex.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.legacy-codex.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-codex.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-codex.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Legacy Claudelegacyclaude · claude-sonnet-4-6	Isolated locallocal · local Basic response not selected `core-compatibility.legacy-claude.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-claude.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-claude.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.legacy-claude.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-claude.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-claude.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Legacy OpenCodelegacyopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Basic response not selected `core-compatibility.legacy-opencode.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-opencode.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-opencode.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.legacy-opencode.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-opencode.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-opencode.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Basic response not selected `core-compatibility.runner-codex.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-codex.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-codex.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.runner-codex.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-codex.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-codex.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Runner OpenCodenativeopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Basic response not selected `core-compatibility.runner-opencode.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-opencode.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-opencode.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.runner-opencode.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-opencode.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-opencode.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Basic response not selected `core-compatibility.runner-acpx-claude.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-acpx-claude.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-acpx-claude.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.runner-acpx-claude.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-acpx-claude.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-acpx-claude.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Codexnativeacpx · gpt-5.6-sol	Isolated locallocal · local Basic response not selected `core-compatibility.runner-acpx-codex.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-acpx-codex.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-acpx-codex.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.runner-acpx-codex.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-acpx-codex.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-acpx-codex.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.

Test suite

Local Session Integrity

Structured interaction and continuation qualification for every supported local profile.

Configuration matrix7 profiles · 1 environments · 0 selected

Agent profile	Isolated locallocal · local
Legacy Codexlegacycodex · gpt-5.6-sol	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.legacy-codex.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.legacy-codex.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Legacy Claudelegacyclaude · claude-sonnet-4-6	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.legacy-claude.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.legacy-claude.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Legacy OpenCodelegacyopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.legacy-opencode.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.legacy-opencode.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.runner-codex.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.runner-codex.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Runner OpenCodenativeopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.runner-opencode.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.runner-opencode.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.runner-acpx-claude.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.runner-acpx-claude.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Codexnativeacpx · gpt-5.6-sol	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.runner-acpx-codex.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.runner-acpx-codex.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.

Test suite

OpenRouter Model Breadth

Weekly-ranked tool-capable OpenRouter models through native OpenCode on isolated local workspaces.

Configuration matrix4 profiles · 1 environments · 0 selected

Agent profile	Isolated locallocal · local
#1 DeepSeek V4 Flash 0731nativeopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-deepseek-deepseek-v4-flash-0731.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-deepseek-deepseek-v4-flash-0731.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded.
#3 Tencent HY 3nativeopencode · openrouter/tencent/hy3	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-tencent-hy3.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-tencent-hy3.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded.
#4 Nemotron 3 Ultra 550B A55B (free)nativeopencode · openrouter/nvidia/nemotron-3-ultra-550b-a55b:free	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded. Plan, approve, complete not selected `openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.plan-approve-complete` Matchers and test context Not selected No matcher result was recorded.
#5 GPT-5.6 Lunanativeopencode · openrouter/openai/gpt-5.6-luna	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded. Plan, approve, complete not selected `openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.plan-approve-complete` Matchers and test context Not selected No matcher result was recorded.

Test suite

Daytona Warm Continuity

Three browser-driven turns on one reusable Daytona sandbox for legacy and native Codex.

Configuration matrix2 profiles · 1 environments · 0 selected

Agent profile	Daytona warm reusable sandboxdaytona · remote
Legacy Codexlegacycodex · gpt-5.6-sol	Daytona warm reusable sandboxdaytona · remote Warm three-turn workspace continuity not selected `daytona-warm-continuity.legacy-codex.daytona.warm-three-turn` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Daytona warm reusable sandboxdaytona · remote Warm three-turn workspace continuity not selected `daytona-warm-continuity.runner-codex.daytona.warm-three-turn` Matchers and test context Not selected No matcher result was recorded.

Test suite

grok-subscription-qualification

Suite discovered from retained campaign identities; full suite size is not known to this publisher.

Pass rate93.8%15/16 passed

TokensUnavailableUnavailable input · Unavailable output

Known spend$0.1405 (partial)reported LLM + runtime estimate

Agent time46m 23s31m 30s lease

Execution15/161 retries · cleanup failed

Configuration matrix1 profiles · 2 environments · 16 selected

Agent profile Isolated locallocal · local Daytona warm reusable sandboxdaytona · remote

runner-acpx-grok-subscriptionnativeacpx · grok-4.7

Isolated locallocal · local

message-marker passed

Overall passed · 6/6 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (6)

Result	Check	Detail
Pass	`message_exact`	matched
Pass	`message_occurrences`	matched
Pass	`issue_status`	matched
Pass	`run_status`	matched
Pass	`runtime_mode`	matched
Pass	`environment`	matched

TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered

LLM spendUnavailable0/1 runs provider-priced

ExecutionLocal · not metered31s agent

grok-subscription-qualification.runner-acpx-grok-subscription.local.message-marker

Matchers and test context

Attempt: 1
Duration: 52s
Agent runtime: 31s
Runtime: native
Provider: acpx
Model: grok-4.7
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`message_exact`	{"kind":"message_exact","expected":"PAPERCLIP_E2E_OK_be61a9dde159-1"}	matched
Pass	`message_occurrences`	{"kind":"message_occurrences","expected":"PAPERCLIP_E2E_OK_be61a9dde159-1","count":1}	matched
Pass	`issue_status`	{"kind":"issue_status","expected":"done"}	matched
Pass	`run_status`	{"kind":"run_status","expected":"succeeded"}	matched
Pass	`runtime_mode`	{"kind":"runtime_mode","expected":"native"}	matched
Pass	`environment`	{"kind":"environment","expected":"local"}	matched

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 30957,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null
}

plan-revise-accept passed

Overall passed · 6/6 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (6)

Result	Check	Detail
Pass	`message_exact`	matched
Pass	`message_occurrences`	matched
Pass	`issue_status`	matched
Pass	`run_status`	matched
Pass	`runtime_mode`	matched
Pass	`environment`	matched

TokensUnavailable in · Unavailable outUnavailable cached · 0/3 runs covered

LLM spendUnavailable0/3 runs provider-priced

ExecutionLocal · not metered3m 52s agent

grok-subscription-qualification.runner-acpx-grok-subscription.local.plan-revise-accept

Matchers and test context

Attempt: 1
Duration: 4m 29s
Agent runtime: 3m 52s
Runtime: native
Provider: acpx
Model: grok-4.7
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`message_exact`	{"kind":"message_exact","expected":"PAPERCLIP_E2E_PLAN_DONE_64b784ebab1f-1"}	matched
Pass	`message_occurrences`	{"kind":"message_occurrences","expected":"PAPERCLIP_E2E_PLAN_DONE_64b784ebab1f-1","count":1}	matched
Pass	`issue_status`	{"kind":"issue_status","expected":"done"}	matched
Pass	`run_status`	{"kind":"run_status","expected":"succeeded"}	matched
Pass	`runtime_mode`	{"kind":"runtime_mode","expected":"native"}	matched
Pass	`environment`	{"kind":"environment","expected":"local"}	matched

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 231727,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "82189eeb-6bda-4db7-8aa5-ddd23ae5e0c6",
        "usage": null
      },
      {
        "runId": "0838b9b3-e5e8-4417-a83b-82e2723257c1",
        "usage": null
      },
      {
        "runId": "be261aed-3892-48ac-b938-560ac2643576",
        "usage": null
      }
    ]
  }
}

ask-question passed

Overall passed · 6/6 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (6)

Result	Check	Detail
Pass	`message_exact`	matched
Pass	`message_occurrences`	matched
Pass	`issue_status`	matched
Pass	`run_status`	matched
Pass	`runtime_mode`	matched
Pass	`environment`	matched

TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered

LLM spendUnavailable0/1 runs provider-priced

ExecutionLocal · not metered1m 1s agent

grok-subscription-qualification.runner-acpx-grok-subscription.local.ask-question

Matchers and test context

Attempt: 1
Duration: 1m 15s
Agent runtime: 1m 1s
Runtime: native
Provider: acpx
Model: grok-4.7
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`message_exact`	{"kind":"message_exact","expected":"E2E_ASK_12_84678463d70d-1"}	matched
Pass	`message_occurrences`	{"kind":"message_occurrences","expected":"E2E_ASK_12_84678463d70d-1","count":1}	matched
Pass	`issue_status`	{"kind":"issue_status","expected":"done"}	matched
Pass	`run_status`	{"kind":"run_status","expected":"succeeded"}	matched
Pass	`runtime_mode`	{"kind":"runtime_mode","expected":"native"}	matched
Pass	`environment`	{"kind":"environment","expected":"local"}	matched

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 60806,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null
}

structured-question-resume passed

Overall passed · 6/6 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (6)

Result	Check	Detail
Pass	`message_exact`	matched
Pass	`message_occurrences`	matched
Pass	`issue_status`	matched
Pass	`run_status`	matched
Pass	`runtime_mode`	matched
Pass	`environment`	matched

TokensUnavailable in · Unavailable outUnavailable cached · 0/2 runs covered

LLM spendUnavailable0/2 runs provider-priced

ExecutionLocal · not metered1m 35s agent

grok-subscription-qualification.runner-acpx-grok-subscription.local.structured-question-resume

Matchers and test context

Attempt: 1
Duration: 2m 4s
Agent runtime: 1m 35s
Runtime: native
Provider: acpx
Model: grok-4.7
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`message_exact`	{"kind":"message_exact","expected":"PAPERCLIP_E2E_QUESTION_DONE_dc72b0d8cd12-1"}	matched
Pass	`message_occurrences`	{"kind":"message_occurrences","expected":"PAPERCLIP_E2E_QUESTION_DONE_dc72b0d8cd12-1","count":1}	matched
Pass	`issue_status`	{"kind":"issue_status","expected":"done"}	matched
Pass	`run_status`	{"kind":"run_status","expected":"succeeded"}	matched
Pass	`runtime_mode`	{"kind":"runtime_mode","expected":"native"}	matched
Pass	`environment`	{"kind":"environment","expected":"local"}	matched

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 94711,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "3f9a390d-5631-455c-b1d5-74f75151b27b",
        "usage": null
      },
      {
        "runId": "93f8f932-2664-4e85-9ceb-229a430904fe",
        "usage": null
      }
    ]
  }
}

structured-question-restart-resume passed

Overall passed · 6/6 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (6)

Result	Check	Detail
Pass	`message_exact`	matched
Pass	`message_occurrences`	matched
Pass	`issue_status`	matched
Pass	`run_status`	matched
Pass	`runtime_mode`	matched
Pass	`environment`	matched

TokensUnavailable in · Unavailable outUnavailable cached · 0/2 runs covered

LLM spendUnavailable0/2 runs provider-priced

ExecutionLocal · not metered2m 45s agent

grok-subscription-qualification.runner-acpx-grok-subscription.local.structured-question-restart-resume

Matchers and test context

Attempt: 1
Duration: 3m 42s
Agent runtime: 2m 45s
Runtime: native
Provider: acpx
Model: grok-4.7
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`message_exact`	{"kind":"message_exact","expected":"PAPERCLIP_E2E_QUESTION_DONE_2fc09286aab7-1"}	matched
Pass	`message_occurrences`	{"kind":"message_occurrences","expected":"PAPERCLIP_E2E_QUESTION_DONE_2fc09286aab7-1","count":1}	matched
Pass	`issue_status`	{"kind":"issue_status","expected":"done"}	matched
Pass	`run_status`	{"kind":"run_status","expected":"succeeded"}	matched
Pass	`runtime_mode`	{"kind":"runtime_mode","expected":"native"}	matched
Pass	`environment`	{"kind":"environment","expected":"local"}	matched

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 165035,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "72ea65b7-7d3b-406e-b66e-d08dae913a3e",
        "usage": null
      },
      {
        "runId": "bd7e61cc-7aa3-4bca-bf3b-421c77e4402d",
        "usage": null
      }
    ]
  }
}

build-revise passed

Overall passed · 40/40 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (40)

Result	Check	Detail
Pass	`initial.one-slugify-source`
Pass	`initial.readme-present`
Pass	`initial.project-tests-present`
Pass	`initial.base-0`	exit=0; expected='hello-world'; observed='hello-world\n'
Pass	`initial.base-1`	exit=0; expected='queue-ready'; observed='queue-ready\n'
Pass	`initial.base-2`	exit=0; expected='already-fine'; observed='already-fine\n'
Pass	`initial.base-3`	exit=0; expected='caf'; observed='caf\n'
Pass	`initial.base-4`	exit=0; expected=''; observed='\n'
Pass	`initial.base-5`	exit=0; expected='a-b-c'; observed='a-b-c\n'
Pass	`initial.base-6`	exit=0; expected='123'; observed='123\n'
Pass	`initial.base-7`	exit=0; expected=''; observed='\n'
Pass	`initial.importable-function`
Pass	`reply-4-stored-once`	A composer submission creates exactly one user message.
Pass	`revised.one-slugify-source`
Pass	`revised.readme-present`
Pass	`revised.project-tests-present`
Pass	`revised.base-0`	exit=0; expected='hello-world'; observed='hello-world\n'
Pass	`revised.base-1`	exit=0; expected='queue-ready'; observed='queue-ready\n'
Pass	`revised.base-2`	exit=0; expected='already-fine'; observed='already-fine\n'
Pass	`revised.base-3`	exit=0; expected='caf'; observed='caf\n'
Pass	`revised.base-4`	exit=0; expected=''; observed='\n'
Pass	`revised.base-5`	exit=0; expected='a-b-c'; observed='a-b-c\n'
Pass	`revised.base-6`	exit=0; expected='123'; observed='123\n'
Pass	`revised.base-7`	exit=0; expected=''; observed='\n'
Pass	`revised.importable-function`
Pass	`revised.separator-_`
Pass	`revised.separator--`
Pass	`revised.reject-invalid-separator`
Pass	`new-artifact-revision`	The follow-up must deliver a new version.
Pass	`prior-download-preserved`	The first delivered version remains retrievable.
Pass	`submitted-replies-consumed`	Every submitted user message appears in a successfully completed native execution input.
Pass	`native-model-config`	Persisted native execution inputs use the selected model; this does not claim provider-side model identity.
Pass	`native-terminal-contract`	Successful runs retain the native terminal contract.
Pass	`tasks-done`	Every story task must reach Done.
Pass	`settled`	No active runs or scheduled recovery remain.
Pass	`native-runtime`	All executions must prove native runtime and runner identity.
Pass	`successful-runs`	Only the expected stop or process-loss outcome of an injected interruption is exempt.
Pass	`bounded-work`	No more than twelve executions, including child and recovery turns.
Pass	`parent-owned-by-lead`	A mentioned worker must not execute on the parent.
Pass	`no-pending-bookkeeping`	No completion confirmation or unanswered interaction remains.

TokensUnavailable in · Unavailable outUnavailable cached · 0/2 runs covered

LLM spendUnavailable0/2 runs provider-priced

ExecutionLocal · not metered2m 52s agent

grok-subscription-qualification.runner-acpx-grok-subscription.local.build-revise

Matchers and test context

Attempt: 1
Duration: 3m 41s
Agent runtime: 2m 52s
Runtime: native
Provider: acpx
Model: grok-4.7
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"initial.one-slugify-source","expected":true}
Pass	`json_path`	{"kind":"json_path","path":"initial.readme-present","expected":true}
Pass	`json_path`	{"kind":"json_path","path":"initial.project-tests-present","expected":true}
Pass	`json_path`	{"kind":"json_path","path":"initial.base-0","expected":true}	exit=0; expected='hello-world'; observed='hello-world\n'
Pass	`json_path`	{"kind":"json_path","path":"initial.base-1","expected":true}	exit=0; expected='queue-ready'; observed='queue-ready\n'
Pass	`json_path`	{"kind":"json_path","path":"initial.base-2","expected":true}	exit=0; expected='already-fine'; observed='already-fine\n'
Pass	`json_path`	{"kind":"json_path","path":"initial.base-3","expected":true}	exit=0; expected='caf'; observed='caf\n'
Pass	`json_path`	{"kind":"json_path","path":"initial.base-4","expected":true}	exit=0; expected=''; observed='\n'
Pass	`json_path`	{"kind":"json_path","path":"initial.base-5","expected":true}	exit=0; expected='a-b-c'; observed='a-b-c\n'
Pass	`json_path`	{"kind":"json_path","path":"initial.base-6","expected":true}	exit=0; expected='123'; observed='123\n'
Pass	`json_path`	{"kind":"json_path","path":"initial.base-7","expected":true}	exit=0; expected=''; observed='\n'
Pass	`json_path`	{"kind":"json_path","path":"initial.importable-function","expected":true}
Pass	`json_path`	{"kind":"json_path","path":"reply-4-stored-once","expected":true}	A composer submission creates exactly one user message.
Pass	`json_path`	{"kind":"json_path","path":"revised.one-slugify-source","expected":true}
Pass	`json_path`	{"kind":"json_path","path":"revised.readme-present","expected":true}
Pass	`json_path`	{"kind":"json_path","path":"revised.project-tests-present","expected":true}
Pass	`json_path`	{"kind":"json_path","path":"revised.base-0","expected":true}	exit=0; expected='hello-world'; observed='hello-world\n'
Pass	`json_path`	{"kind":"json_path","path":"revised.base-1","expected":true}	exit=0; expected='queue-ready'; observed='queue-ready\n'
Pass	`json_path`	{"kind":"json_path","path":"revised.base-2","expected":true}	exit=0; expected='already-fine'; observed='already-fine\n'
Pass	`json_path`	{"kind":"json_path","path":"revised.base-3","expected":true}	exit=0; expected='caf'; observed='caf\n'
Pass	`json_path`	{"kind":"json_path","path":"revised.base-4","expected":true}	exit=0; expected=''; observed='\n'
Pass	`json_path`	{"kind":"json_path","path":"revised.base-5","expected":true}	exit=0; expected='a-b-c'; observed='a-b-c\n'
Pass	`json_path`	{"kind":"json_path","path":"revised.base-6","expected":true}	exit=0; expected='123'; observed='123\n'
Pass	`json_path`	{"kind":"json_path","path":"revised.base-7","expected":true}	exit=0; expected=''; observed='\n'
Pass	`json_path`	{"kind":"json_path","path":"revised.importable-function","expected":true}
Pass	`json_path`	{"kind":"json_path","path":"revised.separator-_","expected":true}
Pass	`json_path`	{"kind":"json_path","path":"revised.separator--","expected":true}
Pass	`json_path`	{"kind":"json_path","path":"revised.reject-invalid-separator","expected":true}
Pass	`json_path`	{"kind":"json_path","path":"new-artifact-revision","expected":true}	The follow-up must deliver a new version.
Pass	`json_path`	{"kind":"json_path","path":"prior-download-preserved","expected":true}	The first delivered version remains retrievable.
Pass	`json_path`	{"kind":"json_path","path":"submitted-replies-consumed","expected":true}	Every submitted user message appears in a successfully completed native execution input.
Pass	`json_path`	{"kind":"json_path","path":"native-model-config","expected":true}	Persisted native execution inputs use the selected model; this does not claim provider-side model identity.
Pass	`json_path`	{"kind":"json_path","path":"native-terminal-contract","expected":true}	Successful runs retain the native terminal contract.
Pass	`json_path`	{"kind":"json_path","path":"tasks-done","expected":true}	Every story task must reach Done.
Pass	`json_path`	{"kind":"json_path","path":"settled","expected":true}	No active runs or scheduled recovery remain.
Pass	`json_path`	{"kind":"json_path","path":"native-runtime","expected":true}	All executions must prove native runtime and runner identity.
Pass	`json_path`	{"kind":"json_path","path":"successful-runs","expected":true}	Only the expected stop or process-loss outcome of an injected interruption is exempt.
Pass	`json_path`	{"kind":"json_path","path":"bounded-work","expected":true}	No more than twelve executions, including child and recovery turns.
Pass	`json_path`	{"kind":"json_path","path":"parent-owned-by-lead","expected":true}	A mentioned worker must not execute on the parent.
Pass	`json_path`	{"kind":"json_path","path":"no-pending-bookkeeping","expected":true}	No completion confirmation or unanswered interaction remains.

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 172390,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "602bdf5c-5ece-41c9-b960-f0b4fa0f8318",
        "usage": null
      },
      {
        "runId": "943c0987-79c5-400c-97cf-7ce47c0412bf",
        "usage": null
      }
    ]
  }
}

continuity-restart passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

TokensUnavailable in · Unavailable outUnavailable cached · 0/3 runs covered

LLM spendUnavailable0/3 runs provider-priced

ExecutionLocal · not metered1m 14s agent

grok-subscription-qualification.runner-acpx-grok-subscription.local.continuity-restart

Matchers and test context

Attempt: 1
Duration: 1m 59s
Agent runtime: 1m 14s
Runtime: native
Provider: acpx
Model: grok-4.7
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 74328,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "03ad5f89-5859-4cdc-873d-86329ee84a19",
        "usage": null
      },
      {
        "runId": "5a8ff462-e974-40a8-bb17-8ebc8b62017b",
        "usage": null
      },
      {
        "runId": "5944cc66-502a-4141-b32a-ceff4406584d",
        "usage": null
      }
    ]
  }
}

stop-new-resume passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

TokensUnavailable in · Unavailable outUnavailable cached · 0/4 runs covered

LLM spendUnavailable0/4 runs provider-priced

ExecutionLocal · not metered3m 42s agent

grok-subscription-qualification.runner-acpx-grok-subscription.local.stop-new-resume

Matchers and test context

Attempt: 1
Duration: 4m 10s
Agent runtime: 3m 42s
Runtime: native
Provider: acpx
Model: grok-4.7
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 4,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 221670,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "4f6f15ac-904b-4b5b-9701-61c07fbd8688",
        "usage": null
      },
      {
        "runId": "5084395f-df90-4f7f-bd71-e96df5155727",
        "usage": null
      },
      {
        "runId": "ca1f83d1-1b56-4975-9034-0eca3c096224",
        "usage": null
      },
      {
        "runId": "9d1613d4-9893-4ea3-973b-462f21db6a0a",
        "usage": null
      }
    ]
  }
}

Daytona warm reusable sandboxdaytona · remote

message-marker passed

Overall passed · 6/6 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (6)

Result	Check	Detail
Pass	`message_exact`	matched
Pass	`message_occurrences`	matched
Pass	`issue_status`	matched
Pass	`run_status`	matched
Pass	`runtime_mode`	matched
Pass	`environment`	matched

TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered

LLM spendUnavailable0/1 runs provider-priced

Execution$0.0106 est.2m 12s agent · 2m 23s lease

grok-subscription-qualification.runner-acpx-grok-subscription.daytona.message-marker

Matchers and test context

Attempt: 1
Duration: 2m 37s
Agent runtime: 2m 12s
Environment lease: 2m 23s
Runtime: native
Provider: acpx
Model: grok-4.7
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`message_exact`	{"kind":"message_exact","expected":"PAPERCLIP_E2E_OK_76faf034169d-1"}	matched
Pass	`message_occurrences`	{"kind":"message_occurrences","expected":"PAPERCLIP_E2E_OK_76faf034169d-1","count":1}	matched
Pass	`issue_status`	{"kind":"issue_status","expected":"done"}	matched
Pass	`run_status`	{"kind":"run_status","expected":"succeeded"}	matched
Pass	`runtime_mode`	{"kind":"runtime_mode","expected":"native"}	matched
Pass	`environment`	{"kind":"environment","expected":"daytona"}	matched

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "daytona",
      "agentRunDurationMs": 132459,
      "leaseDurationMs": 142603,
      "leaseCount": 1,
      "cpuCores": 4,
      "memoryGiB": 4,
      "diskGiB": 10,
      "estimatedListCostUsd": 0.0105954029,
      "costStatus": "estimated",
      "costSource": "daytona_public_list_price",
      "pricingAsOf": "2026-08-27",
      "pricingUrl": "https://www.daytona.io/pricing"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0.0105954029,
    "observedAndEstimatedCostUsd": 0.0105954029,
    "complete": false
  },
  "rawUsage": null
}

plan-revise-accept passed

Overall passed · 6/6 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (6)

Result	Check	Detail
Pass	`message_exact`	matched
Pass	`message_occurrences`	matched
Pass	`issue_status`	matched
Pass	`run_status`	matched
Pass	`runtime_mode`	matched
Pass	`environment`	matched

TokensUnavailable in · Unavailable outUnavailable cached · 0/3 runs covered

LLM spendUnavailable0/3 runs provider-priced

Execution$0.0251 est.5m 10s agent · 5m 38s lease

grok-subscription-qualification.runner-acpx-grok-subscription.daytona.plan-revise-accept

Matchers and test context

Attempt: 1
Duration: 5m 51s
Agent runtime: 5m 10s
Environment lease: 5m 38s
Runtime: native
Provider: acpx
Model: grok-4.7
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`message_exact`	{"kind":"message_exact","expected":"PAPERCLIP_E2E_PLAN_DONE_f3bfa373bd29-1"}	matched
Pass	`message_occurrences`	{"kind":"message_occurrences","expected":"PAPERCLIP_E2E_PLAN_DONE_f3bfa373bd29-1","count":1}	matched
Pass	`issue_status`	{"kind":"issue_status","expected":"done"}	matched
Pass	`run_status`	{"kind":"run_status","expected":"succeeded"}	matched
Pass	`runtime_mode`	{"kind":"runtime_mode","expected":"native"}	matched
Pass	`environment`	{"kind":"environment","expected":"daytona"}	matched

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "daytona",
      "agentRunDurationMs": 309912,
      "leaseDurationMs": 337700,
      "leaseCount": 3,
      "cpuCores": 4,
      "memoryGiB": 4,
      "diskGiB": 10,
      "estimatedListCostUsd": 0.02509111,
      "costStatus": "estimated",
      "costSource": "daytona_public_list_price",
      "pricingAsOf": "2026-08-27",
      "pricingUrl": "https://www.daytona.io/pricing"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0.02509111,
    "observedAndEstimatedCostUsd": 0.02509111,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "6264d71e-ec52-41e9-a3b7-8a8215d98a98",
        "usage": null
      },
      {
        "runId": "55d86b79-4519-41b9-92bb-701c3d109155",
        "usage": null
      },
      {
        "runId": "307b8e8f-dc06-4552-9e5e-971b76735ae8",
        "usage": null
      }
    ]
  }
}

ask-question passed

Overall passed · 6/6 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (6)

Result	Check	Detail
Pass	`message_exact`	matched
Pass	`message_occurrences`	matched
Pass	`issue_status`	matched
Pass	`run_status`	matched
Pass	`runtime_mode`	matched
Pass	`environment`	matched

TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered

LLM spendUnavailable0/1 runs provider-priced

Execution$0.0141 est.3m 23s agent · 3m 10s lease

grok-subscription-qualification.runner-acpx-grok-subscription.daytona.ask-question

Matchers and test context

Attempt: 2
Duration: 3m 48s
Agent runtime: 3m 23s
Environment lease: 3m 10s
Runtime: native
Provider: acpx
Model: grok-4.7
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`message_exact`	{"kind":"message_exact","expected":"E2E_ASK_12_d71729bc8f77-2"}	matched
Pass	`message_occurrences`	{"kind":"message_occurrences","expected":"E2E_ASK_12_d71729bc8f77-2","count":1}	matched
Pass	`issue_status`	{"kind":"issue_status","expected":"done"}	matched
Pass	`run_status`	{"kind":"run_status","expected":"succeeded"}	matched
Pass	`runtime_mode`	{"kind":"runtime_mode","expected":"native"}	matched
Pass	`environment`	{"kind":"environment","expected":"daytona"}	matched

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "daytona",
      "agentRunDurationMs": 202938,
      "leaseDurationMs": 189990,
      "leaseCount": 1,
      "cpuCores": 4,
      "memoryGiB": 4,
      "diskGiB": 10,
      "estimatedListCostUsd": 0.014116257,
      "costStatus": "estimated",
      "costSource": "daytona_public_list_price",
      "pricingAsOf": "2026-08-27",
      "pricingUrl": "https://www.daytona.io/pricing"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0.014116257,
    "observedAndEstimatedCostUsd": 0.014116257,
    "complete": false
  },
  "rawUsage": null
}

structured-question-resume passed

Overall passed · 6/6 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (6)

Result	Check	Detail
Pass	`message_exact`	matched
Pass	`message_occurrences`	matched
Pass	`issue_status`	matched
Pass	`run_status`	matched
Pass	`runtime_mode`	matched
Pass	`environment`	matched

TokensUnavailable in · Unavailable outUnavailable cached · 0/2 runs covered

LLM spendUnavailable0/2 runs provider-priced

Execution$0.0255 est.5m 37s agent · 5m 44s lease

grok-subscription-qualification.runner-acpx-grok-subscription.daytona.structured-question-resume

Matchers and test context

Attempt: 1
Duration: 6m 7s
Agent runtime: 5m 37s
Environment lease: 5m 44s
Runtime: native
Provider: acpx
Model: grok-4.7
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`message_exact`	{"kind":"message_exact","expected":"PAPERCLIP_E2E_QUESTION_DONE_052f0a733f4e-1"}	matched
Pass	`message_occurrences`	{"kind":"message_occurrences","expected":"PAPERCLIP_E2E_QUESTION_DONE_052f0a733f4e-1","count":1}	matched
Pass	`issue_status`	{"kind":"issue_status","expected":"done"}	matched
Pass	`run_status`	{"kind":"run_status","expected":"succeeded"}	matched
Pass	`runtime_mode`	{"kind":"runtime_mode","expected":"native"}	matched
Pass	`environment`	{"kind":"environment","expected":"daytona"}	matched

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "daytona",
      "agentRunDurationMs": 337276,
      "leaseDurationMs": 343874,
      "leaseCount": 2,
      "cpuCores": 4,
      "memoryGiB": 4,
      "diskGiB": 10,
      "estimatedListCostUsd": 0.025549838199999998,
      "costStatus": "estimated",
      "costSource": "daytona_public_list_price",
      "pricingAsOf": "2026-08-27",
      "pricingUrl": "https://www.daytona.io/pricing"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0.025549838199999998,
    "observedAndEstimatedCostUsd": 0.025549838199999998,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "f574208b-8350-465d-b7aa-0ce3ac4b3aea",
        "usage": null
      },
      {
        "runId": "c31b506d-d5a8-4d4d-881e-c46ac808d018",
        "usage": null
      }
    ]
  }
}

structured-question-restart-resume passed

Overall passed · 6/6 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (6)

Result	Check	Detail
Pass	`message_exact`	matched
Pass	`message_occurrences`	matched
Pass	`issue_status`	matched
Pass	`run_status`	matched
Pass	`runtime_mode`	matched
Pass	`environment`	matched

TokensUnavailable in · Unavailable outUnavailable cached · 0/2 runs covered

LLM spendUnavailable0/2 runs provider-priced

Execution$0.0183 est.3m 24s agent · 4m 7s lease

grok-subscription-qualification.runner-acpx-grok-subscription.daytona.structured-question-restart-resume

Matchers and test context

Attempt: 1
Duration: 4m 21s
Agent runtime: 3m 24s
Environment lease: 4m 7s
Runtime: native
Provider: acpx
Model: grok-4.7
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`message_exact`	{"kind":"message_exact","expected":"PAPERCLIP_E2E_QUESTION_DONE_950ff39c75ed-1"}	matched
Pass	`message_occurrences`	{"kind":"message_occurrences","expected":"PAPERCLIP_E2E_QUESTION_DONE_950ff39c75ed-1","count":1}	matched
Pass	`issue_status`	{"kind":"issue_status","expected":"done"}	matched
Pass	`run_status`	{"kind":"run_status","expected":"succeeded"}	matched
Pass	`runtime_mode`	{"kind":"runtime_mode","expected":"native"}	matched
Pass	`environment`	{"kind":"environment","expected":"daytona"}	matched

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "daytona",
      "agentRunDurationMs": 203693,
      "leaseDurationMs": 246876,
      "leaseCount": 2,
      "cpuCores": 4,
      "memoryGiB": 4,
      "diskGiB": 10,
      "estimatedListCostUsd": 0.0183428868,
      "costStatus": "estimated",
      "costSource": "daytona_public_list_price",
      "pricingAsOf": "2026-08-27",
      "pricingUrl": "https://www.daytona.io/pricing"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0.0183428868,
    "observedAndEstimatedCostUsd": 0.0183428868,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "e05a4303-a89f-4425-b1c5-b0dd1fa65697",
        "usage": null
      },
      {
        "runId": "3d8b964a-084a-4c5a-8f30-b825265f1e8b",
        "usage": null
      }
    ]
  }
}

build-revise passed

Overall passed · 40/40 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (40)

Result	Check	Detail
Pass	`initial.one-slugify-source`
Pass	`initial.readme-present`
Pass	`initial.project-tests-present`
Pass	`initial.base-0`	exit=0; expected='hello-world'; observed='hello-world\n'
Pass	`initial.base-1`	exit=0; expected='queue-ready'; observed='queue-ready\n'
Pass	`initial.base-2`	exit=0; expected='already-fine'; observed='already-fine\n'
Pass	`initial.base-3`	exit=0; expected='caf'; observed='caf\n'
Pass	`initial.base-4`	exit=0; expected=''; observed='\n'
Pass	`initial.base-5`	exit=0; expected='a-b-c'; observed='a-b-c\n'
Pass	`initial.base-6`	exit=0; expected='123'; observed='123\n'
Pass	`initial.base-7`	exit=0; expected=''; observed='\n'
Pass	`initial.importable-function`
Pass	`reply-4-stored-once`	A composer submission creates exactly one user message.
Pass	`revised.one-slugify-source`
Pass	`revised.readme-present`
Pass	`revised.project-tests-present`
Pass	`revised.base-0`	exit=0; expected='hello-world'; observed='hello-world\n'
Pass	`revised.base-1`	exit=0; expected='queue-ready'; observed='queue-ready\n'
Pass	`revised.base-2`	exit=0; expected='already-fine'; observed='already-fine\n'
Pass	`revised.base-3`	exit=0; expected='caf'; observed='caf\n'
Pass	`revised.base-4`	exit=0; expected=''; observed='\n'
Pass	`revised.base-5`	exit=0; expected='a-b-c'; observed='a-b-c\n'
Pass	`revised.base-6`	exit=0; expected='123'; observed='123\n'
Pass	`revised.base-7`	exit=0; expected=''; observed='\n'
Pass	`revised.importable-function`
Pass	`revised.separator-_`
Pass	`revised.separator--`
Pass	`revised.reject-invalid-separator`
Pass	`new-artifact-revision`	The follow-up must deliver a new version.
Pass	`prior-download-preserved`	The first delivered version remains retrievable.
Pass	`submitted-replies-consumed`	Every submitted user message appears in a successfully completed native execution input.
Pass	`native-model-config`	Persisted native execution inputs use the selected model; this does not claim provider-side model identity.
Pass	`native-terminal-contract`	Successful runs retain the native terminal contract.
Pass	`tasks-done`	Every story task must reach Done.
Pass	`settled`	No active runs or scheduled recovery remain.
Pass	`native-runtime`	All executions must prove native runtime and runner identity.
Pass	`successful-runs`	Only the expected stop or process-loss outcome of an injected interruption is exempt.
Pass	`bounded-work`	No more than twelve executions, including child and recovery turns.
Pass	`parent-owned-by-lead`	A mentioned worker must not execute on the parent.
Pass	`no-pending-bookkeeping`	No completion confirmation or unanswered interaction remains.

TokensUnavailable in · Unavailable outUnavailable cached · 0/2 runs covered

LLM spendUnavailable0/2 runs provider-priced

Execution$0.0277 est.5m 14s agent · 6m 13s lease

grok-subscription-qualification.runner-acpx-grok-subscription.daytona.build-revise

Matchers and test context

Attempt: 1
Duration: 6m 29s
Agent runtime: 5m 14s
Environment lease: 6m 13s
Runtime: native
Provider: acpx
Model: grok-4.7
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`json_path`	{"kind":"json_path","path":"initial.one-slugify-source","expected":true}
Pass	`json_path`	{"kind":"json_path","path":"initial.readme-present","expected":true}
Pass	`json_path`	{"kind":"json_path","path":"initial.project-tests-present","expected":true}
Pass	`json_path`	{"kind":"json_path","path":"initial.base-0","expected":true}	exit=0; expected='hello-world'; observed='hello-world\n'
Pass	`json_path`	{"kind":"json_path","path":"initial.base-1","expected":true}	exit=0; expected='queue-ready'; observed='queue-ready\n'
Pass	`json_path`	{"kind":"json_path","path":"initial.base-2","expected":true}	exit=0; expected='already-fine'; observed='already-fine\n'
Pass	`json_path`	{"kind":"json_path","path":"initial.base-3","expected":true}	exit=0; expected='caf'; observed='caf\n'
Pass	`json_path`	{"kind":"json_path","path":"initial.base-4","expected":true}	exit=0; expected=''; observed='\n'
Pass	`json_path`	{"kind":"json_path","path":"initial.base-5","expected":true}	exit=0; expected='a-b-c'; observed='a-b-c\n'
Pass	`json_path`	{"kind":"json_path","path":"initial.base-6","expected":true}	exit=0; expected='123'; observed='123\n'
Pass	`json_path`	{"kind":"json_path","path":"initial.base-7","expected":true}	exit=0; expected=''; observed='\n'
Pass	`json_path`	{"kind":"json_path","path":"initial.importable-function","expected":true}
Pass	`json_path`	{"kind":"json_path","path":"reply-4-stored-once","expected":true}	A composer submission creates exactly one user message.
Pass	`json_path`	{"kind":"json_path","path":"revised.one-slugify-source","expected":true}
Pass	`json_path`	{"kind":"json_path","path":"revised.readme-present","expected":true}
Pass	`json_path`	{"kind":"json_path","path":"revised.project-tests-present","expected":true}
Pass	`json_path`	{"kind":"json_path","path":"revised.base-0","expected":true}	exit=0; expected='hello-world'; observed='hello-world\n'
Pass	`json_path`	{"kind":"json_path","path":"revised.base-1","expected":true}	exit=0; expected='queue-ready'; observed='queue-ready\n'
Pass	`json_path`	{"kind":"json_path","path":"revised.base-2","expected":true}	exit=0; expected='already-fine'; observed='already-fine\n'
Pass	`json_path`	{"kind":"json_path","path":"revised.base-3","expected":true}	exit=0; expected='caf'; observed='caf\n'
Pass	`json_path`	{"kind":"json_path","path":"revised.base-4","expected":true}	exit=0; expected=''; observed='\n'
Pass	`json_path`	{"kind":"json_path","path":"revised.base-5","expected":true}	exit=0; expected='a-b-c'; observed='a-b-c\n'
Pass	`json_path`	{"kind":"json_path","path":"revised.base-6","expected":true}	exit=0; expected='123'; observed='123\n'
Pass	`json_path`	{"kind":"json_path","path":"revised.base-7","expected":true}	exit=0; expected=''; observed='\n'
Pass	`json_path`	{"kind":"json_path","path":"revised.importable-function","expected":true}
Pass	`json_path`	{"kind":"json_path","path":"revised.separator-_","expected":true}
Pass	`json_path`	{"kind":"json_path","path":"revised.separator--","expected":true}
Pass	`json_path`	{"kind":"json_path","path":"revised.reject-invalid-separator","expected":true}
Pass	`json_path`	{"kind":"json_path","path":"new-artifact-revision","expected":true}	The follow-up must deliver a new version.
Pass	`json_path`	{"kind":"json_path","path":"prior-download-preserved","expected":true}	The first delivered version remains retrievable.
Pass	`json_path`	{"kind":"json_path","path":"submitted-replies-consumed","expected":true}	Every submitted user message appears in a successfully completed native execution input.
Pass	`json_path`	{"kind":"json_path","path":"native-model-config","expected":true}	Persisted native execution inputs use the selected model; this does not claim provider-side model identity.
Pass	`json_path`	{"kind":"json_path","path":"native-terminal-contract","expected":true}	Successful runs retain the native terminal contract.
Pass	`json_path`	{"kind":"json_path","path":"tasks-done","expected":true}	Every story task must reach Done.
Pass	`json_path`	{"kind":"json_path","path":"settled","expected":true}	No active runs or scheduled recovery remain.
Pass	`json_path`	{"kind":"json_path","path":"native-runtime","expected":true}	All executions must prove native runtime and runner identity.
Pass	`json_path`	{"kind":"json_path","path":"successful-runs","expected":true}	Only the expected stop or process-loss outcome of an injected interruption is exempt.
Pass	`json_path`	{"kind":"json_path","path":"bounded-work","expected":true}	No more than twelve executions, including child and recovery turns.
Pass	`json_path`	{"kind":"json_path","path":"parent-owned-by-lead","expected":true}	A mentioned worker must not execute on the parent.
Pass	`json_path`	{"kind":"json_path","path":"no-pending-bookkeeping","expected":true}	No completion confirmation or unanswered interaction remains.

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "daytona",
      "agentRunDurationMs": 314057,
      "leaseDurationMs": 373179,
      "leaseCount": 2,
      "cpuCores": 4,
      "memoryGiB": 4,
      "diskGiB": 10,
      "estimatedListCostUsd": 0.0277271997,
      "costStatus": "estimated",
      "costSource": "daytona_public_list_price",
      "pricingAsOf": "2026-08-27",
      "pricingUrl": "https://www.daytona.io/pricing"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0.0277271997,
    "observedAndEstimatedCostUsd": 0.0277271997,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "08580f7a-204f-4581-815b-fe914fe09147",
        "usage": null
      },
      {
        "runId": "f85fe7e0-864d-49b0-9b40-cc1d6a275666",
        "usage": null
      }
    ]
  }
}

continuity-restart failed

Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded

TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered

LLM spendUnavailable0/1 runs provider-priced

ExecutionCost unavailable0ms agent

grok-subscription-qualification.runner-acpx-grok-subscription.daytona.continuity-restart

Matchers and test context

Attempt: 0
Duration: 0ms
Agent runtime: 0ms
Runtime: native
Provider: unknown
Model: unknown

No result artifact was uploaded

No matcher result was recorded.

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "daytona",
      "agentRunDurationMs": 0,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "unavailable",
      "costSource": "provider_cost_unavailable"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null
}

stop-new-resume passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

TokensUnavailable in · Unavailable outUnavailable cached · 0/4 runs covered

LLM spendUnavailable0/4 runs provider-priced

Execution$0.0190 est.3m 51s agent · 4m 16s lease

grok-subscription-qualification.runner-acpx-grok-subscription.daytona.stop-new-resume

Matchers and test context

Attempt: 1
Duration: 4m 31s
Agent runtime: 3m 51s
Environment lease: 4m 16s
Runtime: native
Provider: acpx
Model: grok-4.7
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 4,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "daytona",
      "agentRunDurationMs": 231484,
      "leaseDurationMs": 256161,
      "leaseCount": 3,
      "cpuCores": 4,
      "memoryGiB": 4,
      "diskGiB": 10,
      "estimatedListCostUsd": 0.0190327623,
      "costStatus": "estimated",
      "costSource": "daytona_public_list_price",
      "pricingAsOf": "2026-08-27",
      "pricingUrl": "https://www.daytona.io/pricing"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0.0190327623,
    "observedAndEstimatedCostUsd": 0.0190327623,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "b2268654-0b5d-481a-98af-604ac2db672e",
        "usage": null
      },
      {
        "runId": "1a1bbb2a-1e09-4ccd-844c-a44222857107",
        "usage": null
      },
      {
        "runId": "5c39fe5b-4b38-4f30-b75d-f857c2e0a43d",
        "usage": null
      },
      {
        "runId": "9837bc8e-fcdc-4ad0-9c4b-49540718f3e8",
        "usage": null
      }
    ]
  }
}

Task continuation

Everyday Paperclip Work

First-task onboarding

Persistent Agent Chat

Agent Chat Recovery and Coordination

Agent Chat Setup and Interruptions

Agent Chat Remaining Qualification

Core Runner Compatibility

Local Session Integrity

OpenRouter Model Breadth

Daytona Warm Continuity

grok-subscription-qualification

Campaign trends