Full-stack acceptance campaign

Runner Full-Stack E2E

A browser-verified matrix of runner profiles, execution environments, and deterministic task contracts. Declared PNG screenshots and sanitized structured evidence are retained with every published campaign; additional diagnostic evidence remains in the access-controlled workflow artifact.

0/132Passed

132Failed

0msTest time

0Input tokens

0Output tokens

0Cached tokens

$0.000000LLM reported subtotal

$0.000000Daytona list estimate

0msAgent execution time

0msDaytona lease time

0/132Runs provider-priced

Model spend is the provider-reported subtotal; unpriced or unavailable runs are excluded, never counted as free. Daytona runtime is a public-list-price estimate from captured lease time and pinned resources, before credits, discounts, storage allowance, or invoice adjustments. Local execution has no external runtime meter.

Search tests Agent profile Environment Suite Status

Test suite

Task continuation

Human direction, approval boundaries, untrusted evidence, and completed actions across turns.

Pass rate0.0%0/22 passed

Tokens00 input · 0 output

Cost$0.000000reported LLM + runtime estimate

Agent time0ms0ms lease

Execution0/220 retries · cleanup failed

Configuration matrix4 profiles · 1 environments · 22 selected

Agent profile	Isolated locallocal · local
Legacy Codexlegacycodex · gpt-5.6-sol	Isolated locallocal · local answer updates scope failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `continuation.legacy-codex.local.answer-updates-scope` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } clarification not approval failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `continuation.legacy-codex.local.clarification-not-approval` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } revision preserves approval failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `continuation.legacy-codex.local.revision-preserves-approval` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } untrusted evidence failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `continuation.legacy-codex.local.untrusted-evidence` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } completed action resume failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `continuation.legacy-codex.local.completed-action-resume` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }
Legacy Claudelegacyclaude · claude-sonnet-4-6	Isolated locallocal · local answer updates scope failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `continuation.legacy-claude.local.answer-updates-scope` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } clarification not approval failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `continuation.legacy-claude.local.clarification-not-approval` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } revision preserves approval failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `continuation.legacy-claude.local.revision-preserves-approval` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } untrusted evidence failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `continuation.legacy-claude.local.untrusted-evidence` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } completed action resume failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `continuation.legacy-claude.local.completed-action-resume` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local answer updates scope failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `continuation.runner-codex.local.answer-updates-scope` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } clarification not approval failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `continuation.runner-codex.local.clarification-not-approval` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } revision preserves approval failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `continuation.runner-codex.local.revision-preserves-approval` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } untrusted evidence failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `continuation.runner-codex.local.untrusted-evidence` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } completed action resume failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `continuation.runner-codex.local.completed-action-resume` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } question tool documentation failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `continuation.runner-codex.local.question-tool-documentation` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local answer updates scope failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `continuation.runner-acpx-claude.local.answer-updates-scope` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } clarification not approval failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `continuation.runner-acpx-claude.local.clarification-not-approval` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } revision preserves approval failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `continuation.runner-acpx-claude.local.revision-preserves-approval` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } untrusted evidence failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `continuation.runner-acpx-claude.local.untrusted-evidence` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } completed action resume failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `continuation.runner-acpx-claude.local.completed-action-resume` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } question tool documentation failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `continuation.runner-acpx-claude.local.question-tool-documentation` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }

Test suite

Everyday Paperclip Work

Real user requests, useful downloaded work, and durable continuation using production instructions.

Configuration matrix3 profiles · 2 environments · 0 selected

Agent profile	Isolated locallocal · local	Daytona warm reusable sandboxdaytona · remote
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Build, download, and revise a project not selected `everyday-workflows.runner-codex.local.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-codex.local.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Delegate work through an agent review handoff not selected `everyday-workflows.runner-codex.local.agent-review-handoff` Matchers and test context Not selected No matcher result was recorded. Hire one teammate, then reuse that agent not selected `everyday-workflows.runner-codex.local.hire-reuse` Matchers and test context Not selected No matcher result was recorded. Use a connection after approval not selected `everyday-workflows.runner-codex.local.service-approve` Matchers and test context Not selected No matcher result was recorded. Respect a declined tool action not selected `everyday-workflows.runner-codex.local.service-decline` Matchers and test context Not selected No matcher result was recorded. Respect Not now on a new connection not selected `everyday-workflows.runner-codex.local.connection-decline` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-codex.local.recover-controller` Matchers and test context Not selected No matcher result was recorded. Stop a task and send a new direction once not selected `everyday-workflows.runner-codex.local.stop-redirect` Matchers and test context Not selected No matcher result was recorded. Create and edit a company skill not selected `everyday-workflows.runner-codex.local.create-skill-studio` Matchers and test context Not selected No matcher result was recorded.	Daytona warm reusable sandboxdaytona · remote Build, download, and revise a project not selected `everyday-workflows.runner-codex.daytona.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-codex.daytona.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-codex.daytona.recover-controller` Matchers and test context Not selected No matcher result was recorded. Create and edit a company skill not selected `everyday-workflows.runner-codex.daytona.create-skill-studio` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Build, download, and revise a project not selected `everyday-workflows.runner-acpx-claude.local.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-acpx-claude.local.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Delegate work through an agent review handoff not selected `everyday-workflows.runner-acpx-claude.local.agent-review-handoff` Matchers and test context Not selected No matcher result was recorded. Hire one teammate, then reuse that agent not selected `everyday-workflows.runner-acpx-claude.local.hire-reuse` Matchers and test context Not selected No matcher result was recorded. Use a connection after approval not selected `everyday-workflows.runner-acpx-claude.local.service-approve` Matchers and test context Not selected No matcher result was recorded. Respect a declined tool action not selected `everyday-workflows.runner-acpx-claude.local.service-decline` Matchers and test context Not selected No matcher result was recorded. Respect Not now on a new connection not selected `everyday-workflows.runner-acpx-claude.local.connection-decline` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-acpx-claude.local.recover-controller` Matchers and test context Not selected No matcher result was recorded. Stop a task and send a new direction once not selected `everyday-workflows.runner-acpx-claude.local.stop-redirect` Matchers and test context Not selected No matcher result was recorded. Create and edit a company skill not selected `everyday-workflows.runner-acpx-claude.local.create-skill-studio` Matchers and test context Not selected No matcher result was recorded.	Daytona warm reusable sandboxdaytona · remote Build, download, and revise a project not selected `everyday-workflows.runner-acpx-claude.daytona.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-acpx-claude.daytona.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-acpx-claude.daytona.recover-controller` Matchers and test context Not selected No matcher result was recorded. Create and edit a company skill not selected `everyday-workflows.runner-acpx-claude.daytona.create-skill-studio` Matchers and test context Not selected No matcher result was recorded.
Runner Codex Mininativecodex · gpt-5.4-mini	Isolated locallocal · local Build, download, and revise a project not selected `everyday-workflows.runner-codex-mini.local.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-codex-mini.local.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Delegate work through an agent review handoff not selected `everyday-workflows.runner-codex-mini.local.agent-review-handoff` Matchers and test context Not selected No matcher result was recorded. Hire one teammate, then reuse that agent not selected `everyday-workflows.runner-codex-mini.local.hire-reuse` Matchers and test context Not selected No matcher result was recorded. Use a connection after approval not selected `everyday-workflows.runner-codex-mini.local.service-approve` Matchers and test context Not selected No matcher result was recorded. Respect a declined tool action not selected `everyday-workflows.runner-codex-mini.local.service-decline` Matchers and test context Not selected No matcher result was recorded. Respect Not now on a new connection not selected `everyday-workflows.runner-codex-mini.local.connection-decline` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-codex-mini.local.recover-controller` Matchers and test context Not selected No matcher result was recorded. Stop a task and send a new direction once not selected `everyday-workflows.runner-codex-mini.local.stop-redirect` Matchers and test context Not selected No matcher result was recorded. Create and edit a company skill not selected `everyday-workflows.runner-codex-mini.local.create-skill-studio` Matchers and test context Not selected No matcher result was recorded.	Daytona warm reusable sandboxdaytona · remote

Test suite

First-task onboarding

Production onboarding, first replies, approval, and durable task execution.

Pass rate0.0%0/52 passed

Tokens00 input · 0 output

Cost$0.000000reported LLM + runtime estimate

Agent time0ms0ms lease

Execution0/520 retries · cleanup failed

Configuration matrix4 profiles · 1 environments · 52 selected

Agent profile	Isolated locallocal · local
Legacy Codexlegacycodex · Production onboarding default	Isolated locallocal · local Interview: first response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-codex.local.interview-first-response` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Clear task: first response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-codex.local.clear-task-first-response` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Ambiguous task: first response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-codex.local.ambiguous-task-first-response` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Opening card replaced by a message failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-codex.local.plain-message-first-response` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Explicit plan: first response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-codex.local.plan-first-response` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Other tasks do not inherit onboarding policy failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-codex.local.ordinary-task-control` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Interview, plan, and acceptance failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-codex.local.interview-plan-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Subtask accepted through a card failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-codex.local.task-card-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Accept a proposal while its agent is still running failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-codex.local.accept-while-running` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Subtask accepted in conversation failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-codex.local.task-reply-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Clarification, proposal, and acceptance failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-codex.local.clarify-propose-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Revise scope before accepting failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-codex.local.revise-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Decline proposed work failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-codex.local.reject-no-execution` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }
Legacy Claudelegacyclaude · Production onboarding default	Isolated locallocal · local Interview: first response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-claude.local.interview-first-response` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Clear task: first response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-claude.local.clear-task-first-response` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Ambiguous task: first response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-claude.local.ambiguous-task-first-response` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Opening card replaced by a message failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-claude.local.plain-message-first-response` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Explicit plan: first response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-claude.local.plan-first-response` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Other tasks do not inherit onboarding policy failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-claude.local.ordinary-task-control` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Interview, plan, and acceptance failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-claude.local.interview-plan-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Subtask accepted through a card failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-claude.local.task-card-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Accept a proposal while its agent is still running failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-claude.local.accept-while-running` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Subtask accepted in conversation failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-claude.local.task-reply-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Clarification, proposal, and acceptance failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-claude.local.clarify-propose-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Revise scope before accepting failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-claude.local.revise-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Decline proposed work failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.legacy-claude.local.reject-no-execution` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }
Runner Codexnativecodex · Production onboarding default	Isolated locallocal · local Interview: first response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-codex.local.interview-first-response` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Clear task: first response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-codex.local.clear-task-first-response` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Ambiguous task: first response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-codex.local.ambiguous-task-first-response` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Opening card replaced by a message failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-codex.local.plain-message-first-response` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Explicit plan: first response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-codex.local.plan-first-response` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Other tasks do not inherit onboarding policy failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-codex.local.ordinary-task-control` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Interview, plan, and acceptance failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-codex.local.interview-plan-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Subtask accepted through a card failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-codex.local.task-card-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Accept a proposal while its agent is still running failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-codex.local.accept-while-running` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Subtask accepted in conversation failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-codex.local.task-reply-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Clarification, proposal, and acceptance failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-codex.local.clarify-propose-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Revise scope before accepting failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-codex.local.revise-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Decline proposed work failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-codex.local.reject-no-execution` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }
Runner ACPX Claudenativeacpx · Production onboarding default	Isolated locallocal · local Interview: first response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-acpx-claude.local.interview-first-response` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Clear task: first response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-acpx-claude.local.clear-task-first-response` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Ambiguous task: first response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-acpx-claude.local.ambiguous-task-first-response` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Opening card replaced by a message failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-acpx-claude.local.plain-message-first-response` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Explicit plan: first response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-acpx-claude.local.plan-first-response` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Other tasks do not inherit onboarding policy failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-acpx-claude.local.ordinary-task-control` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Interview, plan, and acceptance failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-acpx-claude.local.interview-plan-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Subtask accepted through a card failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-acpx-claude.local.task-card-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Accept a proposal while its agent is still running failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-acpx-claude.local.accept-while-running` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Subtask accepted in conversation failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-acpx-claude.local.task-reply-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Clarification, proposal, and acceptance failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-acpx-claude.local.clarify-propose-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Revise scope before accepting failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-acpx-claude.local.revise-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Decline proposed work failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `first-task.runner-acpx-claude.local.reject-no-execution` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }

Test suite

Persistent Agent Chat

Task-backed conversations, session resets, and project plan handoff.

Pass rate0.0%0/24 passed

Tokens00 input · 0 output

Cost$0.000000reported LLM + runtime estimate

Agent time0ms0ms lease

Execution0/240 retries · cleanup failed

Configuration matrix4 profiles · 1 environments · 24 selected

Agent profile	Isolated locallocal · local
Legacy Codexlegacycodex · gpt-5.6-sol	Isolated locallocal · local Conversation continuity across restart failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.legacy-codex.local.continuity-restart` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Fresh context within preserved history failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.legacy-codex.local.new-session` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Stop, reset, and resume failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.legacy-codex.local.stop-new-resume` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Draft, revise, approve, and hand off a plan failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.legacy-codex.local.plan-handoff` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Clarify and reuse an existing project failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.legacy-codex.local.clarify-reuse` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Create a project with multiple repository URLs failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.legacy-codex.local.multi-repository` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }
Legacy Claudelegacyclaude · claude-sonnet-4-6	Isolated locallocal · local Conversation continuity across restart failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.legacy-claude.local.continuity-restart` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Fresh context within preserved history failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.legacy-claude.local.new-session` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Stop, reset, and resume failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.legacy-claude.local.stop-new-resume` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Draft, revise, approve, and hand off a plan failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.legacy-claude.local.plan-handoff` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Clarify and reuse an existing project failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.legacy-claude.local.clarify-reuse` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Create a project with multiple repository URLs failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.legacy-claude.local.multi-repository` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Conversation continuity across restart failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.runner-codex.local.continuity-restart` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Fresh context within preserved history failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.runner-codex.local.new-session` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Stop, reset, and resume failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.runner-codex.local.stop-new-resume` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Draft, revise, approve, and hand off a plan failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.runner-codex.local.plan-handoff` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Clarify and reuse an existing project failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.runner-codex.local.clarify-reuse` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Create a project with multiple repository URLs failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.runner-codex.local.multi-repository` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Conversation continuity across restart failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.runner-acpx-claude.local.continuity-restart` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Fresh context within preserved history failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.runner-acpx-claude.local.new-session` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Stop, reset, and resume failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.runner-acpx-claude.local.stop-new-resume` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Draft, revise, approve, and hand off a plan failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.runner-acpx-claude.local.plan-handoff` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Clarify and reuse an existing project failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.runner-acpx-claude.local.clarify-reuse` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Create a project with multiple repository URLs failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `agent-chat.runner-acpx-claude.local.multi-repository` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }

Test suite

Core Runner Compatibility

Major provider, runtime generation, and execution-environment compatibility.

Pass rate0.0%0/24 passed

Tokens00 input · 0 output

Cost$0.000000reported LLM + runtime estimate

Agent time0ms0ms lease

Execution0/240 retries · cleanup failed

Configuration matrix7 profiles · 2 environments · 24 selected

Agent profile	Isolated locallocal · local	Daytona sandboxdaytona · remote
Legacy Codexlegacycodex · gpt-5.6-sol	Isolated locallocal · local Basic response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `core-compatibility.legacy-codex.local.message-marker` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Plan, revise, accept, implement failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `core-compatibility.legacy-codex.local.plan-revise-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Ask mode question failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `core-compatibility.legacy-codex.local.ask-question` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }	Daytona sandboxdaytona · remote Basic response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionCost unavailable0ms agent `core-compatibility.legacy-codex.daytona.message-marker` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "daytona", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "unavailable", "costSource": "provider_cost_unavailable" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Plan, revise, accept, implement failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionCost unavailable0ms agent `core-compatibility.legacy-codex.daytona.plan-revise-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "daytona", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "unavailable", "costSource": "provider_cost_unavailable" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Ask mode question failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionCost unavailable0ms agent `core-compatibility.legacy-codex.daytona.ask-question` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "daytona", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "unavailable", "costSource": "provider_cost_unavailable" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }
Legacy Claudelegacyclaude · claude-sonnet-4-6	Isolated locallocal · local Basic response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `core-compatibility.legacy-claude.local.message-marker` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Plan, revise, accept, implement failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `core-compatibility.legacy-claude.local.plan-revise-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Ask mode question failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `core-compatibility.legacy-claude.local.ask-question` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }	Daytona sandboxdaytona · remote Basic response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionCost unavailable0ms agent `core-compatibility.legacy-claude.daytona.message-marker` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "daytona", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "unavailable", "costSource": "provider_cost_unavailable" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Plan, revise, accept, implement failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionCost unavailable0ms agent `core-compatibility.legacy-claude.daytona.plan-revise-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "daytona", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "unavailable", "costSource": "provider_cost_unavailable" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Ask mode question failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionCost unavailable0ms agent `core-compatibility.legacy-claude.daytona.ask-question` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "daytona", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "unavailable", "costSource": "provider_cost_unavailable" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }
Legacy OpenCodelegacyopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Basic response not selected `core-compatibility.legacy-opencode.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-opencode.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-opencode.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.legacy-opencode.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-opencode.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-opencode.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Basic response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `core-compatibility.runner-codex.local.message-marker` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Plan, revise, accept, implement failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `core-compatibility.runner-codex.local.plan-revise-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Ask mode question failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `core-compatibility.runner-codex.local.ask-question` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }	Daytona sandboxdaytona · remote Basic response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionCost unavailable0ms agent `core-compatibility.runner-codex.daytona.message-marker` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "daytona", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "unavailable", "costSource": "provider_cost_unavailable" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Plan, revise, accept, implement failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionCost unavailable0ms agent `core-compatibility.runner-codex.daytona.plan-revise-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "daytona", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "unavailable", "costSource": "provider_cost_unavailable" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Ask mode question failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionCost unavailable0ms agent `core-compatibility.runner-codex.daytona.ask-question` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "daytona", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "unavailable", "costSource": "provider_cost_unavailable" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }
Runner OpenCodenativeopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Basic response not selected `core-compatibility.runner-opencode.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-opencode.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-opencode.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.runner-opencode.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-opencode.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-opencode.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Basic response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `core-compatibility.runner-acpx-claude.local.message-marker` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Plan, revise, accept, implement failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `core-compatibility.runner-acpx-claude.local.plan-revise-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Ask mode question failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `core-compatibility.runner-acpx-claude.local.ask-question` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }	Daytona sandboxdaytona · remote Basic response failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionCost unavailable0ms agent `core-compatibility.runner-acpx-claude.daytona.message-marker` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "daytona", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "unavailable", "costSource": "provider_cost_unavailable" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Plan, revise, accept, implement failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionCost unavailable0ms agent `core-compatibility.runner-acpx-claude.daytona.plan-revise-accept` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "daytona", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "unavailable", "costSource": "provider_cost_unavailable" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Ask mode question failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionCost unavailable0ms agent `core-compatibility.runner-acpx-claude.daytona.ask-question` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "daytona", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "unavailable", "costSource": "provider_cost_unavailable" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }
Runner ACPX Codexnativeacpx · gpt-5.6-sol	Isolated locallocal · local Basic response not selected `core-compatibility.runner-acpx-codex.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-acpx-codex.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-acpx-codex.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.runner-acpx-codex.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-acpx-codex.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-acpx-codex.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.

Test suite

Local Session Integrity

Structured interaction and continuation qualification for every supported local profile.

Pass rate0.0%0/8 passed

Tokens00 input · 0 output

Cost$0.000000reported LLM + runtime estimate

Agent time0ms0ms lease

Execution0/80 retries · cleanup failed

Configuration matrix7 profiles · 1 environments · 8 selected

Agent profile	Isolated locallocal · local
Legacy Codexlegacycodex · gpt-5.6-sol	Isolated locallocal · local Structured question, answer, resume failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `local-session-integrity.legacy-codex.local.structured-question-resume` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Structured question, server restart, answer, resume failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `local-session-integrity.legacy-codex.local.structured-question-restart-resume` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }
Legacy Claudelegacyclaude · claude-sonnet-4-6	Isolated locallocal · local Structured question, answer, resume failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `local-session-integrity.legacy-claude.local.structured-question-resume` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Structured question, server restart, answer, resume failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `local-session-integrity.legacy-claude.local.structured-question-restart-resume` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider claude Model claude-sonnet-4-6 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }
Legacy OpenCodelegacyopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.legacy-opencode.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.legacy-opencode.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Structured question, answer, resume failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `local-session-integrity.runner-codex.local.structured-question-resume` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Structured question, server restart, answer, resume failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `local-session-integrity.runner-codex.local.structured-question-restart-resume` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }
Runner OpenCodenativeopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.runner-opencode.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.runner-opencode.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Structured question, answer, resume failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `local-session-integrity.runner-acpx-claude.local.structured-question-resume` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null } Structured question, server restart, answer, resume failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionLocal · not metered0ms agent `local-session-integrity.runner-acpx-claude.local.structured-question-restart-resume` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider acpx Model claude-sonnet-5 No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "local", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "not_metered", "costSource": "local_not_metered" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }
Runner ACPX Codexnativeacpx · gpt-5.6-sol	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.runner-acpx-codex.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.runner-acpx-codex.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.

Test suite

OpenRouter Model Breadth

Weekly-ranked tool-capable OpenRouter models through native OpenCode on isolated local workspaces.

Configuration matrix4 profiles · 1 environments · 0 selected

Agent profile	Isolated locallocal · local
#1 DeepSeek V4 Flash 0731nativeopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-deepseek-deepseek-v4-flash-0731.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-deepseek-deepseek-v4-flash-0731.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded.
#3 Tencent HY 3nativeopencode · openrouter/tencent/hy3	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-tencent-hy3.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-tencent-hy3.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded.
#4 Nemotron 3 Ultra 550B A55B (free)nativeopencode · openrouter/nvidia/nemotron-3-ultra-550b-a55b:free	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded. Plan, approve, complete not selected `openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.plan-approve-complete` Matchers and test context Not selected No matcher result was recorded.
#5 GPT-5.6 Lunanativeopencode · openrouter/openai/gpt-5.6-luna	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded. Plan, approve, complete not selected `openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.plan-approve-complete` Matchers and test context Not selected No matcher result was recorded.

Test suite

Daytona Warm Continuity

Three browser-driven turns on one reusable Daytona sandbox for legacy and native Codex.

Pass rate0.0%0/2 passed

Tokens00 input · 0 output

Cost$0.000000reported LLM + runtime estimate

Agent time0ms0ms lease

Execution0/20 retries · cleanup failed

Configuration matrix2 profiles · 1 environments · 2 selected

Agent profile Daytona warm reusable sandboxdaytona · remote

Agent profile	Daytona warm reusable sandboxdaytona · remote
Legacy Codexlegacycodex · gpt-5.6-sol	Daytona warm reusable sandboxdaytona · remote Warm three-turn workspace continuity failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionCost unavailable0ms agent `daytona-warm-continuity.legacy-codex.daytona.warm-three-turn` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime legacy Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "daytona", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "unavailable", "costSource": "provider_cost_unavailable" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }
Runner Codexnativecodex · gpt-5.6-sol	Daytona warm reusable sandboxdaytona · remote Warm three-turn workspace continuity failed Overall failed · No behavioral checks recorded permanent infrastructure No result artifact was uploaded Tokens0 in · 0 out0 cached · 0/1 runs covered LLM spendunavailable0/1 runs provider-priced ExecutionCost unavailable0ms agent `daytona-warm-continuity.runner-codex.daytona.warm-three-turn` Matchers and test context Attempt 0 Duration 0ms Agent runtime 0ms Runtime native Provider codex Model gpt-5.6-sol No result artifact was uploaded No matcher result was recorded. Usage and billing metadata { "billing": { "llm": { "runCount": 1, "runsWithTokenUsage": 0, "runsWithReportedCost": 0, "inputTokens": 0, "outputTokens": 0, "cachedInputTokens": 0, "totalTokens": 0, "reportedCostUsd": 0, "costStatus": "unavailable" }, "runtime": { "provider": "daytona", "agentRunDurationMs": 0, "leaseDurationMs": null, "leaseCount": 0, "costStatus": "unavailable", "costSource": "provider_cost_unavailable" }, "reportedCostUsd": 0, "estimatedRuntimeCostUsd": 0, "observedAndEstimatedCostUsd": 0, "complete": false }, "rawUsage": null }

Legacy Codexlegacycodex · gpt-5.6-sol

Daytona warm reusable sandboxdaytona · remote

Warm three-turn workspace continuity failed

Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded

Tokens0 in · 0 out0 cached · 0/1 runs covered

LLM spendunavailable0/1 runs provider-priced

ExecutionCost unavailable0ms agent

daytona-warm-continuity.legacy-codex.daytona.warm-three-turn

Matchers and test context

Attempt: 0
Duration: 0ms
Agent runtime: 0ms
Runtime: legacy
Provider: codex
Model: gpt-5.6-sol

No result artifact was uploaded

No matcher result was recorded.

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "daytona",
      "agentRunDurationMs": 0,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "unavailable",
      "costSource": "provider_cost_unavailable"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null
}

Runner Codexnativecodex · gpt-5.6-sol

Daytona warm reusable sandboxdaytona · remote

Warm three-turn workspace continuity failed

Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded

Tokens0 in · 0 out0 cached · 0/1 runs covered

LLM spendunavailable0/1 runs provider-priced

ExecutionCost unavailable0ms agent

daytona-warm-continuity.runner-codex.daytona.warm-three-turn

Matchers and test context

Attempt: 0
Duration: 0ms
Agent runtime: 0ms
Runtime: native
Provider: codex
Model: gpt-5.6-sol

No result artifact was uploaded

No matcher result was recorded.

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "daytona",
      "agentRunDurationMs": 0,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "unavailable",
      "costSource": "provider_cost_unavailable"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null
}

History

Campaign trends

No historical campaigns have been published yet.