Full-stack acceptance campaign

Runner Full-Stack E2E

Results across runner profiles and execution environments. Declared PNG screenshots and normalized results are retained with every published campaign; additional diagnostic evidence remains in the access-controlled workflow artifact.

2026-10-27T13:51:34.206Z

17/158Passed
141Failed
277m 21sSummed attempt time
Campaign usage and spend
0 / 0Complaints / suggestions · retained attempts0 distinct items · 159 attempts with incomplete collection · 0 failed submissions · 0 unresolved submissions
159Retained attempts0 missing attempts · 0 out-of-scope artifacts
5,267,200 (partial: 168/206 runs)Input tokens
345,468 (partial: 168/206 runs)Output tokens
57,513,984 (partial: 168/206 runs)Cached tokens
UnavailableLLM reported subtotal
$0.000000Daytona list estimate
930m 7sObserved attempt window159 retained attempts · 0 missing attempts

Attempt durations include setup and cleanup captured inside each attempt. The observed window spans the earliest retained start to the latest retained finish, including gaps and overlap. Carried-forward evidence can span older runs, so this window is not the current workflow's duration. Neither measure is CI queue/setup time or provider-billed runtime.

UnknownAgent execution time
0msDaytona lease time
0/206Runs provider-priced

Campaign costs include retained attempts, including failed retries. Result cards show the selected attempt. Provider-reported amounts and model estimates are separate; unpriced or unavailable runs are excluded, never counted as free. Coverage describes captured usage; unobserved setup, subscriptions, tools, CI and storage require additional accounting. Daytona runtime is a public-list-price estimate from captured lease time and pinned resources, before credits, discounts, storage allowance, or invoice adjustments. Local execution has no external runtime meter.

UnknownWorker setup time
UnknownWorker execution time
UnknownWorker feedback time
UnknownWorker cleanup time
UnknownWorker finalization time

0/159 complete worker receipts; 0 partial; 0 missing attempts. Worker phases cover the test callback through finalization before result publication. Browser/server startup, parent cleanup, CI queue/build time and provider-billed runtime are outside these measurements. An interrupted phase has no inferred end time.

Campaign feedback review

0 distinct feedback items await review. Collection gaps and failed submissions remain separate findings.

Full bodies and review rationale stay in private evidence. Exact duplicate bodies are grouped once; related causes can be linked by a reviewed duplicate disposition.

All results

Feature coverage 0 of 191 capabilities linked · 0 of 158 tests mapped

Associations use the current feature map. Counts describe linked test scenarios; a passing journey does not establish full coverage of a capability.

Getting started and access

FeatureCapabilities linkedLinked test results
Onboarding and first work 0/5 No mapped journey
Login, invitations, and access 0/5 No mapped journey
Companies and portability 0/8 No mapped journey

Tasks and conversations

FeatureCapabilities linkedLinked test results
Task creation and lifecycle 0/6 No mapped journey
Delegation, dependencies, and signoff 0/4 No mapped journey
Inbox, decisions, and search 0/5 No mapped journey
Agent conversations and project handoff 0/4 No mapped journey
Questions and approvals 0/8 No mapped journey
Steering and queued messages 0/7 No mapped journey
Documents, attachments, and work products 0/5 No mapped journey

Agents and reusable capabilities

FeatureCapabilities linkedLinked test results
Hiring, configuration, and organization 0/9 No mapped journey
Runs, harnesses, and model accounts 0/4 No mapped journey
Skills and Skill Studio 0/5 No mapped journey
Team packages and installation 0/4 No mapped journey

Projects and execution

FeatureCapabilities linkedLinked test results
Projects and repositories 0/5 No mapped journey
Goals and work alignment 0/3 No mapped journey
Workspaces, services, and files 0/5 No mapped journey
Execution environments 0/5 No mapped journey
Recovery 0/8 No mapped journey

Apps, channels, and extensions

FeatureCapabilities linkedLinked test results
Connection setup 0/8 No mapped journey
Assistant connections (MCP) 0/5 No mapped journey
App access and action permissions 0/5 No mapped journey
External chat and email 0/6 No mapped journey
Tool gateways and access profiles 0/5 No mapped journey
Secrets and proposals 0/5 No mapped journey
Plugins 0/4 No mapped journey

Automation and structured work

FeatureCapabilities linkedLinked test results
Routines, schedules, and triggers 0/5 No mapped journey
Cases 0/5 No mapped journey
Status cards 0/4 No mapped journey

Oversight and operation

FeatureCapabilities linkedLinked test results
Costs and budgets 0/6 No mapped journey
Dashboards and audit trails 0/6 No mapped journey
Navigation, profile, and announcements 0/6 No mapped journey
Instance operations 0/6 No mapped journey
CLI/API and local worktrees 0/6 No mapped journey

Contributor surfaces

FeatureCapabilities linkedLinked test results
Developer previews and diagnostic labs 0/4 No mapped journey

Test suite

Chat feature journeys

Executable catalog requests through Agent Chat, with independently graded persisted state.

Pass rate10.8%17/158 passed
Tokens63,126,652 (partial: 168/206 runs)5,267,200 (partial: 168/206 runs) input · 345,468 (partial: 168/206 runs) output
Known spendUnavailablereported LLM + model/runtime estimates estimate
Agent timeUnknown0ms lease
Execution158/1580 retries · cleanup failed

access.cli-authorization

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
access.cli-authorization failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 14s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered2m 3s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.access.cli-authorization
Attempt
1
Duration
2m 14s
Agent runtime
2m 3s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
26ca4f67-d021-41d8-bd70-941f646a4a54unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 22518,
      "outputTokens": 1194,
      "cachedInputTokens": 328320,
      "totalTokens": 352032,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 123187,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

access.other-company

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
access.other-company failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 19s
Tokens30,435 in · 2,407 out654,080 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 53s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.access.other-company
Attempt
1
Duration
2m 19s
Agent runtime
1m 53s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
1ff9c6d3-7edc-4cc6-9961-3189c37e899aunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 30435,
      "outputTokens": 2407,
      "cachedInputTokens": 654080,
      "totalTokens": 686922,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 112914,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

access.private-resource

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
access.private-resource passed
Test details10/10 checks · 1m 46s
Overall passed · 10/10 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (10)
ResultCheckDetail
Passchat.authenticated-private-evidenceOriginal retained check passed.
Passchat.real-human-private-visibilityOriginal retained check passed.
Passchat.agent-intersection-deniedOriginal retained check passed.
Passchat.no-private-disclosureOriginal retained check passed.
Passchat.private-source-unchangedOriginal retained check passed.
Passchat.no-copy-or-summary-recordOriginal retained check passed.
Passchat.catalog-complete-conditionsOriginal retained check passed.
Passchat.catalog-original-human-queryOriginal retained check passed.
Passchat.catalog-query-attachment-receiptsOriginal retained check passed.
Passchat.catalog-bounded-native-runsOriginal retained check passed.
Tokens26,339 in · 1,872 out484,736 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 24s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.access.private-resource
Attempt
1
Duration
1m 46s
Agent runtime
1m 24s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
0561559c-c3ff-4544-be5c-05375d793a9dunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.authenticated-private-evidence","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.real-human-private-visibility","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.agent-intersection-denied","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.no-private-disclosure","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.private-source-unchanged","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.no-copy-or-summary-record","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Original retained check passed.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 26339,
      "outputTokens": 1872,
      "cachedInputTokens": 484736,
      "totalTokens": 512947,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 84338,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

access.sign-in

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
access.sign-in failed
Overall failed · No behavioral checks recorded

transient infrastructure

Historical local measurement: infrastructure startup failure plus eval-harness diagnostic/finalization defect. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 15s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.access.sign-in
Attempt
1
Duration
15s
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

activity.agent-feedback

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
activity.agent-feedback failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 27s
Tokens36,258 in · 2,602 out454,784 cached · 3/3 runs covered
LLM spendUnavailable0/3 runs provider-priced
ExecutionLocal · not metered2m 12s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.activity.agent-feedback
Attempt
1
Duration
2m 27s
Agent runtime
2m 12s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
c6f31a39-e5a2-4ec9-b945-1714e6bf15abunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
5e2dae94-6166-42da-bd49-387fdc22c7f6unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
96ad12a6-6e57-4daa-87d8-405abd802290unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 3,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 36258,
      "outputTokens": 2602,
      "cachedInputTokens": 454784,
      "totalTokens": 493644,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 131619,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

activity.audit-change

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
activity.audit-change failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 5s
Tokens23,988 in · 836 out263,296 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered42s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.activity.audit-change
Attempt
1
Duration
1m 5s
Agent runtime
42s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
05e124dc-f160-474b-b13f-2b7132ba16b2unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 23988,
      "outputTokens": 836,
      "cachedInputTokens": 263296,
      "totalTokens": 288120,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 41875,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

activity.company-overview

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
activity.company-overview failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 12s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.activity.company-overview
Attempt
1
Duration
12s
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

activity.find-runs

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
activity.find-runs failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 10s
Tokens88,640 in · 2,591 out594,304 cached · 3/3 runs covered
LLM spendUnavailable0/3 runs provider-priced
ExecutionLocal · not metered1m 37s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.activity.find-runs
Attempt
1
Duration
2m 10s
Agent runtime
1m 37s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
f5074c08-b6e4-4d84-807d-18bc1a61f604unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
38f3ab83-bd7e-4b04-bc90-ec3ebb9df494unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ebb62fd9-3b4d-4979-8c8a-83087aba2255unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 3,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 88640,
      "outputTokens": 2591,
      "cachedInputTokens": 594304,
      "totalTokens": 685535,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 97034,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

agent-chat.chat-disabled

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
agent-chat.chat-disabled failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 7s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.agent-chat.chat-disabled
Attempt
1
Duration
7s
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

agent-chat.conference-room

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
agent-chat.conference-room failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 6s
Tokens22,406 in · 1,951 out210,048 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered39s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.agent-chat.conference-room
Attempt
1
Duration
1m 6s
Agent runtime
39s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
be6dc96a-f6e9-4f06-a4e9-36b6cf2a8e73unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 22406,
      "outputTokens": 1951,
      "cachedInputTokens": 210048,
      "totalTokens": 234405,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 39308,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

agent-chat.multiple-handoffs

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
agent-chat.multiple-handoffs failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 12s
Tokens22,838 in · 4,865 out397,824 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered1m 52s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.agent-chat.multiple-handoffs
Attempt
1
Duration
2m 12s
Agent runtime
1m 52s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
766ba58d-0d69-4253-b778-0a88b7351e7funknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
c0327ea4-9885-48ab-a3cc-505ace24f27aunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 22838,
      "outputTokens": 4865,
      "cachedInputTokens": 397824,
      "totalTokens": 425527,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 111594,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

agent-chat.remember-and-follow-up

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
agent-chat.remember-and-follow-up failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 46s
Tokens13,722 in · 2,052 out221,696 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered51s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.agent-chat.remember-and-follow-up
Attempt
1
Duration
1m 46s
Agent runtime
51s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
83aae3d6-3c68-4920-88ea-e3a996ce8107unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 13722,
      "outputTokens": 2052,
      "cachedInputTokens": 221696,
      "totalTokens": 237470,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 50575,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

agent-chat.reopen-conversation

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
agent-chat.reopen-conversation failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 4s
Tokens8,743 in · 279 out45,824 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered12s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.agent-chat.reopen-conversation
Attempt
1
Duration
1m 4s
Agent runtime
12s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
938c2684-614b-43ae-85e0-4f4682d037b0unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 8743,
      "outputTokens": 279,
      "cachedInputTokens": 45824,
      "totalTokens": 54846,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 11531,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

agent-chat.track-delegated-work

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
agent-chat.track-delegated-work failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 3m 18s
Tokens32,568 in · 3,348 out329,088 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered1m 29s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.agent-chat.track-delegated-work
Attempt
1
Duration
3m 18s
Agent runtime
1m 29s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
fd6ecacc-da42-4e56-b7b1-73d84f4a2d84unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
f72aacff-e0cd-47b7-b1db-833bc0196fe0unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 32568,
      "outputTokens": 3348,
      "cachedInputTokens": 329088,
      "totalTokens": 365004,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 89342,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

agents.agent-api-key

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
agents.agent-api-key passed
Test details11/11 checks · 1m 45s
Overall passed · 11/11 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (11)
ResultCheckDetail
Passchat.independent-human-key-evidenceOriginal retained check passed.
Passchat.human-only-creationOriginal retained check passed.
Passchat.one-time-private-interfaceOriginal retained check passed.
Passchat.revocation-preserves-agent-identityOriginal retained check passed.
Passchat.attributed-key-lifecycleOriginal retained check passed.
Passchat.no-delegated-credential-workOriginal retained check passed.
Passchat.honest-secure-human-pathOriginal retained check passed.
Passchat.catalog-complete-conditionsOriginal retained check passed.
Passchat.catalog-original-human-queryOriginal retained check passed.
Passchat.catalog-query-attachment-receiptsOriginal retained check passed.
Passchat.catalog-bounded-native-runsOriginal retained check passed.
Tokens38,109 in · 2,130 out572,032 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 9s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.agents.agent-api-key
Attempt
1
Duration
1m 45s
Agent runtime
1m 9s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
7cb6474b-e1a6-47bb-98c3-162346748b0aunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.independent-human-key-evidence","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.human-only-creation","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.one-time-private-interface","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.revocation-preserves-agent-identity","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.attributed-key-lifecycle","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.no-delegated-credential-work","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.honest-secure-human-path","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Original retained check passed.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 38109,
      "outputTokens": 2130,
      "cachedInputTokens": 572032,
      "totalTokens": 612271,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 69410,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

agents.change-manager

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
agents.change-manager failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 44s
Tokens27,114 in · 972 out334,976 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered40s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.agents.change-manager
Attempt
1
Duration
1m 44s
Agent runtime
40s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
5bb0d59d-46e2-4774-b446-dd34d3d41ff2unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 27114,
      "outputTokens": 972,
      "cachedInputTokens": 334976,
      "totalTokens": 363062,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 40187,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

agents.configure-required-agent

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
agents.configure-required-agent failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 6s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.agents.configure-required-agent
Attempt
1
Duration
6s
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

agents.edit-instructions

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
agents.edit-instructions failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 3s
Tokens38,742 in · 983 out265,728 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered34s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.agents.edit-instructions
Attempt
1
Duration
1m 3s
Agent runtime
34s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
c143f3aa-152c-4400-ae0f-534f0fdf2893unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 38742,
      "outputTokens": 983,
      "cachedInputTokens": 265728,
      "totalTokens": 305453,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 34426,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

agents.hire-denied

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
agents.hire-denied failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 5s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.agents.hire-denied
Attempt
1
Duration
5s
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

agents.hire-needs-approval

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
agents.hire-needs-approval failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 48s
Tokens91,845 in · 4,230 out1,059,712 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered1m 54s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.agents.hire-needs-approval
Attempt
1
Duration
2m 48s
Agent runtime
1m 54s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
101850b2-2f4d-4bd3-a2a2-e32084af05beunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
6aae21b0-73bb-4ebe-8f01-1f6ae5a577fcunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 91845,
      "outputTokens": 4230,
      "cachedInputTokens": 1059712,
      "totalTokens": 1155787,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 113864,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

agents.managed-profile

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
agents.managed-profile failed
Overall failed · No behavioral checks recorded

permanent infrastructure

Historical local measurement: permanent_infrastructure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 27s
Tokens34,788 in · 1,665 out353,920 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 0s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.agents.managed-profile
Attempt
1
Duration
1m 27s
Agent runtime
1m 0s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
88e591cb-1de7-4f0e-8b13-14b0672677f2unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 34788,
      "outputTokens": 1665,
      "cachedInputTokens": 353920,
      "totalTokens": 390373,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 59633,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

agents.pause-agent

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
agents.pause-agent failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 47s
Tokens8,106 in · 1,045 out69,504 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered31s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.agents.pause-agent
Attempt
1
Duration
47s
Agent runtime
31s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
b0bd2ba4-53d7-409a-8896-e7af56b88094unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 8106,
      "outputTokens": 1045,
      "cachedInputTokens": 69504,
      "totalTokens": 78655,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 30648,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

agents.restore-instructions

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
agents.restore-instructions failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 17s
Tokens18,916 in · 1,201 out313,856 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered46s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.agents.restore-instructions
Attempt
1
Duration
1m 17s
Agent runtime
46s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
33423aec-f8db-42bd-8cd2-394b7d9f672aunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 18916,
      "outputTokens": 1201,
      "cachedInputTokens": 313856,
      "totalTokens": 333973,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 46311,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

agents.resume-agent

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
agents.resume-agent failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 35s
Tokens24,814 in · 878 out289,024 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered31s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.agents.resume-agent
Attempt
1
Duration
1m 35s
Agent runtime
31s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
c985b5bd-dc6c-46d1-8eda-55f5e924ca9funknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 24814,
      "outputTokens": 878,
      "cachedInputTokens": 289024,
      "totalTokens": 314716,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 31243,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

agents.retire-agent

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
agents.retire-agent failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 46s
Tokens8,092 in · 1,071 out69,376 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered27s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.agents.retire-agent
Attempt
1
Duration
46s
Agent runtime
27s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
6e7fce7e-d8cb-4972-ade6-09b362f82679unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 8092,
      "outputTokens": 1071,
      "cachedInputTokens": 69376,
      "totalTokens": 78539,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 27449,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

app-permissions.ask-before-action

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
app-permissions.ask-before-action failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 47s
Tokens29,637 in · 1,407 out222,336 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered49s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.app-permissions.ask-before-action
Attempt
1
Duration
2m 47s
Agent runtime
49s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
fdd6b564-1efb-4804-a01c-ce2a33f70a11unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 29637,
      "outputTokens": 1407,
      "cachedInputTokens": 222336,
      "totalTokens": 253380,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 48859,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

app-permissions.new-quarantined-action

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
app-permissions.new-quarantined-action failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 5s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.app-permissions.new-quarantined-action
Attempt
1
Duration
5s
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

app-permissions.read-allowed-write-off

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
app-permissions.read-allowed-write-off failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 2s
Tokens38,828 in · 646 out153,600 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered36s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.app-permissions.read-allowed-write-off
Attempt
1
Duration
1m 2s
Agent runtime
36s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
42eae108-dc04-4662-a7a5-59ed1289a129unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 38828,
      "outputTokens": 646,
      "cachedInputTokens": 153600,
      "totalTokens": 193074,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 36079,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

app-permissions.test-as-agent

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
app-permissions.test-as-agent failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 58s
Tokens47,026 in · 2,803 out763,136 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 38s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.app-permissions.test-as-agent
Attempt
1
Duration
1m 58s
Agent runtime
1m 38s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
7c11b649-5f5b-4ef7-a3bb-a2942dad4bc7unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 47026,
      "outputTokens": 2803,
      "cachedInputTokens": 763136,
      "totalTokens": 812965,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 97664,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

assistant-connections.device-login

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
assistant-connections.device-login failed
Overall failed · No behavioral checks recorded

transient infrastructure

Historical local measurement: transient_infrastructure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 10m 33s
Tokens47,772 in · 1,840 out131,200 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered58s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.assistant-connections.device-login
Attempt
1
Duration
10m 33s
Agent runtime
58s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
fa0935d8-5e95-42f7-8dff-bf6c953a858aunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 47772,
      "outputTokens": 1840,
      "cachedInputTokens": 131200,
      "totalTokens": 180812,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 58329,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

assistant-connections.revoke-personal-grant

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
assistant-connections.revoke-personal-grant failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 0s
Tokens8,266 in · 1,114 out69,376 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered33s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.assistant-connections.revoke-personal-grant
Attempt
1
Duration
1m 0s
Agent runtime
33s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
f94eea80-f43f-4880-bfa9-820466897605unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 8266,
      "outputTokens": 1114,
      "cachedInputTokens": 69376,
      "totalTokens": 78756,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 33139,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

budgets-costs.explain-hard-stop

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
budgets-costs.explain-hard-stop failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 24s
Tokens20,643 in · 1,908 out309,504 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered58s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.budgets-costs.explain-hard-stop
Attempt
1
Duration
1m 24s
Agent runtime
58s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
b2e72b19-a04a-45fe-812e-b497cf2444beunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 20643,
      "outputTokens": 1908,
      "cachedInputTokens": 309504,
      "totalTokens": 332055,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 58119,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

budgets-costs.repair-cost-recording

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
budgets-costs.repair-cost-recording failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 26s
Tokens25,630 in · 283 out24,576 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered11s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.budgets-costs.repair-cost-recording
Attempt
1
Duration
26s
Agent runtime
11s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
c915b2aa-24f2-4a31-9b24-388f0b2a448cunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 25630,
      "outputTokens": 283,
      "cachedInputTokens": 24576,
      "totalTokens": 50489,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 11380,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

budgets-costs.resolve-budget

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
budgets-costs.resolve-budget failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 21s
Tokens50,101 in · 3,154 out799,488 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 39s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.budgets-costs.resolve-budget
Attempt
1
Duration
2m 21s
Agent runtime
1m 39s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
0ae2637b-8dc8-4234-a7ad-d7eb841e999cunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 50101,
      "outputTokens": 3154,
      "cachedInputTokens": 799488,
      "totalTokens": 852743,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 99124,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

budgets-costs.set-budget

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
budgets-costs.set-budget failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 55s
Tokens26,980 in · 1,119 out335,488 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered43s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.budgets-costs.set-budget
Attempt
1
Duration
55s
Agent runtime
43s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
f70d590c-e2a9-41a7-93c4-9e8f9052c3f4unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 26980,
      "outputTokens": 1119,
      "cachedInputTokens": 335488,
      "totalTokens": 363587,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 43181,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

budgets-costs.spend-breakdown

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
budgets-costs.spend-breakdown failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 43s
Tokens46,805 in · 2,220 out309,376 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered1m 4s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.budgets-costs.spend-breakdown
Attempt
1
Duration
1m 43s
Agent runtime
1m 4s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
53c702ff-c38a-4439-9867-655084924423unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
2ac0f909-bdad-4294-aac0-a21e59fd00dfunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 46805,
      "outputTokens": 2220,
      "cachedInputTokens": 309376,
      "totalTokens": 358401,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 63709,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

cases.browse-cases

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
cases.browse-cases failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 12s
Tokens49,460 in · 2,020 out383,232 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered50s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.cases.browse-cases
Attempt
1
Duration
1m 12s
Agent runtime
50s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
172b6e97-4947-4723-a72f-c565f6abe0e5unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 49460,
      "outputTokens": 2020,
      "cachedInputTokens": 383232,
      "totalTokens": 434712,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 49736,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

cases.case-history

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
cases.case-history failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 18s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.cases.case-history
Attempt
1
Duration
18s
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

cases.cases-disabled

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
cases.cases-disabled failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 4s
Tokens28,087 in · 1,417 out322,560 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered42s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.cases.cases-disabled
Attempt
1
Duration
1m 4s
Agent runtime
42s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
8cf1ad0a-7fe1-47e5-a4dc-f16b72e35ff0unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 28087,
      "outputTokens": 1417,
      "cachedInputTokens": 322560,
      "totalTokens": 352064,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 41963,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

cases.close-case

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
cases.close-case failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 12s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.cases.close-case
Attempt
1
Duration
12s
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

cases.create-case

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
cases.create-case failed
Overall failed · No behavioral checks recorded

transient infrastructure

Historical local measurement: transient_infrastructure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 23s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered2m 10s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.cases.create-case
Attempt
1
Duration
2m 23s
Agent runtime
2m 10s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
9aa02ef8-60cd-412d-a95a-c71ab63518c9unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 35907,
      "outputTokens": 765,
      "cachedInputTokens": 128896,
      "totalTokens": 165568,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 129946,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

cases.handoff-same-task

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
cases.handoff-same-task failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 3m 53s
Tokens33,160 in · 924 out61,056 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered26s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.cases.handoff-same-task
Attempt
1
Duration
3m 53s
Agent runtime
26s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
b6dc0f49-99fd-4d82-9311-dd4449f2a110unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 33160,
      "outputTokens": 924,
      "cachedInputTokens": 61056,
      "totalTokens": 95140,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 26004,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

cases.related-work

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
cases.related-work failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 13s
Tokens68,916 in · 2,520 out312,448 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered1m 42s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.cases.related-work
Attempt
1
Duration
2m 13s
Agent runtime
1m 42s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
19e0f9cc-d2ab-40ab-8985-f6a8e6e47e02unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
294f3ffc-47bd-459c-8306-9746257a692eunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 68916,
      "outputTokens": 2520,
      "cachedInputTokens": 312448,
      "totalTokens": 383884,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 101541,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

cases.update-case-facts

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
cases.update-case-facts failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 3m 51s
Tokens46,424 in · 565 out128,640 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered28s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.cases.update-case-facts
Attempt
1
Duration
3m 51s
Agent runtime
28s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
214f61ab-2385-458d-a8fa-b7a67cc574b7unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 46424,
      "outputTokens": 565,
      "cachedInputTokens": 128640,
      "totalTokens": 175629,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 27902,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

chat-channels.provider-disabled

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
chat-channels.provider-disabled passed
Test details8/8 checks · 1m 4s
Overall passed · 8/8 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (8)
ResultCheckDetail
Passchat.complete-disabled-provider-evidenceOriginal retained check passed.
Passchat.provider-disabled-before-and-afterOriginal retained check passed.
Passchat.no-phantom-endpointOriginal retained check passed.
Passchat.clear-provider-specific-prerequisiteOriginal retained check passed.
Passchat.catalog-complete-conditionsOriginal retained check passed.
Passchat.catalog-original-human-queryOriginal retained check passed.
Passchat.catalog-query-attachment-receiptsOriginal retained check passed.
Passchat.catalog-bounded-native-runsOriginal retained check passed.
Tokens18,820 in · 1,047 out144,896 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered39s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.chat-channels.provider-disabled
Attempt
1
Duration
1m 4s
Agent runtime
39s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
374ecd61-9ae4-4184-87fd-f51ba8b4e5c0unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.complete-disabled-provider-evidence","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.provider-disabled-before-and-after","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.no-phantom-endpoint","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.clear-provider-specific-prerequisite","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Original retained check passed.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 18820,
      "outputTokens": 1047,
      "cachedInputTokens": 144896,
      "totalTokens": 164763,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 38879,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

cli-operations.choose-cli-context

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
cli-operations.choose-cli-context failed
Overall failed · No behavioral checks recorded

permanent infrastructure

Historical local measurement: permanent_infrastructure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 17s
Tokens29,991 in · 1,916 out352,128 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 2s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.cli-operations.choose-cli-context
Attempt
1
Duration
1m 17s
Agent runtime
1m 2s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
5229a29d-5892-48f2-ac05-acfe65eb0943unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 29991,
      "outputTokens": 1916,
      "cachedInputTokens": 352128,
      "totalTokens": 384035,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 61873,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

cli-operations.create-from-cli

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
cli-operations.create-from-cli failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 37s
Tokens49,511 in · 2,479 out499,840 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 18s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.cli-operations.create-from-cli
Attempt
1
Duration
1m 37s
Agent runtime
1m 18s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
c450b91c-0ffe-401d-9292-1f5c078a4008unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 49511,
      "outputTokens": 2479,
      "cachedInputTokens": 499840,
      "totalTokens": 551830,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 78326,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

cli-operations.export-document-cli

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
cli-operations.export-document-cli failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 23s
Tokens21,798 in · 2,414 out362,752 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 13s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.cli-operations.export-document-cli
Attempt
1
Duration
1m 23s
Agent runtime
1m 13s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
a4fe84b1-e443-4906-8b20-2f99c1ce4b4eunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 21798,
      "outputTokens": 2414,
      "cachedInputTokens": 362752,
      "totalTokens": 386964,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 72654,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

cli-operations.feedback-bundle

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
cli-operations.feedback-bundle failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 50s
Tokens8,878 in · 1,081 out95,488 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered35s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.cli-operations.feedback-bundle
Attempt
1
Duration
50s
Agent runtime
35s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
b95aeb2b-8197-4368-aa6a-d01c38ab9dc1unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 8878,
      "outputTokens": 1081,
      "cachedInputTokens": 95488,
      "totalTokens": 105447,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 35419,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

cli-operations.inspect-run-cli

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
cli-operations.inspect-run-cli failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 50s
Tokens7,968 in · 991 out69,248 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered29s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.cli-operations.inspect-run-cli
Attempt
1
Duration
50s
Agent runtime
29s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
0b320076-4bba-4c47-bc0a-bfffe81bfd02unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 7968,
      "outputTokens": 991,
      "cachedInputTokens": 69248,
      "totalTokens": 78207,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 28518,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

cli-operations.owned-dev-instance

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
cli-operations.owned-dev-instance failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 50s
Tokens40,507 (partial: 1/2 runs) in · 5,858 (partial: 1/2 runs) out513,920 (partial: 1/2 runs) cached · 1/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered2m 32s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.cli-operations.owned-dev-instance
Attempt
1
Duration
2m 50s
Agent runtime
2m 32s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
e72ddddf-32f2-484e-a4fb-196762a57147unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
12aad0ac-81f2-4a5c-8d2e-d3b185538ef5unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 40507,
      "outputTokens": 5858,
      "cachedInputTokens": 513920,
      "totalTokens": 560285,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 152017,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

companies.agent-observability

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
companies.agent-observability failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 20s
Tokens205,390 in · 7,225 out1,488,768 cached · 3/3 runs covered
LLM spendUnavailable0/3 runs provider-priced
ExecutionLocal · not metered1m 37s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.companies.agent-observability
Attempt
1
Duration
2m 20s
Agent runtime
1m 37s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
80d7323b-6111-44d2-b25f-44ae8744e55funknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
3e768821-3d59-46a9-8a47-9d6388965c56unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
709654dd-a060-4760-984e-400f4f88afd9unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 3,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 205390,
      "outputTokens": 7225,
      "cachedInputTokens": 1488768,
      "totalTokens": 1701383,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 96681,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

companies.archive-company

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
companies.archive-company passed
Test details10/10 checks · 1m 37s
Overall passed · 10/10 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (10)
ResultCheckDetail
Passchat.complete-company-journeyOriginal retained check passed.
Passchat.archive-governance-guidanceOriginal retained check passed.
Passchat.human-archives-exact-companyOriginal retained check passed.
Passchat.archive-enforces-work-gateOriginal retained check passed.
Passchat.restored-not-recreatedOriginal retained check passed.
Passchat.history-and-membership-retainedOriginal retained check passed.
Passchat.catalog-complete-conditionsOriginal retained check passed.
Passchat.catalog-original-human-queryOriginal retained check passed.
Passchat.catalog-query-attachment-receiptsOriginal retained check passed.
Passchat.catalog-bounded-native-runsOriginal retained check passed.
Tokens34,908 in · 1,701 out505,216 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 12s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.companies.archive-company
Attempt
1
Duration
1m 37s
Agent runtime
1m 12s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
3c64826b-c393-4786-b5ff-f3ef927b17a6unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.complete-company-journey","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.archive-governance-guidance","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.human-archives-exact-company","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.archive-enforces-work-gate","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.restored-not-recreated","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.history-and-membership-retained","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Original retained check passed.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 34908,
      "outputTokens": 1701,
      "cachedInputTokens": 505216,
      "totalTokens": 541825,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 71892,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

companies.export-company

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
companies.export-company failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 26s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered2m 16s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.companies.export-company
Attempt
1
Duration
2m 26s
Agent runtime
2m 16s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
e604d4c4-6b86-4ea5-98dc-364cab4f25e6unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 66948,
      "outputTokens": 4059,
      "cachedInputTokens": 963200,
      "totalTokens": 1034207,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 136324,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

companies.import-preview

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
companies.import-preview failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 10s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.companies.import-preview
Attempt
1
Duration
10s
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

companies.rename-company

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
companies.rename-company passed
Test details10/10 checks · 57s
Overall passed · 10/10 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (10)
ResultCheckDetail
Passchat.complete-company-evidenceOriginal retained check passed.
Passchat.same-company-renamedOriginal retained check passed.
Passchat.other-company-preservedOriginal retained check passed.
Passchat.work-retainedOriginal retained check passed.
Passchat.agent-attributed-identity-changeOriginal retained check passed.
Passchat.memberships-preservedOriginal retained check passed.
Passchat.catalog-complete-conditionsOriginal retained check passed.
Passchat.catalog-original-human-queryOriginal retained check passed.
Passchat.catalog-query-attachment-receiptsOriginal retained check passed.
Passchat.catalog-bounded-native-runsOriginal retained check passed.
Tokens25,306 in · 895 out263,296 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered41s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.companies.rename-company
Attempt
1
Duration
57s
Agent runtime
41s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
41194cec-de5e-45fa-b150-94d9807e033cunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.complete-company-evidence","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.same-company-renamed","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.other-company-preserved","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.work-retained","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.agent-attributed-identity-change","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.memberships-preserved","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Original retained check passed.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 25306,
      "outputTokens": 895,
      "cachedInputTokens": 263296,
      "totalTokens": 289497,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 40677,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

companies.switch-company

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
companies.switch-company failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 46s
Tokens28,778 in · 1,722 out480,640 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 8s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.companies.switch-company
Attempt
1
Duration
1m 46s
Agent runtime
1m 8s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
b98fffdf-e2c7-4a9c-b41f-88fc35420a29unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 28778,
      "outputTokens": 1722,
      "cachedInputTokens": 480640,
      "totalTokens": 511140,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 68114,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

connection-setup.choose-provider

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
connection-setup.choose-provider failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 25s
Tokens8,554 in · 145 out45,696 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered16s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.connection-setup.choose-provider
Attempt
1
Duration
25s
Agent runtime
16s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
477b3c6f-bead-45d5-a390-0d3d3c337addunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 8554,
      "outputTokens": 145,
      "cachedInputTokens": 45696,
      "totalTokens": 54395,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 16409,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

connection-setup.notion-declined

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
connection-setup.notion-declined failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 13s
Tokens20,448 in · 679 out235,264 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered35s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.connection-setup.notion-declined
Attempt
1
Duration
1m 13s
Agent runtime
35s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
3ebc3e98-9d17-4b1a-864b-c0ae4c126aedunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 20448,
      "outputTokens": 679,
      "cachedInputTokens": 235264,
      "totalTokens": 256391,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 34859,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

connection-setup.secure-api-key

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
connection-setup.secure-api-key failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 3s
Tokens20,586 in · 1,674 out211,072 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered49s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.connection-setup.secure-api-key
Attempt
1
Duration
1m 3s
Agent runtime
49s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
94886782-86b0-48e6-a612-d28224e2a2cbunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 20586,
      "outputTokens": 1674,
      "cachedInputTokens": 211072,
      "totalTokens": 233332,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 48516,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

connection-setup.unreachable-mcp

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
connection-setup.unreachable-mcp failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 15s
Tokens33,188 in · 1,188 out252,800 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered37s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.connection-setup.unreachable-mcp
Attempt
1
Duration
1m 15s
Agent runtime
37s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
7ac395a3-f94c-4227-84c5-5fe5aea045cdunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 33188,
      "outputTokens": 1188,
      "cachedInputTokens": 252800,
      "totalTokens": 287176,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 36785,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

developer-labs.component-reference

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
developer-labs.component-reference failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 47s
Tokens25,852 in · 2,934 out269,056 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered55s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.developer-labs.component-reference
Attempt
1
Duration
2m 47s
Agent runtime
55s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
ef3c96db-8622-4b9a-bb4c-a44f38708070unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 25852,
      "outputTokens": 2934,
      "cachedInputTokens": 269056,
      "totalTokens": 297842,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 55221,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

developer-labs.gated-lab

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
developer-labs.gated-lab failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 50s
Tokens25,962 in · 1,730 out210,176 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered44s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.developer-labs.gated-lab
Attempt
1
Duration
2m 50s
Agent runtime
44s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
f1996b5a-f143-4885-86aa-1c7801753426unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 25962,
      "outputTokens": 1730,
      "cachedInputTokens": 210176,
      "totalTokens": 237868,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 44393,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

developer-labs.interaction-fixture

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
developer-labs.interaction-fixture failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 50s
Tokens24,535 in · 1,143 out182,016 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered44s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.developer-labs.interaction-fixture
Attempt
1
Duration
2m 50s
Agent runtime
44s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
2f4d884f-0799-4037-8dab-46d30354c049unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 24535,
      "outputTokens": 1143,
      "cachedInputTokens": 182016,
      "totalTokens": 207694,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 44363,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

developer-labs.long-thread-performance

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
developer-labs.long-thread-performance failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 13s
Tokens10,395 in · 690 out101,888 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered29s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.developer-labs.long-thread-performance
Attempt
1
Duration
1m 13s
Agent runtime
29s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
b5573df6-f748-4187-9fc0-0b102150f524unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 10395,
      "outputTokens": 690,
      "cachedInputTokens": 101888,
      "totalTokens": 112973,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 28742,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

documents-artifacts.find-artifact

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
documents-artifacts.find-artifact failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 8s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.documents-artifacts.find-artifact
Attempt
1
Duration
8s
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

documents-artifacts.produce-download

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
documents-artifacts.produce-download failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 4m 12s
Tokens9,614 in · 2,461 out170,880 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered52s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.documents-artifacts.produce-download
Attempt
1
Duration
4m 12s
Agent runtime
52s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
ae6414ed-c263-43d4-9257-777b9e079571unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 9614,
      "outputTokens": 2461,
      "cachedInputTokens": 170880,
      "totalTokens": 182955,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 51579,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

documents-artifacts.resolve-feedback

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
documents-artifacts.resolve-feedback failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 28s
Tokens36,326 in · 2,022 out372,480 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 4s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.documents-artifacts.resolve-feedback
Attempt
1
Duration
1m 28s
Agent runtime
1m 4s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
1656141a-bec9-441f-a218-c1a147dd727cunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 36326,
      "outputTokens": 2022,
      "cachedInputTokens": 372480,
      "totalTokens": 410828,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 63995,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

documents-artifacts.revise-delivery

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
documents-artifacts.revise-delivery failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 22s
Tokens63,131 in · 4,348 out589,824 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered1m 47s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.documents-artifacts.revise-delivery
Attempt
1
Duration
2m 22s
Agent runtime
1m 47s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
ed2371d9-6f31-4159-812d-bb4c731cc80aunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
22dcc44a-e33f-413b-a2cb-5204fa70f8c3unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 63131,
      "outputTokens": 4348,
      "cachedInputTokens": 589824,
      "totalTokens": 657303,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 106721,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

documents-artifacts.write-plan

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
documents-artifacts.write-plan failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 10s
Tokens39,108 in · 1,203 out297,728 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered47s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.documents-artifacts.write-plan
Attempt
1
Duration
1m 10s
Agent runtime
47s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
1b1495a1-0774-4839-80a1-c8c3c294d1bbunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 39108,
      "outputTokens": 1203,
      "cachedInputTokens": 297728,
      "totalTokens": 338039,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 46988,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

gateways-profiles.connect-client

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
gateways-profiles.connect-client failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 8s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered2s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.gateways-profiles.connect-client
Attempt
1
Duration
8s
Agent runtime
2s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
75702b5c-633c-4b5a-80c4-97acb2a098a3unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 1643,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

gateways-profiles.create-gateway

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
gateways-profiles.create-gateway failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 33s
Tokens27,847 in · 1,997 out286,976 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered54s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.gateways-profiles.create-gateway
Attempt
1
Duration
1m 33s
Agent runtime
54s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
4acea6bc-84db-4b13-bdfc-76e0bd43b249unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 27847,
      "outputTokens": 1997,
      "cachedInputTokens": 286976,
      "totalTokens": 316820,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 53789,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

gateways-profiles.inspect-gateway-error

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
gateways-profiles.inspect-gateway-error failed
Overall failed · No behavioral checks recorded

transient infrastructure

Historical local measurement: transient_infrastructure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 3m 19s
Tokens77,817 (partial: 2/3 runs) in · 3,809 (partial: 2/3 runs) out905,856 (partial: 2/3 runs) cached · 2/3 runs covered
LLM spendUnavailable0/3 runs provider-priced
ExecutionLocal · not metered2m 59s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.gateways-profiles.inspect-gateway-error
Attempt
1
Duration
3m 19s
Agent runtime
2m 59s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
975a25f0-afd1-4803-904b-8b05e4a841eeunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
9582a9e8-993f-40b0-965c-4ba55253b5bcunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
d2011825-2b45-497a-ae14-584f5d2d60dcunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 77817,
      "outputTokens": 3809,
      "cachedInputTokens": 905856,
      "totalTokens": 987482,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 178731,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

gateways-profiles.rotate-token

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
gateways-profiles.rotate-token failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 25s
Tokens45,596 in · 2,300 out566,272 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 16s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.gateways-profiles.rotate-token
Attempt
1
Duration
1m 25s
Agent runtime
1m 16s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
f75df723-691f-43f2-970d-a9d4a1649602unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 45596,
      "outputTokens": 2300,
      "cachedInputTokens": 566272,
      "totalTokens": 614168,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 75567,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

goals.align-existing-work

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
goals.align-existing-work failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: eval_defect; machine=candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 27s
Tokens130,155 in · 5,246 out1,461,632 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered2m 1s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.goals.align-existing-work
Attempt
1
Duration
2m 27s
Agent runtime
2m 1s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
b2d3d247-c667-4254-b773-3a526a054f41unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
fa5f3152-4925-4a9b-80e2-6260222404a5unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 130155,
      "outputTokens": 5246,
      "cachedInputTokens": 1461632,
      "totalTokens": 1597033,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 120966,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

goals.create-goal-tree

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
goals.create-goal-tree failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: eval_defect; machine=candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 5s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.goals.create-goal-tree
Attempt
1
Duration
5s
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

goals.explain-purpose

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
goals.explain-purpose failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: eval_defect_fixture_contamination; machine=candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 13s
Tokens23,244 in · 2,012 out224,512 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 2s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.goals.explain-purpose
Attempt
1
Duration
1m 13s
Agent runtime
1m 2s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
b9ef013c-7b1c-4929-a6c9-9ae022814dfcunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 23244,
      "outputTokens": 2012,
      "cachedInputTokens": 224512,
      "totalTokens": 249768,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 61799,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

inbox-search.archive-partial-failure

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
inbox-search.archive-partial-failure passed
Test details9/9 checks · 2m 20s
Overall passed · 9/9 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (9)
ResultCheckDetail
Passchat.real-archive-state-and-transportOriginal retained check passed.
Passchat.two-real-commits-before-third-request-failsOriginal retained check passed.
Passchat.explicit-retry-reconciles-only-remaining-itemOriginal retained check passed.
Passchat.truthful-final-reconciliationOriginal retained check passed.
Passchat.task-completion-never-rewrittenOriginal retained check passed.
Passchat.catalog-complete-conditionsOriginal retained check passed.
Passchat.catalog-original-human-queryOriginal retained check passed.
Passchat.catalog-query-attachment-receiptsOriginal retained check passed.
Passchat.catalog-bounded-native-runsOriginal retained check passed.
Tokens62,060 in · 5,262 out1,392,640 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered1m 57s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.inbox-search.archive-partial-failure
Attempt
1
Duration
2m 20s
Agent runtime
1m 57s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
99dc3487-bad4-48f1-83ab-11279ac6b368unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
2e4cef6e-b627-463c-8adb-c60f9c13b655unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.real-archive-state-and-transport","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.two-real-commits-before-third-request-fails","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.explicit-retry-reconciles-only-remaining-item","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.truthful-final-reconciliation","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.task-completion-never-rewritten","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Original retained check passed.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 62060,
      "outputTokens": 5262,
      "cachedInputTokens": 1392640,
      "totalTokens": 1459962,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 117246,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

inbox-search.archive-without-grant

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
inbox-search.archive-without-grant failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 36s
Tokens29,637 in · 2,196 out581,376 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 9s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.inbox-search.archive-without-grant
Attempt
1
Duration
1m 36s
Agent runtime
1m 9s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
bd721075-490c-444c-9f55-2a827fd10922unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 29637,
      "outputTokens": 2196,
      "cachedInputTokens": 581376,
      "totalTokens": 613209,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 69471,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

inbox-search.find-design

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
inbox-search.find-design failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 4m 38s
Tokens31,086 in · 1,586 out389,248 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 16s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.inbox-search.find-design
Attempt
1
Duration
4m 38s
Agent runtime
1m 16s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
d65353e9-7c6e-4764-8774-371f54164726unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 31086,
      "outputTokens": 1586,
      "cachedInputTokens": 389248,
      "totalTokens": 421920,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 76100,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

inbox-search.show-my-work

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
inbox-search.show-my-work failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 5s
Tokens23,892 in · 1,447 out286,848 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered38s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.inbox-search.show-my-work
Attempt
1
Duration
1m 5s
Agent runtime
38s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
47f9e2c3-5cf9-47a1-8ecd-5ba9ee3bb278unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 23892,
      "outputTokens": 1447,
      "cachedInputTokens": 286848,
      "totalTokens": 312187,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 38348,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

instance-operations.backup-and-restore

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
instance-operations.backup-and-restore failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 8s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.instance-operations.backup-and-restore
Attempt
1
Duration
8s
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

instance-operations.diagnose-health

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
instance-operations.diagnose-health failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 10s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.instance-operations.diagnose-health
Attempt
1
Duration
10s
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

instance-operations.instance-settings

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
instance-operations.instance-settings passed
Test details9/9 checks · 1m 6s
Overall passed · 9/9 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (9)
ResultCheckDetail
Passchat.actual-setting-evidenceOriginal retained check passed.
Passchat.agent-not-instance-adminOriginal retained check passed.
Passchat.supported-human-pathOriginal retained check passed.
Passchat.saved-gate-and-routeOriginal retained check passed.
Passchat.credential-not-disclosedOriginal retained check passed.
Passchat.catalog-complete-conditionsOriginal retained check passed.
Passchat.catalog-original-human-queryOriginal retained check passed.
Passchat.catalog-query-attachment-receiptsOriginal retained check passed.
Passchat.catalog-bounded-native-runsOriginal retained check passed.
Tokens27,730 in · 950 out265,472 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered39s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.instance-operations.instance-settings
Attempt
1
Duration
1m 6s
Agent runtime
39s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
27f3bf19-1a31-47cd-88df-3ec9948d6ee7unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.actual-setting-evidence","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.agent-not-instance-admin","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.supported-human-path","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.saved-gate-and-route","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.credential-not-disclosed","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Original retained check passed.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 27730,
      "outputTokens": 950,
      "cachedInputTokens": 265472,
      "totalTokens": 294152,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 39033,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

instance-operations.restart-service

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
instance-operations.restart-service failed
Overall failed · No behavioral checks recorded

transient infrastructure

Historical local measurement: transient_infrastructure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 5s
Tokens62,494 in · 2,270 out656,640 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 15s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.instance-operations.restart-service
Attempt
1
Duration
2m 5s
Agent runtime
1m 15s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
390be6eb-5479-4a63-89e9-5b4b433bf647unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 62494,
      "outputTokens": 2270,
      "cachedInputTokens": 656640,
      "totalTokens": 721404,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 75084,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

navigation-preferences.find-project-view

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
navigation-preferences.find-project-view failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 18s
Tokens23,424 in · 1,288 out452,096 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 39s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.navigation-preferences.find-project-view
Attempt
1
Duration
2m 18s
Agent runtime
1m 39s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
18352199-c901-4699-92c4-87b9788ea739unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 23424,
      "outputTokens": 1288,
      "cachedInputTokens": 452096,
      "totalTokens": 476808,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 98732,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

onboarding.first-work

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
onboarding.first-work failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 6m 21s
Tokens46,543 (partial: 1/2 runs) in · 11,960 (partial: 1/2 runs) out602,496 (partial: 1/2 runs) cached · 1/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered4m 21s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.onboarding.first-work
Attempt
1
Duration
6m 21s
Agent runtime
4m 21s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
2a80750d-e52f-4bb3-9a5e-d7184527f4e5unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
85629442-539c-45dd-8184-1802d0594694unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 46543,
      "outputTokens": 11960,
      "cachedInputTokens": 602496,
      "totalTokens": 660999,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 261131,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

projects.archive-project

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
projects.archive-project failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 8s
Tokens27,376 in · 1,061 out321,664 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered45s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.projects.archive-project
Attempt
1
Duration
1m 8s
Agent runtime
45s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
feaec8ea-8b28-44bd-b037-77c9faf5e047unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 27376,
      "outputTokens": 1061,
      "cachedInputTokens": 321664,
      "totalTokens": 350101,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 44508,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

projects.create-project

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
projects.create-project failed
Overall failed · 10/10 behavioral checks passed

No behavioral matcher failed. The overall failure came from a separate run, cleanup, or evidence check.

See all behavioral checks (10)
ResultCheckDetail
Passchat.complete-independent-observationOriginal retained check passed.
Passchat.one-company-projectOriginal retained check passed.
Passchat.agent-created-projectOriginal retained check passed.
Passchat.usable-project-linkOriginal retained check passed.
Passchat.retry-reuses-first-projectOriginal retained check passed.
Passchat.no-invented-ready-workOriginal retained check passed.
Passchat.catalog-complete-conditionsOriginal retained check passed.
Passchat.catalog-original-human-queryOriginal retained check passed.
Passchat.catalog-query-attachment-receiptsOriginal retained check passed.
Passchat.catalog-bounded-native-runsOriginal retained check passed.

Secret / evidence safety check failed

Historical local measurement: secret_leak_pending_harness_custody_diagnosis. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test details10/10 checks · 1m 55s
Tokens85,097 in · 2,054 out617,088 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered1m 30s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.projects.create-project
Attempt
1
Duration
1m 55s
Agent runtime
1m 30s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
745fa7c6-e543-4c8d-aafd-4a16a676162dunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
92c2fb9f-3865-478c-986d-59ef9c207ce0unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.complete-independent-observation","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.one-company-project","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.agent-created-project","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.usable-project-link","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.retry-reuses-first-project","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.no-invented-ready-work","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Original retained check passed.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 85097,
      "outputTokens": 2054,
      "cachedInputTokens": 617088,
      "totalTokens": 704239,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 89531,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

projects.project-defaults

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
projects.project-defaults failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 20s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered56s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.projects.project-defaults
Attempt
1
Duration
1m 20s
Agent runtime
56s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
aa975ef1-f269-411c-8e09-7b1ad6440573unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 15167,
      "outputTokens": 742,
      "cachedInputTokens": 113024,
      "totalTokens": 128933,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 56309,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

projects.project-work

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
projects.project-work passed
Test details15/15 checks · 2m 43s
Overall passed · 15/15 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (15)
ResultCheckDetail
Passchat.complete-creation-evidenceOriginal retained check passed.
Passchat.one-ordinary-company-taskOriginal retained check passed.
Passchat.requested-work-capturedOriginal retained check passed.
Passchat.one-launch-and-attributionOriginal retained check passed.
Passchat.retained-chat-and-linksOriginal retained check passed.
Passchat.separate-admitted-workerOriginal retained check passed.
Passchat.no-premature-website-successOriginal retained check passed.
Passchat.existing-work-preservedOriginal retained check passed.
Passchat.launch-leftover-summaryOriginal retained check passed.
Passchat.catalog-complete-conditionsOriginal retained check passed.
Passchat.catalog-original-human-queryOriginal retained check passed.
Passchat.catalog-query-attachment-receiptsOriginal retained check passed.
Passchat.catalog-bounded-native-runsOriginal retained check passed.
Passchat.catalog-exact-owned-worker-cancellationOriginal retained check passed.
Passchat.catalog-settled-source-separate-workOriginal retained check passed.
Tokens36,449 in · 3,587 out560,768 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered2m 44s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.projects.project-work
Attempt
1
Duration
2m 43s
Agent runtime
2m 44s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
ac2cbc77-2d38-45a1-8246-5c32fabbab59unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
1263b1f9-0f4c-42cb-b254-dfa4f582ef4dunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.complete-creation-evidence","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.one-ordinary-company-task","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.requested-work-captured","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.one-launch-and-attribution","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.retained-chat-and-links","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.separate-admitted-worker","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.no-premature-website-success","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.existing-work-preserved","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.launch-leftover-summary","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-exact-owned-worker-cancellation","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-settled-source-separate-work","expected":true} Original retained check passed.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 36449,
      "outputTokens": 3587,
      "cachedInputTokens": 560768,
      "totalTokens": 600804,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 164042,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

questions-and-approvals.accept-one-proposal

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
questions-and-approvals.accept-one-proposal passed
Test details9/9 checks · 2m 10s
Overall passed · 9/9 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (9)
ResultCheckDetail
Passchat.complete-confirmation-workflowOriginal retained check passed.
Passchat.same-proposal-and-human-commentOriginal retained check passed.
Passchat.one-attributed-conversational-decisionOriginal retained check passed.
Passchat.actual-action-onceOriginal retained check passed.
Passchat.repeat-did-not-replace-decisionOriginal retained check passed.
Passchat.catalog-complete-conditionsOriginal retained check passed.
Passchat.catalog-original-human-queryOriginal retained check passed.
Passchat.catalog-query-attachment-receiptsOriginal retained check passed.
Passchat.catalog-bounded-native-runsOriginal retained check passed.
Tokens87,517 in · 5,606 out1,181,568 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered1m 46s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.questions-and-approvals.accept-one-proposal
Attempt
1
Duration
2m 10s
Agent runtime
1m 46s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
95441b43-88c5-4ac0-adcc-c595c4370eaaunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
447efa51-2801-4b44-ab4b-5b056d687d72unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.complete-confirmation-workflow","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.same-proposal-and-human-comment","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.one-attributed-conversational-decision","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.actual-action-once","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.repeat-did-not-replace-decision","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Original retained check passed.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 87517,
      "outputTokens": 5606,
      "cachedInputTokens": 1181568,
      "totalTokens": 1274691,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 106222,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

questions-and-approvals.ambiguous-yes

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
questions-and-approvals.ambiguous-yes passed
Test details9/9 checks · 59s
Overall passed · 9/9 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (9)
ResultCheckDetail
Passchat.complete-interaction-evidenceOriginal retained check passed.
Passchat.two-original-proposals-pendingOriginal retained check passed.
Passchat.neither-action-executedOriginal retained check passed.
Passchat.specific-disambiguationOriginal retained check passed.
Passchat.stale-and-expired-cannot-authorizeOriginal retained check passed.
Passchat.catalog-complete-conditionsOriginal retained check passed.
Passchat.catalog-original-human-queryOriginal retained check passed.
Passchat.catalog-query-attachment-receiptsOriginal retained check passed.
Passchat.catalog-bounded-native-runsOriginal retained check passed.
Tokens27,583 in · 1,237 out257,024 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered41s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.questions-and-approvals.ambiguous-yes
Attempt
1
Duration
59s
Agent runtime
41s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
7a9be274-6b6e-4604-a0d1-7674b62ac27eunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.complete-interaction-evidence","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.two-original-proposals-pending","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.neither-action-executed","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.specific-disambiguation","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.stale-and-expired-cannot-authorize","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Original retained check passed.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 27583,
      "outputTokens": 1237,
      "cachedInputTokens": 257024,
      "totalTokens": 285844,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 41273,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

questions-and-approvals.approve-tool-once

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
questions-and-approvals.approve-tool-once failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 46s
Tokens57,013 in · 1,374 out372,608 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered44s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.questions-and-approvals.approve-tool-once
Attempt
1
Duration
2m 46s
Agent runtime
44s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
3fc7838b-9a9d-414b-94de-96debe1f740funknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 57013,
      "outputTokens": 1374,
      "cachedInputTokens": 372608,
      "totalTokens": 430995,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 44105,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

questions-and-approvals.decline-tool

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
questions-and-approvals.decline-tool failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 22s
Tokens55,565 in · 2,711 out472,704 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered1m 1s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.questions-and-approvals.decline-tool
Attempt
1
Duration
1m 22s
Agent runtime
1m 1s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
f7d5beca-5969-40f1-9ee6-90265d3b9cf7unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
a03a9952-7c67-4a06-9f3f-a33e491fd95cunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 55565,
      "outputTokens": 2711,
      "cachedInputTokens": 472704,
      "totalTokens": 530980,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 60601,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

questions-and-approvals.defer-and-reopen

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
questions-and-approvals.defer-and-reopen failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 4s
Tokens16,777 in · 572 out172,416 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered26s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.questions-and-approvals.defer-and-reopen
Attempt
1
Duration
1m 4s
Agent runtime
26s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
5c26c261-c15b-40b7-86fb-a458f5d416baunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 16777,
      "outputTokens": 572,
      "cachedInputTokens": 172416,
      "totalTokens": 189765,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 25915,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

questions-and-approvals.duplicate-answer

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
questions-and-approvals.duplicate-answer failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 43s
Tokens68,446 in · 4,773 out1,070,976 cached · 3/3 runs covered
LLM spendUnavailable0/3 runs provider-priced
ExecutionLocal · not metered1m 55s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.questions-and-approvals.duplicate-answer
Attempt
1
Duration
2m 43s
Agent runtime
1m 55s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
213834c7-0d7d-434b-81d3-507ea6f3c606unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ae124e6a-9962-4b28-9128-727ba59852b1unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
7de7738a-cd7d-4fa4-a40d-23e7868170c0unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 3,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 68446,
      "outputTokens": 4773,
      "cachedInputTokens": 1070976,
      "totalTokens": 1144195,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 114710,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

questions-and-approvals.formal-hire-revision

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
questions-and-approvals.formal-hire-revision failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 15s
Tokens55,315 in · 3,522 out707,712 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 34s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.questions-and-approvals.formal-hire-revision
Attempt
1
Duration
2m 15s
Agent runtime
1m 34s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
db5ee076-1b96-482c-a348-ea32afcdb9eeunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 55315,
      "outputTokens": 3522,
      "cachedInputTokens": 707712,
      "totalTokens": 766549,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 94060,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

questions-and-approvals.multi-part-question

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
questions-and-approvals.multi-part-question failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 23s
Tokens27,025 in · 1,665 out219,008 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered45s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.questions-and-approvals.multi-part-question
Attempt
1
Duration
1m 23s
Agent runtime
45s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
2d8bf13c-f957-40e4-94f7-95530fc7b9b6unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 27025,
      "outputTokens": 1665,
      "cachedInputTokens": 219008,
      "totalTokens": 247698,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 44819,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

questions-and-approvals.necessary-question

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
questions-and-approvals.necessary-question failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 27s
Tokens57,977 in · 3,308 out548,224 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered1m 2s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.questions-and-approvals.necessary-question
Attempt
1
Duration
1m 27s
Agent runtime
1m 2s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
56627c9a-af7f-4d47-ba84-e434fb5567a5unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
b34f728a-42f8-4bae-8c7a-41fd8dd7e0aeunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 57977,
      "outputTokens": 3308,
      "cachedInputTokens": 548224,
      "totalTokens": 609509,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 62083,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

questions-and-approvals.reject-and-revise

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
questions-and-approvals.reject-and-revise failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 30s
Tokens20,372 in · 1,362 out251,648 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered47s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.questions-and-approvals.reject-and-revise
Attempt
1
Duration
1m 30s
Agent runtime
47s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
9eda6b94-8c62-4219-a60e-4397ecbdb85cunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 20372,
      "outputTokens": 1362,
      "cachedInputTokens": 251648,
      "totalTokens": 273382,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 47066,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

questions-and-approvals.review-plan

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
questions-and-approvals.review-plan failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 3m 45s
Tokens107,682 in · 13,207 out1,559,296 cached · 3/3 runs covered
LLM spendUnavailable0/3 runs provider-priced
ExecutionLocal · not metered3m 37s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.questions-and-approvals.review-plan
Attempt
1
Duration
3m 45s
Agent runtime
3m 37s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
67752c32-a74a-4e90-9872-37039a79f7e5unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
510c6159-c783-47c1-8497-4f55498ec3efunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
d7f89b0b-4aa4-4f20-9e30-ca74ecf86d4cunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 3,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 107682,
      "outputTokens": 13207,
      "cachedInputTokens": 1559296,
      "totalTokens": 1680185,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 217069,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

recovery.browser-reconnect

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
recovery.browser-reconnect failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 42s
Tokens7,990 in · 894 out69,376 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered27s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.recovery.browser-reconnect
Attempt
1
Duration
42s
Agent runtime
27s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
90f85bd5-88cd-4f05-94e7-3bb0cf5f2d4cunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 7990,
      "outputTokens": 894,
      "cachedInputTokens": 69376,
      "totalTokens": 78260,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 26538,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

recovery.controller-restart

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
recovery.controller-restart failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 6s
Tokens18,891 in · 2,760 out248,832 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered57s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.recovery.controller-restart
Attempt
1
Duration
1m 6s
Agent runtime
57s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
3774fa27-bcef-4984-bc1f-d0dfb82e5e89unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 18891,
      "outputTokens": 2760,
      "cachedInputTokens": 248832,
      "totalTokens": 270483,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 57306,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

recovery.explain-stall

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
recovery.explain-stall failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 45s
Tokens8,149 in · 1,040 out69,376 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered27s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.recovery.explain-stall
Attempt
1
Duration
45s
Agent runtime
27s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
a9be548c-5e45-4904-9c56-79ee8ae1ea35unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 8149,
      "outputTokens": 1040,
      "cachedInputTokens": 69376,
      "totalTokens": 78565,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 27089,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

recovery.post-stop-message

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
recovery.post-stop-message failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 10s
Tokens18,589 in · 7,234 out241,536 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 57s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.recovery.post-stop-message
Attempt
1
Duration
2m 10s
Agent runtime
1m 57s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
c515dc28-0cc2-4cc9-9501-11fca9e59cc6unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 18589,
      "outputTokens": 7234,
      "cachedInputTokens": 241536,
      "totalTokens": 267359,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 117491,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

recovery.retry-exhausted

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
recovery.retry-exhausted failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 50s
Tokens7,971 in · 990 out69,376 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered31s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.recovery.retry-exhausted
Attempt
1
Duration
50s
Agent runtime
31s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
b8d896b9-e0b2-4540-bb16-aa0796f2655bunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 7971,
      "outputTokens": 990,
      "cachedInputTokens": 69376,
      "totalTokens": 78337,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 31099,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

recovery.source-action

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
recovery.source-action failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 51s
Tokens8,185 in · 1,094 out69,632 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered31s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.recovery.source-action
Attempt
1
Duration
51s
Agent runtime
31s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
38cd9079-7d75-4ce2-a7ad-63622f0d38a2unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 8185,
      "outputTokens": 1094,
      "cachedInputTokens": 69632,
      "totalTokens": 78911,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 30613,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

routines.create-daily-brief

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
routines.create-daily-brief failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 57s
Tokens59,873 in · 2,845 out915,072 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 33s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.routines.create-daily-brief
Attempt
1
Duration
1m 57s
Agent runtime
1m 33s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
096efbbf-aac8-4011-acfb-b6d847e045abunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 59873,
      "outputTokens": 2845,
      "cachedInputTokens": 915072,
      "totalTokens": 977790,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 93444,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

routines.manage-other-owner

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
routines.manage-other-owner failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 42s
Tokens31,643 in · 1,949 out507,392 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 13s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.routines.manage-other-owner
Attempt
1
Duration
1m 42s
Agent runtime
1m 13s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
081c3911-e233-480f-b50d-f0301fe52773unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 31643,
      "outputTokens": 1949,
      "cachedInputTokens": 507392,
      "totalTokens": 540984,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 73012,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

routines.pause-owned

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
routines.pause-owned failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 3m 18s
Tokens8,576 in · 530 out95,872 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered20s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.routines.pause-owned
Attempt
1
Duration
3m 18s
Agent runtime
20s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
53054c67-fadf-4d4d-8c0a-c215e64f23ddunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 8576,
      "outputTokens": 530,
      "cachedInputTokens": 95872,
      "totalTokens": 104978,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 19727,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

routines.read-history

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
routines.read-history failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 25s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered6s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.routines.read-history
Attempt
1
Duration
25s
Agent runtime
6s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
634f2ffd-f698-4a2e-9547-3a14d5732b90unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 6436,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

routines.run-now

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
routines.run-now failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 8s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.routines.run-now
Attempt
1
Duration
8s
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

routines.webhook-trigger

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
routines.webhook-trigger failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 12s
Tokens33,259 in · 1,825 out378,752 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 4s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.routines.webhook-trigger
Attempt
1
Duration
1m 12s
Agent runtime
1m 4s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
bf6d0a92-efc9-4e49-86f1-3ebd030cdd6bunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 33259,
      "outputTokens": 1825,
      "cachedInputTokens": 378752,
      "totalTokens": 413836,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 63572,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

runs-adapters.inspect-failed-run

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
runs-adapters.inspect-failed-run failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 52s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered8s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.runs-adapters.inspect-failed-run
Attempt
1
Duration
52s
Agent runtime
8s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
27d2100f-7096-47ac-befa-1bd8279d67f4unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 7655,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

runs-adapters.list-model-options

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
runs-adapters.list-model-options passed
Test details11/11 checks · 1m 24s
Overall passed · 11/11 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (11)
ResultCheckDetail
Passchat.authorized-model-discovery-evidenceOriginal retained check passed.
Passchat.at-least-one-current-discovered-optionOriginal retained check passed.
Passchat.no-unqualified-model-inventoryOriginal retained check passed.
Passchat.availability-not-account-qualificationOriginal retained check passed.
Passchat.restricted-runtime-read-deniedOriginal retained check passed.
Passchat.configuration-and-permissions-preservedOriginal retained check passed.
Passchat.private-credential-scan-completeOriginal retained check passed.
Passchat.catalog-complete-conditionsOriginal retained check passed.
Passchat.catalog-original-human-queryOriginal retained check passed.
Passchat.catalog-query-attachment-receiptsOriginal retained check passed.
Passchat.catalog-bounded-native-runsOriginal retained check passed.
Tokens61,888 in · 1,544 out319,360 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 3s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.runs-adapters.list-model-options
Attempt
1
Duration
1m 24s
Agent runtime
1m 3s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
494cdb3f-95ea-44ad-afc0-f303b7909373unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.authorized-model-discovery-evidence","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.at-least-one-current-discovered-option","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.no-unqualified-model-inventory","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.availability-not-account-qualification","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.restricted-runtime-read-denied","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.configuration-and-permissions-preserved","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.private-credential-scan-complete","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Original retained check passed.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 61888,
      "outputTokens": 1544,
      "cachedInputTokens": 319360,
      "totalTokens": 382792,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 63498,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

runs-adapters.reset-session

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
runs-adapters.reset-session failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 44s
Tokens44,379 in · 5,812 out787,584 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered2m 25s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.runs-adapters.reset-session
Attempt
1
Duration
2m 44s
Agent runtime
2m 25s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
e2491d47-dab2-40f4-8d61-90ee464c169dunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
b7be9b90-6ae0-4a75-9234-a8ca46abce3bunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 44379,
      "outputTokens": 5812,
      "cachedInputTokens": 787584,
      "totalTokens": 837775,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 144807,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

secrets.ask-for-plaintext

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
secrets.ask-for-plaintext failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 52s
Tokens17,933 in · 1,004 out174,720 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered37s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.secrets.ask-for-plaintext
Attempt
1
Duration
52s
Agent runtime
37s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
68d31611-f44e-47e6-83ef-8ecd52337a4funknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 17933,
      "outputTokens": 1004,
      "cachedInputTokens": 174720,
      "totalTokens": 193657,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 36895,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

secrets.configure-company-secret

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
secrets.configure-company-secret failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 29s
Tokens39,133 in · 1,934 out481,664 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 14s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.secrets.configure-company-secret
Attempt
1
Duration
1m 29s
Agent runtime
1m 14s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
361029bc-1157-45d8-b67f-16f4e4035c2cunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 39133,
      "outputTokens": 1934,
      "cachedInputTokens": 481664,
      "totalTokens": 522731,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 73681,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

secrets.least-scope-delivery

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
secrets.least-scope-delivery failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 12s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.secrets.least-scope-delivery
Attempt
1
Duration
12s
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

secrets.secret-proposal

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
secrets.secret-proposal failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 57s
Tokens18,143 in · 828 out139,776 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered37s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.secrets.secret-proposal
Attempt
1
Duration
57s
Agent runtime
37s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
015d8402-47b7-4479-b648-c7ab5949b43cunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 18143,
      "outputTokens": 828,
      "cachedInputTokens": 139776,
      "totalTokens": 158747,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 36846,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

skills.author-skill

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
skills.author-skill failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 28s
Tokens18,639 in · 2,134 out208,512 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 0s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.skills.author-skill
Attempt
1
Duration
1m 28s
Agent runtime
1m 0s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
3e3bf266-7734-4917-8930-0dcf78e096d9unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 18639,
      "outputTokens": 2134,
      "cachedInputTokens": 208512,
      "totalTokens": 229285,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 59723,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

skills.explicit-restriction

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
skills.explicit-restriction failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 27s
Tokens24,601 in · 2,231 out286,976 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 4s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.skills.explicit-restriction
Attempt
1
Duration
1m 27s
Agent runtime
1m 4s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
8a6f8cac-e717-4d31-9cd2-ae3a986f28b8unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 24601,
      "outputTokens": 2231,
      "cachedInputTokens": 286976,
      "totalTokens": 313808,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 63915,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

skills.find-and-install

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
skills.find-and-install failed
Overall failed · No behavioral checks recorded

transient infrastructure

Historical local measurement: transient_infrastructure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 13s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered2m 3s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.skills.find-and-install
Attempt
1
Duration
2m 13s
Agent runtime
2m 3s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
ca1f84da-7acd-46ac-8c01-7d7d89a9630eunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 53051,
      "outputTokens": 3580,
      "cachedInputTokens": 692736,
      "totalTokens": 749367,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 123047,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

skills.fork-read-only

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
skills.fork-read-only failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 5s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.skills.fork-read-only
Attempt
1
Duration
5s
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

skills.review-update

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
skills.review-update failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 13s
Tokens34,672 in · 1,493 out380,672 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 2s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.skills.review-update
Attempt
1
Duration
1m 13s
Agent runtime
1m 2s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
f0521991-2f8a-432d-a6f7-2d345a16a27eunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 34672,
      "outputTokens": 1493,
      "cachedInputTokens": 380672,
      "totalTokens": 416837,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 61751,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

skills.studio-test

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
skills.studio-test failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 4m 16s
Tokens30,113 in · 1,703 out364,160 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 0s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.skills.studio-test
Attempt
1
Duration
4m 16s
Agent runtime
1m 0s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
b24b514e-9498-4a4b-a8c6-3796aa827899unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 30113,
      "outputTokens": 1703,
      "cachedInputTokens": 364160,
      "totalTokens": 395976,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 60371,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

status-cards.archive-card

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
status-cards.archive-card failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 4m 8s
Tokens84,419 in · 7,609 out1,238,144 cached · 3/3 runs covered
LLM spendUnavailable0/3 runs provider-priced
ExecutionLocal · not metered3m 25s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.status-cards.archive-card
Attempt
1
Duration
4m 8s
Agent runtime
3m 25s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
2bbfd80d-95ec-4dec-b9af-943de5e65846unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
01da12b0-5497-4540-a9ab-e0fa5b97fec1unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
678246f3-394c-4e46-b8ab-713cf8b2b0bdunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 3,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 84419,
      "outputTokens": 7609,
      "cachedInputTokens": 1238144,
      "totalTokens": 1330172,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 205153,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

status-cards.create-card

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
status-cards.create-card failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 30s
Tokens26,334 in · 1,472 out303,232 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 0s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.status-cards.create-card
Attempt
1
Duration
1m 30s
Agent runtime
1m 0s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
4fa06b53-e9e1-44c0-b1be-992237b56639unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 26334,
      "outputTokens": 1472,
      "cachedInputTokens": 303232,
      "totalTokens": 331038,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 60172,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

status-cards.explain-card

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
status-cards.explain-card failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 59s
Tokens68,870 in · 5,133 out1,001,600 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered2m 32s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.status-cards.explain-card
Attempt
1
Duration
2m 59s
Agent runtime
2m 32s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
09e176ff-5aac-4e95-8007-71fef0bec830unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
d112ff5d-621e-4055-99f8-e6f0f74bbcccunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 68870,
      "outputTokens": 5133,
      "cachedInputTokens": 1001600,
      "totalTokens": 1075603,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 152448,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

status-cards.other-authors-card

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
status-cards.other-authors-card failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 33s
Tokens46,690 (partial: 1/3 runs) in · 5,610 (partial: 1/3 runs) out802,048 (partial: 1/3 runs) cached · 1/3 runs covered
LLM spendUnavailable0/3 runs provider-priced
ExecutionLocal · not metered2m 21s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.status-cards.other-authors-card
Attempt
1
Duration
2m 33s
Agent runtime
2m 21s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
1efcb976-fa9f-404e-81fa-4c5155c2448aunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
e4df1e4e-4cfb-4633-b742-77e9120e5824unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
d60a9edb-b0f4-4641-96a3-9d5bcac8f51aunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 46690,
      "outputTokens": 5610,
      "cachedInputTokens": 802048,
      "totalTokens": 854348,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 141387,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

status-cards.refresh-card

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
status-cards.refresh-card failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 6m 55s
Tokens208,825 in · 13,243 out3,147,776 cached · 5/5 runs covered
LLM spendUnavailable0/5 runs provider-priced
ExecutionLocal · not metered4m 29s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.status-cards.refresh-card
Attempt
1
Duration
6m 55s
Agent runtime
4m 29s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
5fd4c85d-5b4e-4660-b4b9-6fdeae5e6035unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
dcb4c63c-868f-4459-9e59-79e3eeb8fd96unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
557f9090-f382-4602-b9a1-8612e7104043unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
85fa644a-4ddd-48d1-9859-289b9b6413afunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
48395bd0-1d23-4941-b118-6487dd10914eunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 5,
      "runsWithTokenUsage": 5,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 208825,
      "outputTokens": 13243,
      "cachedInputTokens": 3147776,
      "totalTokens": 3369844,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 269248,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

steering.approval-delivery

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
steering.approval-delivery failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 48s
Tokens8,268 in · 895 out121,472 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered29s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.steering.approval-delivery
Attempt
1
Duration
48s
Agent runtime
29s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
470ccb0a-50b5-4d52-81c5-f7bf4dd6d72dunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 8268,
      "outputTokens": 895,
      "cachedInputTokens": 121472,
      "totalTokens": 130635,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 29202,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

steering.discard-queued-message

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
steering.discard-queued-message failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 51s
Tokens8,129 in · 1,007 out69,376 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered32s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.steering.discard-queued-message
Attempt
1
Duration
51s
Agent runtime
32s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
c0f2e254-288e-4b7e-8dc5-a3e51744d13dunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 8129,
      "outputTokens": 1007,
      "cachedInputTokens": 69376,
      "totalTokens": 78512,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 32295,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

steering.edit-queued-message

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
steering.edit-queued-message failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 52s
Tokens8,162 in · 1,014 out69,376 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered31s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.steering.edit-queued-message
Attempt
1
Duration
52s
Agent runtime
31s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
db38539c-cbfb-4628-93c4-b4b6a3c4d06eunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 8162,
      "outputTokens": 1014,
      "cachedInputTokens": 69376,
      "totalTokens": 78552,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 31310,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

steering.interrupt-with-direction

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
steering.interrupt-with-direction failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 47s
Tokens7,976 in · 970 out69,376 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered28s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.steering.interrupt-with-direction
Attempt
1
Duration
47s
Agent runtime
28s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
57109c62-46fa-41f1-962a-75b87adb9c29unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 7976,
      "outputTokens": 970,
      "cachedInputTokens": 69376,
      "totalTokens": 78322,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 28123,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

steering.preserve-draft

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
steering.preserve-draft passed
Test details12/12 checks · 1m 58s
Overall passed · 12/12 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (12)
ResultCheckDetail
Passchat.real-draft-and-upload-evidenceOriginal retained check passed.
Passchat.draft-survived-switch-and-reloadOriginal retained check passed.
Passchat.one-message-with-original-uploadOriginal retained check passed.
Passchat.actual-file-bytes-retainedOriginal retained check passed.
Passchat.uncertain-send-reconciled-without-duplicationOriginal retained check passed.
Passchat.other-task-unchangedOriginal retained check passed.
Passchat.catalog-complete-conditionsOriginal retained check passed.
Passchat.catalog-original-human-queryOriginal retained check passed.
Passchat.catalog-query-attachment-receiptsOriginal retained check passed.
Passchat.catalog-bounded-native-runsOriginal retained check passed.
Passchat.catalog-exact-owned-worker-cancellationOriginal retained check passed.
Passchat.catalog-settled-source-separate-workOriginal retained check passed.
Tokens34,484 (partial: 1/2 runs) in · 3,021 (partial: 1/2 runs) out358,144 (partial: 1/2 runs) cached · 1/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered1m 52s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.steering.preserve-draft
Attempt
1
Duration
1m 58s
Agent runtime
1m 52s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
ba7442cb-37eb-45f1-ae24-008337e84eaaunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
192c9bfe-4e23-4029-9b28-a0ee7873094funknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.real-draft-and-upload-evidence","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.draft-survived-switch-and-reload","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.one-message-with-original-upload","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.actual-file-bytes-retained","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.uncertain-send-reconciled-without-duplication","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.other-task-unchanged","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-exact-owned-worker-cancellation","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-settled-source-separate-work","expected":true} Original retained check passed.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 34484,
      "outputTokens": 3021,
      "cachedInputTokens": 358144,
      "totalTokens": 395649,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 111951,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

steering.queue-follow-up

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
steering.queue-follow-up failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 41s
Tokens7,934 in · 995 out69,376 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered25s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.steering.queue-follow-up
Attempt
1
Duration
41s
Agent runtime
25s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
bbf68b6a-79a5-4f23-9816-ec841b1baeddunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 7934,
      "outputTokens": 995,
      "cachedInputTokens": 69376,
      "totalTokens": 78305,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 25439,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

steering.steer-active

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
steering.steer-active failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 43s
Tokens8,019 in · 1,040 out69,376 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered26s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.steering.steer-active
Attempt
1
Duration
43s
Agent runtime
26s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
474fbcfb-5df1-45d6-87b1-a7f0697c3a2dunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 8019,
      "outputTokens": 1040,
      "cachedInputTokens": 69376,
      "totalTokens": 78435,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 25892,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

steering.stop-versus-pause

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
steering.stop-versus-pause failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 12s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.steering.stop-versus-pause
Attempt
1
Duration
1m 12s
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

task-coordination.block-on-design

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
task-coordination.block-on-design failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 2s
Tokens35,425 in · 1,604 out211,072 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 5s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.task-coordination.block-on-design
Attempt
1
Duration
2m 2s
Agent runtime
1m 5s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
f9276ebc-ef31-44af-8f47-f527baabcfe7unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 35425,
      "outputTokens": 1604,
      "cachedInputTokens": 211072,
      "totalTokens": 248101,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 65475,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

task-coordination.delegate-with-context

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
task-coordination.delegate-with-context failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 23s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.task-coordination.delegate-with-context
Attempt
1
Duration
23s
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

task-coordination.independent-review

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
task-coordination.independent-review failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 18s
Tokens15,923 in · 5,447 out251,264 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 43s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.task-coordination.independent-review
Attempt
1
Duration
2m 18s
Agent runtime
1m 43s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
9987f165-9e71-4ae3-9bf7-8b5126829be7unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 15923,
      "outputTokens": 5447,
      "cachedInputTokens": 251264,
      "totalTokens": 272634,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 103165,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

task-coordination.pause-tree

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
task-coordination.pause-tree failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 54s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.task-coordination.pause-tree
Attempt
1
Duration
1m 54s
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

task-coordination.reject-dependency-cycle

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
task-coordination.reject-dependency-cycle passed
Test details8/8 checks · 1m 17s
Overall passed · 8/8 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (8)
ResultCheckDetail
Passchat.complete-dependency-observationOriginal retained check passed.
Passchat.original-edge-retained-reverse-edge-absentOriginal retained check passed.
Passchat.same-company-unchanged-task-recordsOriginal retained check passed.
Passchat.explains-actual-conflict-and-next-decisionOriginal retained check passed.
Passchat.catalog-complete-conditionsOriginal retained check passed.
Passchat.catalog-original-human-queryOriginal retained check passed.
Passchat.catalog-query-attachment-receiptsOriginal retained check passed.
Passchat.catalog-bounded-native-runsOriginal retained check passed.
Tokens32,268 in · 1,392 out420,608 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered58s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.task-coordination.reject-dependency-cycle
Attempt
1
Duration
1m 17s
Agent runtime
58s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
203238ee-e8fc-47a5-be47-97b3b0e2c1a0unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.complete-dependency-observation","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.original-edge-retained-reverse-edge-absent","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.same-company-unchanged-task-records","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.explains-actual-conflict-and-next-decision","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Original retained check passed.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 32268,
      "outputTokens": 1392,
      "cachedInputTokens": 420608,
      "totalTokens": 454268,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 58383,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

tasks.ambiguous-task

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
tasks.ambiguous-task failed
Overall failed · No behavioral checks recorded

transient infrastructure

Historical local measurement: transient_infrastructure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 5m 1s
Tokens78,551 (partial: 1/2 runs) in · 4,802 (partial: 1/2 runs) out958,592 (partial: 1/2 runs) cached · 1/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered3m 58s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.tasks.ambiguous-task
Attempt
1
Duration
5m 1s
Agent runtime
3m 58s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
a67ce7ea-f697-4d67-b6c3-1b7bcb1a7e04unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
6e5c4af9-af1d-40a5-86bb-b4a5cd603604unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 78551,
      "outputTokens": 4802,
      "cachedInputTokens": 958592,
      "totalTokens": 1041945,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 237660,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

tasks.comment-with-reference

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
tasks.comment-with-reference failed
Overall failed · No behavioral checks recorded

cleanup failure

Historical local measurement: eval_harness_startup_doctor_requires_persisted_database_dsn. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 9s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.tasks.comment-with-reference
Attempt
1
Duration
9s
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

create-backlog

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
create-backlog passed
Test details10/10 checks · 1m 14s
Overall passed · 10/10 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (10)
ResultCheckDetail
Passchat.one-human-requestOriginal retained check passed.
Passchat.one-assigned-taskOriginal retained check passed.
Passchat.task-request-capturedOriginal retained check passed.
Passchat.agent-created-taskOriginal retained check passed.
Passchat.bounded-native-workOriginal retained check passed.
Passchat.conversation-retainedOriginal retained check passed.
Passchat.chat-task-linkOriginal retained check passed.
Passchat.saved-without-executionOriginal retained check passed.
Passchat.backlog-replyOriginal retained check passed.
Passchat.browser-result-accessOriginal retained check passed.
Tokens41,350 in · 1,633 out303,488 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered52s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.create-backlog
Attempt
1
Duration
1m 14s
Agent runtime
52s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
ab5d3e91-10a9-45a8-b61d-ec1148459ff7unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.one-human-request","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.one-assigned-task","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.task-request-captured","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.agent-created-task","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.bounded-native-work","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.conversation-retained","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.chat-task-link","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.saved-without-execution","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.backlog-reply","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.browser-result-access","expected":true} Original retained check passed.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 41350,
      "outputTokens": 1633,
      "cachedInputTokens": 303488,
      "totalTokens": 346471,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 52096,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

delegate-announcement

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
delegate-announcement passed
Test details15/15 checks · 2m 55s
Overall passed · 15/15 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (15)
ResultCheckDetail
Passchat.one-human-requestOriginal retained check passed.
Passchat.one-assigned-taskOriginal retained check passed.
Passchat.task-request-capturedOriginal retained check passed.
Passchat.agent-created-taskOriginal retained check passed.
Passchat.bounded-native-workOriginal retained check passed.
Passchat.conversation-retainedOriginal retained check passed.
Passchat.chat-task-linkOriginal retained check passed.
Passchat.worker-executedOriginal retained check passed.
Passchat.grounded-worker-documentOriginal retained check passed.
Passchat.completion-worker-doneOriginal retained check passed.
Passchat.completion-output-savedOriginal retained check passed.
Passchat.completion-source-responseOriginal retained check passed.
Passchat.completion-source-correlatedOriginal retained check passed.
Passchat.completion-result-accessOriginal retained check passed.
Passchat.browser-result-accessOriginal retained check passed.
Tokens129,760 in · 8,991 out799,872 cached · 3/3 runs covered
LLM spendUnavailable0/3 runs provider-priced
ExecutionLocal · not metered1m 59s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.delegate-announcement
Attempt
1
Duration
2m 55s
Agent runtime
1m 59s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
2e00768c-8e2e-45bd-bba1-fe59d5cf42b5unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
d9e35e77-7416-4ff3-bcfb-c57f631923a2unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
690b831d-13d0-4cce-888c-4c6c4974a782unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.one-human-request","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.one-assigned-task","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.task-request-captured","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.agent-created-task","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.bounded-native-work","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.conversation-retained","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.chat-task-link","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.worker-executed","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.grounded-worker-document","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.completion-worker-done","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.completion-output-saved","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.completion-source-response","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.completion-source-correlated","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.completion-result-access","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.browser-result-access","expected":true} Original retained check passed.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 3,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 129760,
      "outputTokens": 8991,
      "cachedInputTokens": 799872,
      "totalTokens": 938623,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 118909,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

tasks.edit-properties

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
tasks.edit-properties failed
Overall failed · No behavioral checks recorded

transient infrastructure

Historical local measurement: transient_infrastructure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 42s
Tokens84,683 (partial: 2/3 runs) in · 3,558 (partial: 2/3 runs) out691,968 (partial: 2/3 runs) cached · 2/3 runs covered
LLM spendUnavailable0/3 runs provider-priced
ExecutionLocal · not metered1m 34s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.tasks.edit-properties
Attempt
1
Duration
1m 42s
Agent runtime
1m 34s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
f1678b0a-a8cf-45e1-a01c-dc446588d140unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
b5040e9a-ed8d-4b5b-8731-6a3da7fa0c34unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
f75b0f6c-9c31-4ce2-8bda-1d43a5b13803unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 84683,
      "outputTokens": 3558,
      "cachedInputTokens": 691968,
      "totalTokens": 780209,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 94368,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

tasks.website-task

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
tasks.website-task passed
Test details13/13 checks · 1m 16s
Overall passed · 13/13 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (13)
ResultCheckDetail
Passchat.complete-creation-evidenceOriginal retained check passed.
Passchat.one-ordinary-company-taskOriginal retained check passed.
Passchat.requested-work-capturedOriginal retained check passed.
Passchat.one-launch-and-attributionOriginal retained check passed.
Passchat.retained-chat-and-linksOriginal retained check passed.
Passchat.separate-admitted-workerOriginal retained check passed.
Passchat.no-premature-website-successOriginal retained check passed.
Passchat.existing-work-preservedOriginal retained check passed.
Passchat.catalog-complete-conditionsOriginal retained check passed.
Passchat.catalog-original-human-queryOriginal retained check passed.
Passchat.catalog-query-attachment-receiptsOriginal retained check passed.
Passchat.catalog-bounded-native-runsOriginal retained check passed.
Passchat.catalog-settled-source-separate-workOriginal retained check passed.
Tokens45,727 (partial: 1/2 runs) in · 1,779 (partial: 1/2 runs) out283,264 (partial: 1/2 runs) cached · 1/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered1m 20s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.tasks.website-task
Attempt
1
Duration
1m 16s
Agent runtime
1m 20s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
89d0ad99-daa2-48df-8601-12514da5195cunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ec9eb7cc-3b27-4f93-9584-26c90acc3494unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.complete-creation-evidence","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.one-ordinary-company-task","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.requested-work-captured","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.one-launch-and-attribution","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.retained-chat-and-links","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.separate-admitted-worker","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.no-premature-website-success","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.existing-work-preserved","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Original retained check passed.
Pass json_path {"kind":"json_path","path":"chat.catalog-settled-source-separate-work","expected":true} Original retained check passed.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 45727,
      "outputTokens": 1779,
      "cachedInputTokens": 283264,
      "totalTokens": 330770,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 79621,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

tasks.website-without-project

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
tasks.website-without-project failed
Overall failed · No behavioral checks recorded

transient infrastructure

Historical local measurement: transient_infrastructure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 50s
Tokens68,886 (partial: 1/2 runs) in · 11,542 (partial: 1/2 runs) out507,264 (partial: 1/2 runs) cached · 1/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered2m 57s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.tasks.website-without-project
Attempt
1
Duration
2m 50s
Agent runtime
2m 57s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
b7b1ed56-cb4e-43f4-97b0-dba8591f8e7cunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
90d73952-57b9-407f-9b6e-784f1494ff1dunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 68886,
      "outputTokens": 11542,
      "cachedInputTokens": 507264,
      "totalTokens": 587692,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 177270,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

teams.find-team

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
teams.find-team failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 55s
Tokens15,977 in · 1,061 out174,208 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered31s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.teams.find-team
Attempt
1
Duration
55s
Agent runtime
31s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
ba38f9c9-2485-4e3b-965a-0960a5cf8044unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 15977,
      "outputTokens": 1061,
      "cachedInputTokens": 174208,
      "totalTokens": 191246,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 31132,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

teams.preview-install

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
teams.preview-install failed
Overall failed · No behavioral checks recorded

transient infrastructure

Historical local measurement: transient_infrastructure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 1m 32s
Tokens30,878 in · 1,570 out381,056 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 7s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.teams.preview-install
Attempt
1
Duration
1m 32s
Agent runtime
1m 7s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
db80bd0d-801d-47c8-99c0-b0f6d2c55760unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 30878,
      "outputTokens": 1570,
      "cachedInputTokens": 381056,
      "totalTokens": 413504,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 67222,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

workspaces.inspect-git

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
workspaces.inspect-git failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 58s
Tokens27,137 in · 4,629 out434,048 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered2m 25s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.workspaces.inspect-git
Attempt
1
Duration
2m 58s
Agent runtime
2m 25s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
55aee9a7-462b-4791-8871-cdb787019d94unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
5d0ccb96-eee5-4b8b-b0d6-e75ba73cdeabunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 27137,
      "outputTokens": 4629,
      "cachedInputTokens": 434048,
      "totalTokens": 465814,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 144718,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

workspaces.locate-files

Inspect case ↗
Native Codex subscriptionIsolated localcodex · gpt-5.6-sol
workspaces.locate-files failed
Overall failed · No behavioral checks recorded

candidate failure

Historical local measurement: candidate_failure. Original failed outcome retained; no current OpenCode qualification. Public projection omits raw error text.
Original failed outcome retained.
Test detailsNo checks recorded · 2m 53s
Tokens35,627 in · 4,598 out519,296 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered1m 59s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-codex-subscription.local.workspaces.locate-files
Attempt
1
Duration
2m 53s
Agent runtime
1m 59s
Runtime
native
Provider
codex
Model
gpt-5.6-sol

Original failed outcome retained.

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
6bdf1989-457f-425e-a94a-3c6c4d3e2607unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
3eeb283f-02c9-4d79-bac9-4ad6b664d48cunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 35627,
      "outputTokens": 4598,
      "cachedInputTokens": 519296,
      "totalTokens": 559521,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 119382,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}
Screenshot evidence
Environment:
Duration Tokens Tests
Open original image ↗