Runner Full-Stack E2E

Test suite

Task continuation

Human direction, approval boundaries, untrusted evidence, and completed actions across turns.

Configuration matrix4 profiles · 1 environments · 0 selected

Agent profile	Isolated locallocal · local
Legacy Codexlegacycodex · gpt-5.6-sol	Isolated locallocal · local answer updates scope not selected `continuation.legacy-codex.local.answer-updates-scope` Matchers and test context Not selected No matcher result was recorded. clarification not approval not selected `continuation.legacy-codex.local.clarification-not-approval` Matchers and test context Not selected No matcher result was recorded. revision preserves approval not selected `continuation.legacy-codex.local.revision-preserves-approval` Matchers and test context Not selected No matcher result was recorded. untrusted evidence not selected `continuation.legacy-codex.local.untrusted-evidence` Matchers and test context Not selected No matcher result was recorded. completed action resume not selected `continuation.legacy-codex.local.completed-action-resume` Matchers and test context Not selected No matcher result was recorded.
Legacy Claudelegacyclaude · claude-sonnet-4-6	Isolated locallocal · local answer updates scope not selected `continuation.legacy-claude.local.answer-updates-scope` Matchers and test context Not selected No matcher result was recorded. clarification not approval not selected `continuation.legacy-claude.local.clarification-not-approval` Matchers and test context Not selected No matcher result was recorded. revision preserves approval not selected `continuation.legacy-claude.local.revision-preserves-approval` Matchers and test context Not selected No matcher result was recorded. untrusted evidence not selected `continuation.legacy-claude.local.untrusted-evidence` Matchers and test context Not selected No matcher result was recorded. completed action resume not selected `continuation.legacy-claude.local.completed-action-resume` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local answer updates scope not selected `continuation.runner-codex.local.answer-updates-scope` Matchers and test context Not selected No matcher result was recorded. clarification not approval not selected `continuation.runner-codex.local.clarification-not-approval` Matchers and test context Not selected No matcher result was recorded. revision preserves approval not selected `continuation.runner-codex.local.revision-preserves-approval` Matchers and test context Not selected No matcher result was recorded. untrusted evidence not selected `continuation.runner-codex.local.untrusted-evidence` Matchers and test context Not selected No matcher result was recorded. completed action resume not selected `continuation.runner-codex.local.completed-action-resume` Matchers and test context Not selected No matcher result was recorded. question tool documentation not selected `continuation.runner-codex.local.question-tool-documentation` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local answer updates scope not selected `continuation.runner-acpx-claude.local.answer-updates-scope` Matchers and test context Not selected No matcher result was recorded. clarification not approval not selected `continuation.runner-acpx-claude.local.clarification-not-approval` Matchers and test context Not selected No matcher result was recorded. revision preserves approval not selected `continuation.runner-acpx-claude.local.revision-preserves-approval` Matchers and test context Not selected No matcher result was recorded. untrusted evidence not selected `continuation.runner-acpx-claude.local.untrusted-evidence` Matchers and test context Not selected No matcher result was recorded. completed action resume not selected `continuation.runner-acpx-claude.local.completed-action-resume` Matchers and test context Not selected No matcher result was recorded. question tool documentation not selected `continuation.runner-acpx-claude.local.question-tool-documentation` Matchers and test context Not selected No matcher result was recorded. provider question bridge not selected `continuation.runner-acpx-claude.local.provider-question-bridge` Matchers and test context Not selected No matcher result was recorded.

Test suite

Everyday Paperclip Work

Real user requests, useful downloaded work, and durable continuation using production instructions.

Configuration matrix3 profiles · 2 environments · 0 selected

Agent profile	Isolated locallocal · local	Daytona warm reusable sandboxdaytona · remote
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Build, download, and revise a project not selected `everyday-workflows.runner-codex.local.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-codex.local.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Delegate work through an agent review handoff not selected `everyday-workflows.runner-codex.local.agent-review-handoff` Matchers and test context Not selected No matcher result was recorded. Hire one teammate, then reuse that agent not selected `everyday-workflows.runner-codex.local.hire-reuse` Matchers and test context Not selected No matcher result was recorded. Use a connection after approval not selected `everyday-workflows.runner-codex.local.service-approve` Matchers and test context Not selected No matcher result was recorded. Respect a declined tool action not selected `everyday-workflows.runner-codex.local.service-decline` Matchers and test context Not selected No matcher result was recorded. Respect Not now on a new connection not selected `everyday-workflows.runner-codex.local.connection-decline` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-codex.local.recover-controller` Matchers and test context Not selected No matcher result was recorded. Stop a task and send a new direction once not selected `everyday-workflows.runner-codex.local.stop-redirect` Matchers and test context Not selected No matcher result was recorded. Create and edit a company skill not selected `everyday-workflows.runner-codex.local.create-skill-studio` Matchers and test context Not selected No matcher result was recorded.	Daytona warm reusable sandboxdaytona · remote Build, download, and revise a project not selected `everyday-workflows.runner-codex.daytona.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-codex.daytona.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-codex.daytona.recover-controller` Matchers and test context Not selected No matcher result was recorded. Create and edit a company skill not selected `everyday-workflows.runner-codex.daytona.create-skill-studio` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Build, download, and revise a project not selected `everyday-workflows.runner-acpx-claude.local.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-acpx-claude.local.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Delegate work through an agent review handoff not selected `everyday-workflows.runner-acpx-claude.local.agent-review-handoff` Matchers and test context Not selected No matcher result was recorded. Hire one teammate, then reuse that agent not selected `everyday-workflows.runner-acpx-claude.local.hire-reuse` Matchers and test context Not selected No matcher result was recorded. Use a connection after approval not selected `everyday-workflows.runner-acpx-claude.local.service-approve` Matchers and test context Not selected No matcher result was recorded. Respect a declined tool action not selected `everyday-workflows.runner-acpx-claude.local.service-decline` Matchers and test context Not selected No matcher result was recorded. Respect Not now on a new connection not selected `everyday-workflows.runner-acpx-claude.local.connection-decline` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-acpx-claude.local.recover-controller` Matchers and test context Not selected No matcher result was recorded. Stop a task and send a new direction once not selected `everyday-workflows.runner-acpx-claude.local.stop-redirect` Matchers and test context Not selected No matcher result was recorded. Create and edit a company skill not selected `everyday-workflows.runner-acpx-claude.local.create-skill-studio` Matchers and test context Not selected No matcher result was recorded.	Daytona warm reusable sandboxdaytona · remote Build, download, and revise a project not selected `everyday-workflows.runner-acpx-claude.daytona.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-acpx-claude.daytona.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-acpx-claude.daytona.recover-controller` Matchers and test context Not selected No matcher result was recorded. Create and edit a company skill not selected `everyday-workflows.runner-acpx-claude.daytona.create-skill-studio` Matchers and test context Not selected No matcher result was recorded.
Runner Codex Mininativecodex · gpt-5.4-mini	Isolated locallocal · local Build, download, and revise a project not selected `everyday-workflows.runner-codex-mini.local.build-revise` Matchers and test context Not selected No matcher result was recorded. Delegate implementation and preserve late feedback not selected `everyday-workflows.runner-codex-mini.local.delegate-feedback` Matchers and test context Not selected No matcher result was recorded. Delegate work through an agent review handoff not selected `everyday-workflows.runner-codex-mini.local.agent-review-handoff` Matchers and test context Not selected No matcher result was recorded. Hire one teammate, then reuse that agent not selected `everyday-workflows.runner-codex-mini.local.hire-reuse` Matchers and test context Not selected No matcher result was recorded. Use a connection after approval not selected `everyday-workflows.runner-codex-mini.local.service-approve` Matchers and test context Not selected No matcher result was recorded. Respect a declined tool action not selected `everyday-workflows.runner-codex-mini.local.service-decline` Matchers and test context Not selected No matcher result was recorded. Respect Not now on a new connection not selected `everyday-workflows.runner-codex-mini.local.connection-decline` Matchers and test context Not selected No matcher result was recorded. Recover work after the server restarts not selected `everyday-workflows.runner-codex-mini.local.recover-controller` Matchers and test context Not selected No matcher result was recorded. Stop a task and send a new direction once not selected `everyday-workflows.runner-codex-mini.local.stop-redirect` Matchers and test context Not selected No matcher result was recorded. Create and edit a company skill not selected `everyday-workflows.runner-codex-mini.local.create-skill-studio` Matchers and test context Not selected No matcher result was recorded.	Daytona warm reusable sandboxdaytona · remote

Test suite

First-task onboarding

Production onboarding, first replies, approval, and durable task execution.

Configuration matrix4 profiles · 1 environments · 0 selected

Agent profile	Isolated locallocal · local
Legacy Codexlegacycodex · Production onboarding default	Isolated locallocal · local Interview: first response not selected `first-task.legacy-codex.local.interview-first-response` Matchers and test context Not selected No matcher result was recorded. Clear task: first response not selected `first-task.legacy-codex.local.clear-task-first-response` Matchers and test context Not selected No matcher result was recorded. Ambiguous task: first response not selected `first-task.legacy-codex.local.ambiguous-task-first-response` Matchers and test context Not selected No matcher result was recorded. Opening card replaced by a message not selected `first-task.legacy-codex.local.plain-message-first-response` Matchers and test context Not selected No matcher result was recorded. Explicit plan: first response not selected `first-task.legacy-codex.local.plan-first-response` Matchers and test context Not selected No matcher result was recorded. Other tasks do not inherit onboarding policy not selected `first-task.legacy-codex.local.ordinary-task-control` Matchers and test context Not selected No matcher result was recorded. Interview, plan, and acceptance not selected `first-task.legacy-codex.local.interview-plan-accept` Matchers and test context Not selected No matcher result was recorded. Subtask accepted through a card not selected `first-task.legacy-codex.local.task-card-accept` Matchers and test context Not selected No matcher result was recorded. Accept a proposal while its agent is still running not selected `first-task.legacy-codex.local.accept-while-running` Matchers and test context Not selected No matcher result was recorded. Subtask accepted in conversation not selected `first-task.legacy-codex.local.task-reply-accept` Matchers and test context Not selected No matcher result was recorded. Clarification, proposal, and acceptance not selected `first-task.legacy-codex.local.clarify-propose-accept` Matchers and test context Not selected No matcher result was recorded. Revise scope before accepting not selected `first-task.legacy-codex.local.revise-accept` Matchers and test context Not selected No matcher result was recorded. Decline proposed work not selected `first-task.legacy-codex.local.reject-no-execution` Matchers and test context Not selected No matcher result was recorded.
Legacy Claudelegacyclaude · Production onboarding default	Isolated locallocal · local Interview: first response not selected `first-task.legacy-claude.local.interview-first-response` Matchers and test context Not selected No matcher result was recorded. Clear task: first response not selected `first-task.legacy-claude.local.clear-task-first-response` Matchers and test context Not selected No matcher result was recorded. Ambiguous task: first response not selected `first-task.legacy-claude.local.ambiguous-task-first-response` Matchers and test context Not selected No matcher result was recorded. Opening card replaced by a message not selected `first-task.legacy-claude.local.plain-message-first-response` Matchers and test context Not selected No matcher result was recorded. Explicit plan: first response not selected `first-task.legacy-claude.local.plan-first-response` Matchers and test context Not selected No matcher result was recorded. Other tasks do not inherit onboarding policy not selected `first-task.legacy-claude.local.ordinary-task-control` Matchers and test context Not selected No matcher result was recorded. Interview, plan, and acceptance not selected `first-task.legacy-claude.local.interview-plan-accept` Matchers and test context Not selected No matcher result was recorded. Subtask accepted through a card not selected `first-task.legacy-claude.local.task-card-accept` Matchers and test context Not selected No matcher result was recorded. Accept a proposal while its agent is still running not selected `first-task.legacy-claude.local.accept-while-running` Matchers and test context Not selected No matcher result was recorded. Subtask accepted in conversation not selected `first-task.legacy-claude.local.task-reply-accept` Matchers and test context Not selected No matcher result was recorded. Clarification, proposal, and acceptance not selected `first-task.legacy-claude.local.clarify-propose-accept` Matchers and test context Not selected No matcher result was recorded. Revise scope before accepting not selected `first-task.legacy-claude.local.revise-accept` Matchers and test context Not selected No matcher result was recorded. Decline proposed work not selected `first-task.legacy-claude.local.reject-no-execution` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · Production onboarding default	Isolated locallocal · local Interview: first response not selected `first-task.runner-codex.local.interview-first-response` Matchers and test context Not selected No matcher result was recorded. Clear task: first response not selected `first-task.runner-codex.local.clear-task-first-response` Matchers and test context Not selected No matcher result was recorded. Ambiguous task: first response not selected `first-task.runner-codex.local.ambiguous-task-first-response` Matchers and test context Not selected No matcher result was recorded. Opening card replaced by a message not selected `first-task.runner-codex.local.plain-message-first-response` Matchers and test context Not selected No matcher result was recorded. Explicit plan: first response not selected `first-task.runner-codex.local.plan-first-response` Matchers and test context Not selected No matcher result was recorded. Other tasks do not inherit onboarding policy not selected `first-task.runner-codex.local.ordinary-task-control` Matchers and test context Not selected No matcher result was recorded. Interview, plan, and acceptance not selected `first-task.runner-codex.local.interview-plan-accept` Matchers and test context Not selected No matcher result was recorded. Subtask accepted through a card not selected `first-task.runner-codex.local.task-card-accept` Matchers and test context Not selected No matcher result was recorded. Accept a proposal while its agent is still running not selected `first-task.runner-codex.local.accept-while-running` Matchers and test context Not selected No matcher result was recorded. Subtask accepted in conversation not selected `first-task.runner-codex.local.task-reply-accept` Matchers and test context Not selected No matcher result was recorded. Clarification, proposal, and acceptance not selected `first-task.runner-codex.local.clarify-propose-accept` Matchers and test context Not selected No matcher result was recorded. Revise scope before accepting not selected `first-task.runner-codex.local.revise-accept` Matchers and test context Not selected No matcher result was recorded. Decline proposed work not selected `first-task.runner-codex.local.reject-no-execution` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · Production onboarding default	Isolated locallocal · local Interview: first response not selected `first-task.runner-acpx-claude.local.interview-first-response` Matchers and test context Not selected No matcher result was recorded. Clear task: first response not selected `first-task.runner-acpx-claude.local.clear-task-first-response` Matchers and test context Not selected No matcher result was recorded. Ambiguous task: first response not selected `first-task.runner-acpx-claude.local.ambiguous-task-first-response` Matchers and test context Not selected No matcher result was recorded. Opening card replaced by a message not selected `first-task.runner-acpx-claude.local.plain-message-first-response` Matchers and test context Not selected No matcher result was recorded. Explicit plan: first response not selected `first-task.runner-acpx-claude.local.plan-first-response` Matchers and test context Not selected No matcher result was recorded. Other tasks do not inherit onboarding policy not selected `first-task.runner-acpx-claude.local.ordinary-task-control` Matchers and test context Not selected No matcher result was recorded. Interview, plan, and acceptance not selected `first-task.runner-acpx-claude.local.interview-plan-accept` Matchers and test context Not selected No matcher result was recorded. Subtask accepted through a card not selected `first-task.runner-acpx-claude.local.task-card-accept` Matchers and test context Not selected No matcher result was recorded. Accept a proposal while its agent is still running not selected `first-task.runner-acpx-claude.local.accept-while-running` Matchers and test context Not selected No matcher result was recorded. Subtask accepted in conversation not selected `first-task.runner-acpx-claude.local.task-reply-accept` Matchers and test context Not selected No matcher result was recorded. Clarification, proposal, and acceptance not selected `first-task.runner-acpx-claude.local.clarify-propose-accept` Matchers and test context Not selected No matcher result was recorded. Revise scope before accepting not selected `first-task.runner-acpx-claude.local.revise-accept` Matchers and test context Not selected No matcher result was recorded. Decline proposed work not selected `first-task.runner-acpx-claude.local.reject-no-execution` Matchers and test context Not selected No matcher result was recorded.

Test suite

Persistent Agent Chat

Task-backed conversations, session resets, and project plan handoff.

Pass rate93.8%15/16 passed

Tokens4,594,1011,298,102 input · 42,376 output

Cost$0.000000reported LLM + runtime estimate

Agent time17m 28s0ms lease

Execution16/160 retries · cleanup passed

Configuration matrix4 profiles · 1 environments · 16 selected

Agent profile Isolated locallocal · local

Legacy Codexlegacycodex · gpt-5.6-sol

Isolated locallocal · local

Conversation continuity across restart not selected

agent-chat.legacy-codex.local.continuity-restart

Matchers and test context

Not selected

No matcher result was recorded.

Fresh context within preserved history not selected

agent-chat.legacy-codex.local.new-session

Matchers and test context

Not selected

No matcher result was recorded.

Stop, reset, and resume not selected

agent-chat.legacy-codex.local.stop-new-resume

Matchers and test context

Not selected

No matcher result was recorded.

Draft, revise, approve, and hand off a plan not selected

agent-chat.legacy-codex.local.plan-handoff

Matchers and test context

Not selected

No matcher result was recorded.

Clarify and reuse an existing project not selected

agent-chat.legacy-codex.local.clarify-reuse

Matchers and test context

Not selected

No matcher result was recorded.

Create a project with multiple repository URLs not selected

agent-chat.legacy-codex.local.multi-repository

Matchers and test context

Not selected

No matcher result was recorded.

Legacy Claudelegacyclaude · claude-sonnet-4-6

Isolated locallocal · local

Conversation continuity across restart not selected

agent-chat.legacy-claude.local.continuity-restart

Matchers and test context

Not selected

No matcher result was recorded.

Fresh context within preserved history not selected

agent-chat.legacy-claude.local.new-session

Matchers and test context

Not selected

No matcher result was recorded.

Stop, reset, and resume not selected

agent-chat.legacy-claude.local.stop-new-resume

Matchers and test context

Not selected

No matcher result was recorded.

Draft, revise, approve, and hand off a plan not selected

agent-chat.legacy-claude.local.plan-handoff

Matchers and test context

Not selected

No matcher result was recorded.

Clarify and reuse an existing project not selected

agent-chat.legacy-claude.local.clarify-reuse

Matchers and test context

Not selected

No matcher result was recorded.

Create a project with multiple repository URLs not selected

agent-chat.legacy-claude.local.multi-repository

Matchers and test context

Not selected

No matcher result was recorded.

Runner Codexnativecodex · gpt-5.6-sol

Isolated locallocal · local

Save a planned task without starting work passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens238,543 in · 2,099 out196,020 cached · 2/2 runs covered

LLM spend$0.0000002/2 runs provider-priced

ExecutionLocal · not metered37s agent

agent-chat.runner-codex.local.create-backlog

Matchers and test context

Attempt: 1
Duration: 56s
Agent runtime: 37s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 238543,
      "outputTokens": 2099,
      "cachedInputTokens": 196020,
      "totalTokens": 436662,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 36631,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "f432b3b5-bf4b-447c-b862-86ac806ccb62",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 164199,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 1328,
          "sessionReused": true,
          "rawInputTokens": 164199,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:cab31f450beda77c79b6668e1645065d69d0ba8a08da82ac3d876b64cb7e833e",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:aae56d2cea04b454ec9464eb147c477c34180052e83bce4012b7fbb6a2da1a90",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1328,
          "cachedInputTokens": 141188,
          "taskSessionReused": true,
          "persistedSessionId": "01a0c56f-ce6d-7b43-9a17-89aef8eb7ae9",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 141188,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "ddac50d4-0adc-4fdc-afb1-863ec743be2a",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 74344,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 771,
          "sessionReused": false,
          "rawInputTokens": 74344,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:cab31f450beda77c79b6668e1645065d69d0ba8a08da82ac3d876b64cb7e833e",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:aae56d2cea04b454ec9464eb147c477c34180052e83bce4012b7fbb6a2da1a90",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 771,
          "cachedInputTokens": 54832,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c56f-ce6d-7b43-9a17-89aef8eb7ae9",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 54832,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Reassign existing work and preserve queued context passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens179,001 in · 1,738 out141,082 cached · 2/2 runs covered

LLM spend$0.0000002/2 runs provider-priced

ExecutionLocal · not metered55s agent

agent-chat.runner-codex.local.reassign-task

Matchers and test context

Attempt: 1
Duration: 55s
Agent runtime: 55s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: RUN-3

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 179001,
      "outputTokens": 1738,
      "cachedInputTokens": 141082,
      "totalTokens": 321821,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 55210,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "fb7942de-53ca-4f13-82ad-ce3e74370a94",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 87175,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 649,
          "sessionReused": false,
          "rawInputTokens": 87175,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:6f2922152c55de9550ab5521928e9142bb9504f355abceddb69b7af15f8f2fb7",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:f2283a969b1061e2a0aacbf648eedaf24e46fa367eadac3247f7152011c058eb",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 649,
          "cachedInputTokens": 68742,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c56f-f853-7f42-b06f-a07e66754fb4",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 68742,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "b4578a8d-800f-4698-92ed-3917d2597d40",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 91826,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 1089,
          "sessionReused": false,
          "rawInputTokens": 91826,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:8314bfb7f93ac44c94f602fb95e74f68debde98a63d1c4691ec37e466f46b873",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:f2283a969b1061e2a0aacbf648eedaf24e46fa367eadac3247f7152011c058eb",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1089,
          "cachedInputTokens": 72340,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c56f-bf2c-7831-a97b-fc1d9913c51c",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 72340,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Conversation continuity across restart failed

Overall failed · No behavioral checks recorded

candidate failure

page.goto: Timeout 60000ms exceeded. Call log: [2m - navigating to "http://127.0.0.1:41215/RUN/chats/fbaeae4f-9c4d-4664-8968-fcea24b8ceb1", waiting until "commit"[22m

Tokens108,381 in · 575 out71,105 cached · 2/2 runs covered

LLM spend$0.0000002/2 runs provider-priced

ExecutionLocal · not metered17s agent

agent-chat.runner-codex.local.continuity-restart

Matchers and test context

Attempt: 1
Duration: 1m 48s
Agent runtime: 17s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: RUN-1

No result artifact was uploaded

No matcher result was recorded.

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 108381,
      "outputTokens": 575,
      "cachedInputTokens": 71105,
      "totalTokens": 180061,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 17077,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "6655697e-3940-4068-ac2c-e289c1de1566",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 74034,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 374,
          "sessionReused": true,
          "rawInputTokens": 74034,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:5a9198d2adc8883f5d46bfd51c1d46fa6a0ce43d32981600c5d1f540b7750036",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:b792f7cac0c51f084effc2e47f41c5e72f4274d720a8dda0f9cadcbb3c33fe83",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 374,
          "cachedInputTokens": 54062,
          "taskSessionReused": true,
          "persistedSessionId": "01a0c56f-d3fc-7e00-b8c1-53787b57b8b0",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 54062,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "11d42a42-40fe-4bdc-96e5-9ff9ccc7f6f8",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 34347,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 201,
          "sessionReused": false,
          "rawInputTokens": 34347,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:5a9198d2adc8883f5d46bfd51c1d46fa6a0ce43d32981600c5d1f540b7750036",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:b792f7cac0c51f084effc2e47f41c5e72f4274d720a8dda0f9cadcbb3c33fe83",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 201,
          "cachedInputTokens": 17043,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c56f-d3fc-7e00-b8c1-53787b57b8b0",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 17043,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Fresh context within preserved history passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens68,987 in · 731 out34,064 cached · 2/3 runs covered

LLM spend$0.0000002/3 runs provider-priced

ExecutionLocal · not metered21s agent

agent-chat.runner-codex.local.new-session

Matchers and test context

Attempt: 1
Duration: 46s
Agent runtime: 21s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 68987,
      "outputTokens": 731,
      "cachedInputTokens": 34064,
      "totalTokens": 103782,
      "reportedCostUsd": 0,
      "costStatus": "partial"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 21140,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "1861ba2a-4690-4d0c-8cd8-892dc9bfbe27",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 34583,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 391,
          "sessionReused": false,
          "rawInputTokens": 34583,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:7f3ac14a42ce5fe603a8d05f4c1c16104edfb241ac8b6a0d6358f5657a2c6b95",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:ccc5176209edacf75698ff815977ed7d0d058341631df03c0413b6951694d74e",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 391,
          "cachedInputTokens": 17060,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c570-1e19-7b21-83fb-0d7eeffbd67d",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 17060,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "8efbd345-6f92-4a89-8835-048d9ebe818c",
        "usage": null
      },
      {
        "runId": "3988b8f2-39bf-4729-8468-39e315afebe1",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 34404,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 340,
          "sessionReused": false,
          "rawInputTokens": 34404,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:7f3ac14a42ce5fe603a8d05f4c1c16104edfb241ac8b6a0d6358f5657a2c6b95",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:ccc5176209edacf75698ff815977ed7d0d058341631df03c0413b6951694d74e",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 340,
          "cachedInputTokens": 17004,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c56f-d54d-7110-ac11-6644966e231d",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 17004,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Stop, reset, and resume passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens68,703 in · 497 out34,038 cached · 2/4 runs covered

LLM spend$0.0000002/4 runs provider-priced

ExecutionLocal · not metered31s agent

agent-chat.runner-codex.local.stop-new-resume

Matchers and test context

Attempt: 1
Duration: 1m 2s
Agent runtime: 31s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 4,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 68703,
      "outputTokens": 497,
      "cachedInputTokens": 34038,
      "totalTokens": 103238,
      "reportedCostUsd": 0,
      "costStatus": "partial"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 31100,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "570be565-f85e-4c81-ab25-ef66157e3251",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 34390,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 253,
          "sessionReused": false,
          "rawInputTokens": 34390,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:bc63386bcbe4c271d9038cb3c9f6d4bf4b98bc4866eafe05c8cf961b66fbdda7",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:cf2f6c3c7cb94daf056dc2cf064513e161561bee98a4bed7205ce0d792279c0f",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 253,
          "cachedInputTokens": 17032,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c570-343b-75b0-8d44-0edb15f9edf8",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 17032,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "6c02e414-2763-4026-894b-9a1fe8046527",
        "usage": null
      },
      {
        "runId": "f37664b4-221e-442d-98a0-1692dd324ef5",
        "usage": null
      },
      {
        "runId": "7788c193-21ca-47dd-82ee-97710e0aa5b8",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 34313,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 244,
          "sessionReused": false,
          "rawInputTokens": 34313,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:bc63386bcbe4c271d9038cb3c9f6d4bf4b98bc4866eafe05c8cf961b66fbdda7",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:cf2f6c3c7cb94daf056dc2cf064513e161561bee98a4bed7205ce0d792279c0f",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 244,
          "cachedInputTokens": 17006,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c56f-b448-7541-9dc7-b3fcf1b17b8b",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 17006,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Draft, revise, approve, and hand off a plan passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens291,145 in · 4,035 out213,514 cached · 4/4 runs covered

LLM spend$0.0000004/4 runs provider-priced

ExecutionLocal · not metered1m 24s agent

agent-chat.runner-codex.local.plan-handoff

Matchers and test context

Attempt: 1
Duration: 1m 32s
Agent runtime: 1m 24s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 4,
      "runsWithTokenUsage": 4,
      "runsWithReportedCost": 4,
      "inputTokens": 291145,
      "outputTokens": 4035,
      "cachedInputTokens": 213514,
      "totalTokens": 508694,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 84257,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "d93631b3-4145-4aa3-afcb-eebe82e5b644",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 69891,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 833,
          "sessionReused": false,
          "rawInputTokens": 69891,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:3ad4573a227a7b405c4245996907500e6b10c3f86ff784b36df6650c3c5e660c",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:f8bb8f338c741dfba4077b1b53a78f50af59627e3b97c9cb66e9d32b8168fe8a",
              "workspaceReused": false,
              "activeWorkspaceId": "e1dee384-9dad-4b9c-8638-ede11eac7891",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 833,
          "cachedInputTokens": 51624,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c570-a664-7cd1-a286-b7648c21421f",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 51624,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "187fab16-9773-4529-ade3-fa56e5760840",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 92418,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 1309,
          "sessionReused": false,
          "rawInputTokens": 92418,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [
                "forceFreshSession was requested"
              ],
              "nextFingerprint": "v1:sha256:9e64623ec43297bb761d056cf7b30cf7b80d6ae64657e9bb7e6ee5972238b3b3",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:5f2e03c7333e4ba0b29849a7ec2e95df761bf1d9558c2453484419f41f6fbabb",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1309,
          "cachedInputTokens": 72587,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c570-61a7-7472-98b9-13a2d42291a9",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 72587,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "32a771f3-5765-48fb-8fa6-05e57fab2a2b",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 95579,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 1332,
          "sessionReused": true,
          "rawInputTokens": 95579,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:9e64623ec43297bb761d056cf7b30cf7b80d6ae64657e9bb7e6ee5972238b3b3",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:5f2e03c7333e4ba0b29849a7ec2e95df761bf1d9558c2453484419f41f6fbabb",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1332,
          "cachedInputTokens": 73122,
          "taskSessionReused": true,
          "persistedSessionId": "01a0c56f-e0a9-7e91-b0a0-8f0b8d623ca9",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 73122,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "a4218a60-b2e7-4bc4-b8b6-776d165b1fde",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 33257,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 561,
          "sessionReused": false,
          "rawInputTokens": 33257,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:9e64623ec43297bb761d056cf7b30cf7b80d6ae64657e9bb7e6ee5972238b3b3",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:5f2e03c7333e4ba0b29849a7ec2e95df761bf1d9558c2453484419f41f6fbabb",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 561,
          "cachedInputTokens": 16181,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c56f-e0a9-7e91-b0a0-8f0b8d623ca9",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 16181,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Clarify and reuse an existing project passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens175,383 in · 1,902 out152,086 cached · 2/3 runs covered

LLM spend$0.0000002/3 runs provider-priced

ExecutionLocal · not metered1m 8s agent

agent-chat.runner-codex.local.clarify-reuse

Matchers and test context

Attempt: 1
Duration: 1m 1s
Agent runtime: 1m 8s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 175383,
      "outputTokens": 1902,
      "cachedInputTokens": 152086,
      "totalTokens": 329371,
      "reportedCostUsd": 0,
      "costStatus": "partial"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 67560,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "db86d52d-9ae1-4e25-b356-772b7f2c552f",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 68743,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 637,
          "sessionReused": false,
          "rawInputTokens": 68743,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:e3f8b364d4223b81828500005a53983bb36a0fb9305e8ed7ff17fc36a3fd10c5",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:b194bd638c5c26a1cc0de3b5af31a061e77efd2c5635283333d2b4bccd765d0a",
              "workspaceReused": false,
              "activeWorkspaceId": "13e0407d-ff58-4c6c-a6ca-966b50186643",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 637,
          "cachedInputTokens": 50886,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c570-1fb3-7912-af5a-09e6cc69f269",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 50886,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "97272460-7c57-4c7b-a877-85493f52d0f1",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 106640,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 1265,
          "sessionReused": true,
          "rawInputTokens": 106640,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:d403ed8ddfcae3792ac9719e09a18324522a0fdaa57a15f3844b2fb2fd435f4f",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:0135211b96a2ab1696afc16ca29e7f6a45b370df2b5b2c721664f50c05c5e693",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1265,
          "cachedInputTokens": 101200,
          "taskSessionReused": true,
          "persistedSessionId": "01a0c56f-bcf5-7623-bbc3-613b157515f4",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 101200,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "52157bd0-8ebe-4daf-a768-8f30120bb524",
        "usage": null
      }
    ]
  }
}

Create a project with multiple repository URLs passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens167,825 in · 2,407 out128,174 cached · 2/2 runs covered

LLM spend$0.0000002/2 runs provider-priced

ExecutionLocal · not metered1m 8s agent

agent-chat.runner-codex.local.multi-repository

Matchers and test context

Attempt: 1
Duration: 1m 7s
Agent runtime: 1m 8s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 167825,
      "outputTokens": 2407,
      "cachedInputTokens": 128174,
      "totalTokens": 298406,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 68442,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "fef1de6f-3fd9-495d-a85d-1f78de4fadaf",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 70412,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 757,
          "sessionReused": false,
          "rawInputTokens": 70412,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:441fbd002acfaf62f7bcaed2fe137e95c14afc4a3d8948b0970712b2978eba0d",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:c0e144d233ab1d5dd8a82926e3f63860e8f9623c63cfe27954cad652185fe852",
              "workspaceReused": false,
              "activeWorkspaceId": "4b68197d-3ed7-407e-a290-0788dbb73ba3",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 757,
          "cachedInputTokens": 52048,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c570-2311-71c3-a1f7-c01cc75a1443",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 52048,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "be6dbc03-1f1a-4907-b52f-8ccb0264d784",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 97413,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 1650,
          "sessionReused": false,
          "rawInputTokens": 97413,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:54913e934aa8e8e7ba0e0439950498144d8ff5147c94c38f00b8e0072a631b44",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:4f3f447f5d21822779907336dea1e7aecb7f21066897ff962dbb1721d215df43",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1650,
          "cachedInputTokens": 76126,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c56f-c312-7ed2-97ca-8f8a2406ceac",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 76126,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Runner ACPX Claudenativeacpx · claude-sonnet-5

Isolated locallocal · local

Save a planned task without starting work passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens16 in · 2,624 out278,707 cached · 2/2 runs covered

LLM spend$0.0000002/2 runs provider-priced

ExecutionLocal · not metered58s agent

agent-chat.runner-acpx-claude.local.create-backlog

Matchers and test context

Attempt: 1
Duration: 1m 18s
Agent runtime: 58s
Runtime: native
Provider: acpx
Model: claude-sonnet-5
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 16,
      "outputTokens": 2624,
      "cachedInputTokens": 278707,
      "totalTokens": 281347,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 58360,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "8782098b-b88e-45cc-928a-247675745209",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 6,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 958,
          "sessionReused": true,
          "rawInputTokens": 6,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:d22577b442abdd60309fe88095e587481ad87c92afd0b5c0f0dcebbe1e54e2a0",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:5589719a80db5631bd1b1e6820caedb847506753c0a2075dcf962c69ec5c7eff",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 958,
          "cachedInputTokens": 107595,
          "taskSessionReused": true,
          "persistedSessionId": "73a94e3b-00aa-4349-9147-ac25264fb702",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 107595,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "e8883f10-67f8-4b5a-884e-4bc95a921139",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 10,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 1666,
          "sessionReused": false,
          "rawInputTokens": 10,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:d22577b442abdd60309fe88095e587481ad87c92afd0b5c0f0dcebbe1e54e2a0",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:5589719a80db5631bd1b1e6820caedb847506753c0a2075dcf962c69ec5c7eff",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1666,
          "cachedInputTokens": 171112,
          "taskSessionReused": false,
          "persistedSessionId": "73a94e3b-00aa-4349-9147-ac25264fb702",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 171112,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Reassign existing work and preserve queued context passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens20 in · 4,690 out338,065 cached · 2/2 runs covered

LLM spend$0.0000002/2 runs provider-priced

ExecutionLocal · not metered1m 18s agent

agent-chat.runner-acpx-claude.local.reassign-task

Matchers and test context

Attempt: 1
Duration: 1m 18s
Agent runtime: 1m 18s
Runtime: native
Provider: acpx
Model: claude-sonnet-5
Issue: RUN-3

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 20,
      "outputTokens": 4690,
      "cachedInputTokens": 338065,
      "totalTokens": 342775,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 78492,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "7b7bf3a0-7d81-4355-acc3-76b508ecd676",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 8,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 2212,
          "sessionReused": false,
          "rawInputTokens": 8,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:581cd200b9a324a29d12b110d4b6cd163c974eb4b762efb3a2d7e180944bfec2",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:891fbb466eb0266a50768b314e0237c0fccefaf0d1fa52a303565fa0ea614d30",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 2212,
          "cachedInputTokens": 125971,
          "taskSessionReused": false,
          "persistedSessionId": "d7f9b5cd-5f06-490a-b210-fcd7f062054e",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 125971,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "2534cc9a-3137-4080-a71c-5fb655db0880",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 12,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 2478,
          "sessionReused": false,
          "rawInputTokens": 12,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:c63684ffe3d7c3f03230dc431dbf830ea8bb2c7ede0996e2423d477dd8d6abf4",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:891fbb466eb0266a50768b314e0237c0fccefaf0d1fa52a303565fa0ea614d30",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 2478,
          "cachedInputTokens": 212094,
          "taskSessionReused": false,
          "persistedSessionId": "ec4bf6a2-b1d1-49de-b14f-4ab0ef436c46",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 212094,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Conversation continuity across restart passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens14 in · 1,387 out235,093 cached · 3/3 runs covered

LLM spend$0.0000003/3 runs provider-priced

ExecutionLocal · not metered54s agent

agent-chat.runner-acpx-claude.local.continuity-restart

Matchers and test context

Attempt: 1
Duration: 1m 42s
Agent runtime: 54s
Runtime: native
Provider: acpx
Model: claude-sonnet-5
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 3,
      "runsWithReportedCost": 3,
      "inputTokens": 14,
      "outputTokens": 1387,
      "cachedInputTokens": 235093,
      "totalTokens": 236494,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 53947,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "1e8522de-a75f-4133-ae7f-e89c0c3e40f3",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 4,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 438,
          "sessionReused": true,
          "rawInputTokens": 4,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:b38f73d2da6909a178b9a746bd455470e89d414f27d895eaf17c36682db9e8a9",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:8e79152323d0b216e4f908c94f964607455a0a3fcc968a2178bda1e903778b80",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 438,
          "cachedInputTokens": 84779,
          "taskSessionReused": true,
          "persistedSessionId": "e24bf0ae-3ab9-42dd-9e94-0a2057bfbea5",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 84779,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "fcc62b1d-6ff0-435d-b5db-1cf8cc0c20dd",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 4,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 390,
          "sessionReused": true,
          "rawInputTokens": 4,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:b38f73d2da6909a178b9a746bd455470e89d414f27d895eaf17c36682db9e8a9",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:8e79152323d0b216e4f908c94f964607455a0a3fcc968a2178bda1e903778b80",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 390,
          "cachedInputTokens": 59900,
          "taskSessionReused": true,
          "persistedSessionId": "e24bf0ae-3ab9-42dd-9e94-0a2057bfbea5",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 59900,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "4b6cf64f-6516-4414-8632-0a62648baf35",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 6,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 559,
          "sessionReused": false,
          "rawInputTokens": 6,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:b38f73d2da6909a178b9a746bd455470e89d414f27d895eaf17c36682db9e8a9",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:8e79152323d0b216e4f908c94f964607455a0a3fcc968a2178bda1e903778b80",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 559,
          "cachedInputTokens": 90414,
          "taskSessionReused": false,
          "persistedSessionId": "e24bf0ae-3ab9-42dd-9e94-0a2057bfbea5",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 90414,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Fresh context within preserved history passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens12 in · 1,483 out181,165 cached · 2/3 runs covered

LLM spend$0.0000002/3 runs provider-priced

ExecutionLocal · not metered43s agent

agent-chat.runner-acpx-claude.local.new-session

Matchers and test context

Attempt: 1
Duration: 1m 8s
Agent runtime: 43s
Runtime: native
Provider: acpx
Model: claude-sonnet-5
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 12,
      "outputTokens": 1483,
      "cachedInputTokens": 181165,
      "totalTokens": 182660,
      "reportedCostUsd": 0,
      "costStatus": "partial"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 43359,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "96406df6-46d3-43a4-8a03-c7b9f0d78f6b",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 6,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 867,
          "sessionReused": false,
          "rawInputTokens": 6,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:37fffddc8a7bdd115b98a4c36bbf480c92822a458936e03af3854317b1d14b4a",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:cf52faafe6e933493aaf6b7b739ba9f9634b385100658fb3c6091be292e84e00",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 867,
          "cachedInputTokens": 90748,
          "taskSessionReused": false,
          "persistedSessionId": "e1535929-dd6b-4242-9af8-97248419d876",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 90748,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "db0a8452-22c6-4c90-9689-bde4f14df08f",
        "usage": null
      },
      {
        "runId": "4dc4079c-d511-4c0a-834e-da84caafc299",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 6,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 616,
          "sessionReused": false,
          "rawInputTokens": 6,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:37fffddc8a7bdd115b98a4c36bbf480c92822a458936e03af3854317b1d14b4a",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:cf52faafe6e933493aaf6b7b739ba9f9634b385100658fb3c6091be292e84e00",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 616,
          "cachedInputTokens": 90417,
          "taskSessionReused": false,
          "persistedSessionId": "34949d79-e091-48e6-b125-d90021d1d449",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 90417,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Stop, reset, and resume passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens12 in · 1,572 out181,382 cached · 2/4 runs covered

LLM spend$0.0000002/4 runs provider-priced

ExecutionLocal · not metered50s agent

agent-chat.runner-acpx-claude.local.stop-new-resume

Matchers and test context

Attempt: 1
Duration: 1m 17s
Agent runtime: 50s
Runtime: native
Provider: acpx
Model: claude-sonnet-5
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 4,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 12,
      "outputTokens": 1572,
      "cachedInputTokens": 181382,
      "totalTokens": 182966,
      "reportedCostUsd": 0,
      "costStatus": "partial"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 50123,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "84823301-6d5c-48bf-86f3-a04f487f9607",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 6,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 912,
          "sessionReused": false,
          "rawInputTokens": 6,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:144c2ee427f91cc34d94439660b5b8b4921202dc9ec0413f1c2e8ec9171d7ba2",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:95007716cf88f120281053be2df36c30c39e8363f168d779667a9b27e1d0ccf4",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 912,
          "cachedInputTokens": 90821,
          "taskSessionReused": false,
          "persistedSessionId": "f86098e6-b557-47e3-82e1-c8de35623e67",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 90821,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "95262a47-6561-4ae5-a0bb-8e449ddabc29",
        "usage": null
      },
      {
        "runId": "6dfc562e-4acb-4ad4-8f48-a6f4341e1368",
        "usage": null
      },
      {
        "runId": "9828fd72-d7be-4405-8751-d473627c4c38",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 6,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 660,
          "sessionReused": false,
          "rawInputTokens": 6,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:144c2ee427f91cc34d94439660b5b8b4921202dc9ec0413f1c2e8ec9171d7ba2",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:95007716cf88f120281053be2df36c30c39e8363f168d779667a9b27e1d0ccf4",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 660,
          "cachedInputTokens": 90561,
          "taskSessionReused": false,
          "persistedSessionId": "915ffa8d-d661-4f6c-8061-8a2262e96f24",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 90561,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Draft, revise, approve, and hand off a plan passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens22 in · 5,113 out390,441 cached · 2/4 runs covered

LLM spend$0.0000002/4 runs provider-priced

ExecutionLocal · not metered2m 25s agent

agent-chat.runner-acpx-claude.local.plan-handoff

Matchers and test context

Attempt: 1
Duration: 2m 29s
Agent runtime: 2m 25s
Runtime: native
Provider: acpx
Model: claude-sonnet-5
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 4,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 22,
      "outputTokens": 5113,
      "cachedInputTokens": 390441,
      "totalTokens": 395576,
      "reportedCostUsd": 0,
      "costStatus": "partial"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 144643,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "f8114979-ed3d-456c-a561-77b9a1ed6a09",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 8,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 1380,
          "sessionReused": false,
          "rawInputTokens": 8,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:49f29b0d736220a32e8d415088d828a59c56b94340e9fe2dd9b9aeabe0bafe81",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:fbaf6cc615ef2751165726dc367c5c523ba781d65d1a075be073032300333fef",
              "workspaceReused": false,
              "activeWorkspaceId": "83bbb43f-6258-434d-a7da-4547daaee757",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1380,
          "cachedInputTokens": 131027,
          "taskSessionReused": false,
          "persistedSessionId": "8f8f11e3-1063-4cde-8e71-ca6982993b40",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 131027,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "9dcb33a6-7880-4441-877c-ca1dc9c9f706",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 14,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 3733,
          "sessionReused": false,
          "rawInputTokens": 14,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [
                "forceFreshSession was requested"
              ],
              "nextFingerprint": "v1:sha256:b83f0707d25c5660587c2acabfd667e8ead6fe3b08083e25cab8110bfea628fe",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:dcad27e503544e632855547428a9514bb58333e38580cb8895e0c96c44358a29",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 3733,
          "cachedInputTokens": 259414,
          "taskSessionReused": false,
          "persistedSessionId": "4a741caa-9b88-4492-a17e-22e75f1b4770",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 259414,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "7d9783f9-df66-45e7-8ee9-0972693e2cbf",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 0,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 0,
          "sessionReused": true,
          "rawInputTokens": 0,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:b83f0707d25c5660587c2acabfd667e8ead6fe3b08083e25cab8110bfea628fe",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:dcad27e503544e632855547428a9514bb58333e38580cb8895e0c96c44358a29",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 0,
          "cachedInputTokens": 0,
          "taskSessionReused": true,
          "persistedSessionId": "82e55233-2066-4395-8445-bca6c9de8050",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 0,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "578b6fdf-a3ea-49e4-ab34-2a81ca91d7fa",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 0,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 0,
          "sessionReused": false,
          "rawInputTokens": 0,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:b83f0707d25c5660587c2acabfd667e8ead6fe3b08083e25cab8110bfea628fe",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:dcad27e503544e632855547428a9514bb58333e38580cb8895e0c96c44358a29",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 0,
          "cachedInputTokens": 0,
          "taskSessionReused": false,
          "persistedSessionId": "82e55233-2066-4395-8445-bca6c9de8050",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 0,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Clarify and reuse an existing project passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens18 in · 6,031 out346,881 cached · 2/3 runs covered

LLM spend$0.0000002/3 runs provider-priced

ExecutionLocal · not metered2m 24s agent

agent-chat.runner-acpx-claude.local.clarify-reuse

Matchers and test context

Attempt: 1
Duration: 2m 13s
Agent runtime: 2m 24s
Runtime: native
Provider: acpx
Model: claude-sonnet-5
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 18,
      "outputTokens": 6031,
      "cachedInputTokens": 346881,
      "totalTokens": 352930,
      "reportedCostUsd": 0,
      "costStatus": "partial"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 144460,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "c84750be-67b6-465d-ad5e-391b0f5d3583",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 8,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 1275,
          "sessionReused": false,
          "rawInputTokens": 8,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:d09209dccf454bc9583a3dfdaf6428239f7559d5097678530b79bb29cdb3b62a",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:11880ad0524d7311792753804aa39206b7b70628c2aabd765859d9bbc547926d",
              "workspaceReused": false,
              "activeWorkspaceId": "7723cb93-d04d-4b90-b139-d678e7824b1d",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1275,
          "cachedInputTokens": 126594,
          "taskSessionReused": false,
          "persistedSessionId": "fee4f498-475c-4bb9-a6f5-b01dacb91f81",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 126594,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "37c2cf79-ce21-400c-8e15-186f5203883c",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 10,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 4756,
          "sessionReused": true,
          "rawInputTokens": 10,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:932fcb854247c91e387868a86b8ff982c1b217cc3a6f5d8c45774f504a29ceb9",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:cb80e7ecffa2ad4d47c6514fc1b0e1d88bf7ce5a7dcf25b6eb5e5662a93529f7",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 4756,
          "cachedInputTokens": 220287,
          "taskSessionReused": true,
          "persistedSessionId": "d3af51e7-b5ed-4748-820f-c95902fc174f",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 220287,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "2f6c4b91-10ce-47ce-afcf-0c987d59dfab",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 0,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 0,
          "sessionReused": false,
          "rawInputTokens": 0,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:932fcb854247c91e387868a86b8ff982c1b217cc3a6f5d8c45774f504a29ceb9",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:cb80e7ecffa2ad4d47c6514fc1b0e1d88bf7ce5a7dcf25b6eb5e5662a93529f7",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 0,
          "cachedInputTokens": 0,
          "taskSessionReused": false,
          "persistedSessionId": "d3af51e7-b5ed-4748-820f-c95902fc174f",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 0,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Create a project with multiple repository URLs passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens20 in · 5,492 out331,806 cached · 2/2 runs covered

LLM spend$0.0000002/2 runs provider-priced

ExecutionLocal · not metered1m 34s agent

agent-chat.runner-acpx-claude.local.multi-repository

Matchers and test context

Attempt: 1
Duration: 1m 36s
Agent runtime: 1m 34s
Runtime: native
Provider: acpx
Model: claude-sonnet-5
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 20,
      "outputTokens": 5492,
      "cachedInputTokens": 331806,
      "totalTokens": 337318,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 93564,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "eaeebf92-3e8b-4be7-b3d5-bbaab639a86e",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 8,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 1233,
          "sessionReused": false,
          "rawInputTokens": 8,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:2af7427749310aabdeb4aac187dfed74f423b767707825f8e2837b6d938d4c7d",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:a9f5bfd7e31e7ddbc7f7eeb5d1b03f8d5239c9cabc6d082e60a3e77c50844da1",
              "workspaceReused": false,
              "activeWorkspaceId": "646ef06f-f58c-40a7-ba6c-456406a43bf7",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1233,
          "cachedInputTokens": 127686,
          "taskSessionReused": false,
          "persistedSessionId": "ee724b8e-d7c1-4e22-ba3e-1fff966d3a12",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 127686,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "35275ca5-062e-490e-9ba4-6f9a8a473045",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 12,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 4259,
          "sessionReused": false,
          "rawInputTokens": 12,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:5f497c94283fd9db9de4f6d17980cc6c61f93a4db52cdb846f4e97edfe9220dc",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:cb2a05db9789ade0c9150faa19651fc03b9719f3268af698be3fb8a4804737e7",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 4259,
          "cachedInputTokens": 204120,
          "taskSessionReused": false,
          "persistedSessionId": "60dbe473-6387-41ab-a2fc-b8fae1009042",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 204120,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Test suite

Agent Chat Recovery and Coordination

Native chat startup cancellation, committed sends, hiring, grounded status, and remote continuity.

Pass rate100.0%18/18 passed

Tokens12,539,8733,718,311 input · 88,733 output

Cost$0.0406reported LLM + runtime estimate

Agent time28m 3s9m 7s lease

Execution18/180 retries · cleanup passed

Configuration matrix2 profiles · 2 environments · 18 selected

Agent profile Isolated locallocal · local Daytona warm reusable sandboxdaytona · remote

Runner Codexnativecodex · gpt-5.6-sol

Isolated locallocal · local

Stop during startup, reset, and resume passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens71,080 in · 470 out35,239 cached · 2/4 runs covered

LLM spend$0.0000002/4 runs provider-priced

ExecutionLocal · not metered23s agent

agent-chat-hardening.runner-codex.local.stop-startup-new-resume

Matchers and test context

Attempt: 1
Duration: 51s
Agent runtime: 23s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 4,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 71080,
      "outputTokens": 470,
      "cachedInputTokens": 35239,
      "totalTokens": 106789,
      "reportedCostUsd": 0,
      "costStatus": "partial"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 23110,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "94079dca-a4f2-4cd8-a643-c4746dd6b4c8",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 35535,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 227,
          "sessionReused": false,
          "rawInputTokens": 35535,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:7f73204c58896c887b1b67f4cffa238258b90bac3a91ecdf512314848fad3d0e",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:0ea0c7d821a9b7f66aad80fd9f129c53ff3a87d4046db2ca9a4185c8b8b7d7ac",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 227,
          "cachedInputTokens": 17617,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c570-3600-7b21-b309-8964b3eb875a",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 17617,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "4538b525-bbb1-4afd-9929-17c20c586b8b",
        "usage": null
      },
      {
        "runId": "a565cb19-3320-4f62-a861-1a37dd349f48",
        "usage": null
      },
      {
        "runId": "071b1a5d-bf2a-4c1a-9386-d3a253825e26",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 35545,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 243,
          "sessionReused": false,
          "rawInputTokens": 35545,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:7f73204c58896c887b1b67f4cffa238258b90bac3a91ecdf512314848fad3d0e",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:0ea0c7d821a9b7f66aad80fd9f129c53ff3a87d4046db2ca9a4185c8b8b7d7ac",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 243,
          "cachedInputTokens": 17622,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c56f-d72f-7b90-a5eb-08e00c1eb39d",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 17622,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Hire through chat, delegate, and reuse the same teammate passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens1,565,185 in · 17,507 out1,406,864 cached · 5/5 runs covered

LLM spend$0.0000005/5 runs provider-priced

ExecutionLocal · not metered3m 49s agent

agent-chat-hardening.runner-codex.local.hire-delegate-reuse

Matchers and test context

Attempt: 1
Duration: 3m 20s
Agent runtime: 3m 49s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 5,
      "runsWithTokenUsage": 5,
      "runsWithReportedCost": 5,
      "inputTokens": 1565185,
      "outputTokens": 17507,
      "cachedInputTokens": 1406864,
      "totalTokens": 2989556,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 229181,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "93cab089-237a-4491-9f84-6cfe21ac26b9",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 660720,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 6532,
          "sessionReused": true,
          "rawInputTokens": 660720,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:656d55e813a22275e98483b1eb026f9bc8eaee41921a893c1ea832e0909899bd",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:5041118d29a15104d5ee73cc04d680e4eb638f17de9737fa0fbc051270d487c4",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 6532,
          "cachedInputTokens": 614440,
          "taskSessionReused": true,
          "persistedSessionId": "01a0c570-0472-79e2-8d1a-737da84db250",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 614440,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "be38e041-86a8-48a0-a2d7-aefdf517d177",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 97645,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 1065,
          "sessionReused": false,
          "rawInputTokens": 97645,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:f9674b994370f5233c3d6f0eef83240b9335229b220a62959be763af9c1f7600",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:166ba50571ce3fab944efc76ac1caf1b80b2bf5b71fccc8fa14659434c668ff2",
              "workspaceReused": false,
              "activeWorkspaceId": "3a71969a-f3c3-49ed-8415-e5c58561001a",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1065,
          "cachedInputTokens": 76476,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c571-da9c-7800-a1a6-661de5231dfa",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 76476,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "8dd0f933-7923-4a9b-8226-6d746c1c10a1",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 481212,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 5560,
          "sessionReused": true,
          "rawInputTokens": 481212,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:656d55e813a22275e98483b1eb026f9bc8eaee41921a893c1ea832e0909899bd",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:5041118d29a15104d5ee73cc04d680e4eb638f17de9737fa0fbc051270d487c4",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 5560,
          "cachedInputTokens": 440184,
          "taskSessionReused": true,
          "persistedSessionId": "01a0c570-0472-79e2-8d1a-737da84db250",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 440184,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "6f7d0461-0800-48f2-88c9-a90e704c3dae",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 70869,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 761,
          "sessionReused": false,
          "rawInputTokens": 70869,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:f9674b994370f5233c3d6f0eef83240b9335229b220a62959be763af9c1f7600",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:166ba50571ce3fab944efc76ac1caf1b80b2bf5b71fccc8fa14659434c668ff2",
              "workspaceReused": false,
              "activeWorkspaceId": "2893fe6d-dea5-4fd3-a829-0214962692a6",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 761,
          "cachedInputTokens": 52373,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c570-e80a-7b81-990f-14cf1d3ba711",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 52373,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "a33bf3b5-1590-41bc-9418-10fd84d33a5c",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 254739,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 3589,
          "sessionReused": false,
          "rawInputTokens": 254739,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:656d55e813a22275e98483b1eb026f9bc8eaee41921a893c1ea832e0909899bd",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:5041118d29a15104d5ee73cc04d680e4eb638f17de9737fa0fbc051270d487c4",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 3589,
          "cachedInputTokens": 223391,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c570-0472-79e2-8d1a-737da84db250",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 223391,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Read the actual blocker and hand source material to a reviewer passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens1,096,369 in · 7,209 out980,203 cached · 4/4 runs covered

LLM spend$0.0000004/4 runs provider-priced

ExecutionLocal · not metered2m 2s agent

agent-chat-hardening.runner-codex.local.blocked-status-review

Matchers and test context

Attempt: 1
Duration: 2m 1s
Agent runtime: 2m 2s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: RUN-2

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 4,
      "runsWithTokenUsage": 4,
      "runsWithReportedCost": 4,
      "inputTokens": 1096369,
      "outputTokens": 7209,
      "cachedInputTokens": 980203,
      "totalTokens": 2083781,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 122140,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "f1490af9-e444-4aa5-be93-3780690193e1",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 514391,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 3296,
          "sessionReused": true,
          "rawInputTokens": 514391,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:9ad4973e920b47aa98dbf4951496fc3c4f8254534bd5412ae5f4b11830892a84",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:00f83347987f6d63afd1a74a7a8795e42d59b2ea81010feed65d73b7485055b7",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 3296,
          "cachedInputTokens": 473738,
          "taskSessionReused": true,
          "persistedSessionId": "01a0c56f-e6c6-74e3-8536-4509809a47d8",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 473738,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "b7e8677b-b033-44f5-bfa8-c8eed34b2af5",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 70147,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 721,
          "sessionReused": false,
          "rawInputTokens": 70147,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:77cded1c82796036655e8ba14dd3917f61e1028cfe7138304d74c7e036965369",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:d337a13d2a940d9bfe6a7293529715eac663fae5329c4a02d9254f55c10505f9",
              "workspaceReused": false,
              "activeWorkspaceId": "07a81ee5-c2e7-4e77-9f26-34c7905bd7a8",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 721,
          "cachedInputTokens": 51874,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c570-c2a4-7083-b252-11eb24f27cbb",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 51874,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "298450ac-a0bf-46fd-abb9-909fbceca554",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 362186,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 2347,
          "sessionReused": true,
          "rawInputTokens": 362186,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:9ad4973e920b47aa98dbf4951496fc3c4f8254534bd5412ae5f4b11830892a84",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:00f83347987f6d63afd1a74a7a8795e42d59b2ea81010feed65d73b7485055b7",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 2347,
          "cachedInputTokens": 329223,
          "taskSessionReused": true,
          "persistedSessionId": "01a0c56f-e6c6-74e3-8536-4509809a47d8",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 329223,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "c677fbab-e25d-4337-8d83-a5f9340dea3e",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 149645,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 845,
          "sessionReused": false,
          "rawInputTokens": 149645,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:9ad4973e920b47aa98dbf4951496fc3c4f8254534bd5412ae5f4b11830892a84",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:00f83347987f6d63afd1a74a7a8795e42d59b2ea81010feed65d73b7485055b7",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 845,
          "cachedInputTokens": 125368,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c56f-e6c6-74e3-8536-4509809a47d8",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 125368,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Recover a lost send acknowledgement without repeating committed work passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens221,617 in · 2,117 out178,247 cached · 2/2 runs covered

LLM spend$0.0000002/2 runs provider-priced

ExecutionLocal · not metered43s agent

agent-chat-hardening.runner-codex.local.committed-send-retry

Matchers and test context

Attempt: 1
Duration: 1m 22s
Agent runtime: 43s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 221617,
      "outputTokens": 2117,
      "cachedInputTokens": 178247,
      "totalTokens": 401981,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 42557,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "cd24abe9-0ace-44f2-bcc9-f8f855a81349",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 145159,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 1210,
          "sessionReused": true,
          "rawInputTokens": 145159,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:ce09aabf9ff0b6ccb590c81631965b341068603d690c8215279ac8c1eb27677c",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:0f24e341c4285bad443c76a33d1c11741b52b90658e27def3d911bc35f52f452",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1210,
          "cachedInputTokens": 121935,
          "taskSessionReused": true,
          "persistedSessionId": "01a0c56f-c752-7d61-bf7b-eb8956605c44",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 121935,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "e945a97a-4617-4c52-b8d9-7da29281d6ba",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 76458,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 907,
          "sessionReused": false,
          "rawInputTokens": 76458,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:ce09aabf9ff0b6ccb590c81631965b341068603d690c8215279ac8c1eb27677c",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:0f24e341c4285bad443c76a33d1c11741b52b90658e27def3d911bc35f52f452",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 907,
          "cachedInputTokens": 56312,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c56f-c752-7d61-bf7b-eb8956605c44",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 56312,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Conversation continuity across restart passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens233,928 in · 1,310 out172,310 cached · 3/3 runs covered

LLM spend$0.0000003/3 runs provider-priced

ExecutionLocal · not metered30s agent

agent-chat-hardening.runner-codex.local.continuity-restart

Matchers and test context

Attempt: 1
Duration: 1m 15s
Agent runtime: 30s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 3,
      "runsWithReportedCost": 3,
      "inputTokens": 233928,
      "outputTokens": 1310,
      "cachedInputTokens": 172310,
      "totalTokens": 407548,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 29995,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "88fbcc36-a0fc-41c0-8680-a54a0ba5310f",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 122375,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 642,
          "sessionReused": true,
          "rawInputTokens": 122375,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:f9064854f61dff34ddc6b9c4caef9ea6b5cebe16367a034ded38378dcb583292",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:1d0276c4a07eaafe3c60c7bbbcb46c6d9ffcf157142337943384f65aa3ca8c93",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 642,
          "cachedInputTokens": 99119,
          "taskSessionReused": true,
          "persistedSessionId": "01a0c56f-ef4f-7d61-b1a6-e30e13260a70",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 99119,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "9f215dac-1de3-4484-8c1d-5807f8689aea",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 76160,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 427,
          "sessionReused": true,
          "rawInputTokens": 76160,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:f9064854f61dff34ddc6b9c4caef9ea6b5cebe16367a034ded38378dcb583292",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:1d0276c4a07eaafe3c60c7bbbcb46c6d9ffcf157142337943384f65aa3ca8c93",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 427,
          "cachedInputTokens": 55643,
          "taskSessionReused": true,
          "persistedSessionId": "01a0c56f-ef4f-7d61-b1a6-e30e13260a70",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 55643,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "94f0212c-06cc-409e-8340-6a30af941e74",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 35393,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 241,
          "sessionReused": false,
          "rawInputTokens": 35393,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:f9064854f61dff34ddc6b9c4caef9ea6b5cebe16367a034ded38378dcb583292",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:1d0276c4a07eaafe3c60c7bbbcb46c6d9ffcf157142337943384f65aa3ca8c93",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 241,
          "cachedInputTokens": 17548,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c56f-ef4f-7d61-b1a6-e30e13260a70",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 17548,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Stop, reset, and resume passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens70,873 in · 607 out35,067 cached · 2/4 runs covered

LLM spend$0.0000002/4 runs provider-priced

ExecutionLocal · not metered23s agent

agent-chat-hardening.runner-codex.local.stop-new-resume

Matchers and test context

Attempt: 1
Duration: 51s
Agent runtime: 23s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 4,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 70873,
      "outputTokens": 607,
      "cachedInputTokens": 35067,
      "totalTokens": 106547,
      "reportedCostUsd": 0,
      "costStatus": "partial"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 23103,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "f4fd80ab-20c7-429f-94bc-169dfd16bbe9",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 35397,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 263,
          "sessionReused": false,
          "rawInputTokens": 35397,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:e979a6155523cc0b7ed32614456467fe9785d0ee42c8894b90a80dbe9aef91cd",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:a407db5d4f190a34431b5e08764b2b67d23583b5fe3aaf40af365c7b2ec91769",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 263,
          "cachedInputTokens": 17530,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c570-9abf-7c81-a5c3-7a5042bb7d38",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 17530,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "510941f9-f95c-4526-852d-8bb9e795e4f0",
        "usage": null
      },
      {
        "runId": "ca3dc20d-74f4-413d-85bc-85c05f0e6451",
        "usage": null
      },
      {
        "runId": "ef89a747-12a1-40e8-960a-34e6e18ef476",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 35476,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 344,
          "sessionReused": false,
          "rawInputTokens": 35476,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:e979a6155523cc0b7ed32614456467fe9785d0ee42c8894b90a80dbe9aef91cd",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:a407db5d4f190a34431b5e08764b2b67d23583b5fe3aaf40af365c7b2ec91769",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 344,
          "cachedInputTokens": 17537,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c570-3c01-7f32-8c7e-e1ebef204c47",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 17537,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Daytona warm reusable sandboxdaytona · remote

Recover a lost send acknowledgement without repeating committed work passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens247,538 in · 2,455 out205,622 cached · 2/2 runs covered

LLM spend$0.0000002/2 runs provider-priced

Execution$0.007027 est.1m 16s agent · 1m 35s lease

agent-chat-hardening.runner-codex.daytona.committed-send-retry

Matchers and test context

Attempt: 1
Duration: 2m 1s
Agent runtime: 1m 16s
Environment lease: 1m 35s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 247538,
      "outputTokens": 2455,
      "cachedInputTokens": 205622,
      "totalTokens": 455615,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "daytona",
      "agentRunDurationMs": 75551,
      "leaseDurationMs": 94576,
      "leaseCount": 2,
      "cpuCores": 4,
      "memoryGiB": 4,
      "diskGiB": 10,
      "estimatedListCostUsd": 0.007026996799999999,
      "costStatus": "estimated",
      "costSource": "daytona_public_list_price",
      "pricingAsOf": "2026-08-27",
      "pricingUrl": "https://www.daytona.io/pricing"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0.007026996799999999,
    "observedAndEstimatedCostUsd": 0.007026996799999999,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "deb19a68-bbc9-4e6e-bb75-9614dbb42464",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 157013,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 1367,
          "sessionReused": true,
          "rawInputTokens": 157013,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:c9e3d94107a4b23d16abbd5d756e7b0f3575ea2dc42a9117537209c7475b49c6",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:b86d6d0d6c83cd538d83e518f8148d52e0031a9498b7f5af969ecc53c516769a",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1367,
          "cachedInputTokens": 134540,
          "taskSessionReused": true,
          "persistedSessionId": "01a0c570-6af4-7601-95fc-cfb252dcb506",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 134540,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "8bb0a0c4-0029-40bb-bd4a-bbb40f5fbc27",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 90525,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 1088,
          "sessionReused": false,
          "rawInputTokens": 90525,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:c9e3d94107a4b23d16abbd5d756e7b0f3575ea2dc42a9117537209c7475b49c6",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:b86d6d0d6c83cd538d83e518f8148d52e0031a9498b7f5af969ecc53c516769a",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1088,
          "cachedInputTokens": 71082,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c570-6af4-7601-95fc-cfb252dcb506",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 71082,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Conversation continuity across restart passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens148,072 in · 952 out124,045 cached · 3/3 runs covered

LLM spend$0.0000003/3 runs provider-priced

Execution$0.006976 est.52s agent · 1m 34s lease

agent-chat-hardening.runner-codex.daytona.continuity-restart

Matchers and test context

Attempt: 1
Duration: 1m 49s
Agent runtime: 52s
Environment lease: 1m 34s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 3,
      "runsWithReportedCost": 3,
      "inputTokens": 148072,
      "outputTokens": 952,
      "cachedInputTokens": 124045,
      "totalTokens": 273069,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "daytona",
      "agentRunDurationMs": 51812,
      "leaseDurationMs": 93886,
      "leaseCount": 3,
      "cpuCores": 4,
      "memoryGiB": 4,
      "diskGiB": 10,
      "estimatedListCostUsd": 0.0069757298,
      "costStatus": "estimated",
      "costSource": "daytona_public_list_price",
      "pricingAsOf": "2026-08-27",
      "pricingUrl": "https://www.daytona.io/pricing"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0.0069757298,
    "observedAndEstimatedCostUsd": 0.0069757298,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "c01a1b48-d798-4fdc-ab0e-16be5c4477fc",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 79402,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 457,
          "sessionReused": true,
          "rawInputTokens": 79402,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:e68d1bb068ecd89c4fe3effc584e139682a3078618965af2948ccc637eb27252",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:4b1712f969f1bcba745fa67853f1731919cfd7c92dd1b308a7523e71277c4242",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 457,
          "cachedInputTokens": 74041,
          "taskSessionReused": true,
          "persistedSessionId": "01a0c570-6116-76a0-b485-ab26a761e2ab",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 74041,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "0cbf209f-3acc-41fb-b172-6c95d4a9a238",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 37017,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 232,
          "sessionReused": true,
          "rawInputTokens": 37017,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:e68d1bb068ecd89c4fe3effc584e139682a3078618965af2948ccc637eb27252",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:4b1712f969f1bcba745fa67853f1731919cfd7c92dd1b308a7523e71277c4242",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 232,
          "cachedInputTokens": 34338,
          "taskSessionReused": true,
          "persistedSessionId": "01a0c570-6116-76a0-b485-ab26a761e2ab",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 34338,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "5de4bb2a-4d8c-44dd-9426-8f181c2397a3",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 31653,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 263,
          "sessionReused": false,
          "rawInputTokens": 31653,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:e68d1bb068ecd89c4fe3effc584e139682a3078618965af2948ccc637eb27252",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:4b1712f969f1bcba745fa67853f1731919cfd7c92dd1b308a7523e71277c4242",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 263,
          "cachedInputTokens": 15666,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c570-6116-76a0-b485-ab26a761e2ab",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 15666,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Stop, reset, and resume passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens63,421 in · 519 out31,386 cached · 2/4 runs covered

LLM spend$0.0000002/4 runs provider-priced

Execution$0.004415 est.52s agent · 59s lease

agent-chat-hardening.runner-codex.daytona.stop-new-resume

Matchers and test context

Attempt: 1
Duration: 1m 27s
Agent runtime: 52s
Environment lease: 59s
Runtime: native
Provider: codex
Model: gpt-5.6-sol
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 4,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 63421,
      "outputTokens": 519,
      "cachedInputTokens": 31386,
      "totalTokens": 95326,
      "reportedCostUsd": 0,
      "costStatus": "partial"
    },
    "runtime": {
      "provider": "daytona",
      "agentRunDurationMs": 51941,
      "leaseDurationMs": 59415,
      "leaseCount": 3,
      "cpuCores": 4,
      "memoryGiB": 4,
      "diskGiB": 10,
      "estimatedListCostUsd": 0.0044145345,
      "costStatus": "estimated",
      "costSource": "daytona_public_list_price",
      "pricingAsOf": "2026-08-27",
      "pricingUrl": "https://www.daytona.io/pricing"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0.0044145345,
    "observedAndEstimatedCostUsd": 0.0044145345,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "9f5397d4-c44f-4274-b60a-d46637e151b5",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 31760,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 277,
          "sessionReused": false,
          "rawInputTokens": 31760,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:ce83fdde03ecc4d91174fc631463a18d6c635cdd1fc798a0996ae9ba8db63f4d",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:44e6c770feefb0f51063a81b93c16f1d8af6e132d366134285f7a4afc89a5ffb",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 277,
          "cachedInputTokens": 15705,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c570-bae6-7940-8e74-f9450a967e38",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 15705,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "256f30bf-85d9-470f-866c-539231b62ea9",
        "usage": null
      },
      {
        "runId": "2c4a13d3-8c48-4544-bb12-d5ced03bd9e1",
        "usage": null
      },
      {
        "runId": "9837347e-e5e0-4525-ac6b-84bce48b76e8",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 31661,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 242,
          "sessionReused": false,
          "rawInputTokens": 31661,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:ce83fdde03ecc4d91174fc631463a18d6c635cdd1fc798a0996ae9ba8db63f4d",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:44e6c770feefb0f51063a81b93c16f1d8af6e132d366134285f7a4afc89a5ffb",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 242,
          "cachedInputTokens": 15681,
          "taskSessionReused": false,
          "persistedSessionId": "01a0c570-3dc8-73c1-8fc1-1c7c6004a50c",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 15681,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Runner ACPX Claudenativeacpx · claude-sonnet-5

Isolated locallocal · local

Stop during startup, reset, and resume passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens12 in · 1,347 out181,195 cached · 2/4 runs covered

LLM spend$0.0000002/4 runs provider-priced

ExecutionLocal · not metered51s agent

agent-chat-hardening.runner-acpx-claude.local.stop-startup-new-resume

Matchers and test context

Attempt: 1
Duration: 1m 21s
Agent runtime: 51s
Runtime: native
Provider: acpx
Model: claude-sonnet-5
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 4,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 12,
      "outputTokens": 1347,
      "cachedInputTokens": 181195,
      "totalTokens": 182554,
      "reportedCostUsd": 0,
      "costStatus": "partial"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 50962,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "8b2f1c43-12f9-44c6-b4ff-d1a325d40cb5",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 6,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 794,
          "sessionReused": false,
          "rawInputTokens": 6,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:238f8515ba2fb9b7ce16cc4ae5d42907755214767d437c4acf2dc64deaafc849",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:5b1d7e4073e604187cc7a6db55828b28b3af7faef7c9e2084c22f89bd40159c3",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 794,
          "cachedInputTokens": 90718,
          "taskSessionReused": false,
          "persistedSessionId": "3cebf684-76fe-46b8-bd41-b91e6d1810ab",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 90718,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "097d9743-a9d8-468b-8ff0-cd3a686809fe",
        "usage": null
      },
      {
        "runId": "3b934e2f-ad00-471d-a289-f6762be06f16",
        "usage": null
      },
      {
        "runId": "27ff9d14-0dd4-4564-bc55-9a6cc846c7c8",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 6,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 553,
          "sessionReused": false,
          "rawInputTokens": 6,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:238f8515ba2fb9b7ce16cc4ae5d42907755214767d437c4acf2dc64deaafc849",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:5b1d7e4073e604187cc7a6db55828b28b3af7faef7c9e2084c22f89bd40159c3",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 553,
          "cachedInputTokens": 90477,
          "taskSessionReused": false,
          "persistedSessionId": "14157563-5d13-42c3-bfc0-a6e25e82ca03",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 90477,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Hire through chat, delegate, and reuse the same teammate passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens80 in · 33,238 out2,641,718 cached · 5/5 runs covered

LLM spend$0.0000005/5 runs provider-priced

ExecutionLocal · not metered7m 28s agent

agent-chat-hardening.runner-acpx-claude.local.hire-delegate-reuse

Matchers and test context

Attempt: 1
Duration: 6m 43s
Agent runtime: 7m 28s
Runtime: native
Provider: acpx
Model: claude-sonnet-5
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 5,
      "runsWithTokenUsage": 5,
      "runsWithReportedCost": 5,
      "inputTokens": 80,
      "outputTokens": 33238,
      "cachedInputTokens": 2641718,
      "totalTokens": 2675036,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 447951,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "576aa95f-2b67-4f72-badb-e4cd35677236",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 6,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 1615,
          "sessionReused": true,
          "rawInputTokens": 6,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:abe5c62900a3a6ab4daab93f536c0d0885911dc53a56df38983816d62c08a8ca",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:66c702fb1b2ab94570ff4f84de0001512f97a89b43a382b979b82f9d75eefbca",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1615,
          "cachedInputTokens": 388682,
          "taskSessionReused": true,
          "persistedSessionId": "cd9efd19-86d4-4c81-a56b-7450f001a14a",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 388682,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "268d0022-912d-44de-9f03-bac38b0feb4d",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 14,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 7900,
          "sessionReused": false,
          "rawInputTokens": 14,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:147963684484f956dce87016e8680909d89abfe86544ada9898f032e7cdf229b",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:86c1cfe5ade65830b34183d753986ffc66da42230a1f9bb617c1c0db1b17e231",
              "workspaceReused": false,
              "activeWorkspaceId": "55020c74-ad5c-4138-9103-44ebbefccf57",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 7900,
          "cachedInputTokens": 274341,
          "taskSessionReused": false,
          "persistedSessionId": "7255d8d5-4a7b-4c9e-91cb-026350456ddd",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 274341,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "c38e313e-1836-4a07-9baf-f718818ee40d",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 12,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 5017,
          "sessionReused": true,
          "rawInputTokens": 12,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:abe5c62900a3a6ab4daab93f536c0d0885911dc53a56df38983816d62c08a8ca",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:66c702fb1b2ab94570ff4f84de0001512f97a89b43a382b979b82f9d75eefbca",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 5017,
          "cachedInputTokens": 578300,
          "taskSessionReused": true,
          "persistedSessionId": "cd9efd19-86d4-4c81-a56b-7450f001a14a",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 578300,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "b8b3048b-9a30-401e-911f-9c997666064b",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 14,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 2875,
          "sessionReused": false,
          "rawInputTokens": 14,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:147963684484f956dce87016e8680909d89abfe86544ada9898f032e7cdf229b",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:86c1cfe5ade65830b34183d753986ffc66da42230a1f9bb617c1c0db1b17e231",
              "workspaceReused": false,
              "activeWorkspaceId": "cbcc6307-8d6f-4bbe-aef6-58979dfb5238",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 2875,
          "cachedInputTokens": 257797,
          "taskSessionReused": false,
          "persistedSessionId": "d0f096cb-7d9a-43df-8356-690d092fcae1",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 257797,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "14c92347-a6be-496d-8f04-4e6d0d6b2b27",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 34,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 15831,
          "sessionReused": false,
          "rawInputTokens": 34,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:abe5c62900a3a6ab4daab93f536c0d0885911dc53a56df38983816d62c08a8ca",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:66c702fb1b2ab94570ff4f84de0001512f97a89b43a382b979b82f9d75eefbca",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 15831,
          "cachedInputTokens": 1142598,
          "taskSessionReused": false,
          "persistedSessionId": "cd9efd19-86d4-4c81-a56b-7450f001a14a",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 1142598,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Read the actual blocker and hand source material to a reviewer passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens48 in · 10,037 out1,248,200 cached · 4/4 runs covered

LLM spend$0.0000004/4 runs provider-priced

ExecutionLocal · not metered2m 50s agent

agent-chat-hardening.runner-acpx-claude.local.blocked-status-review

Matchers and test context

Attempt: 1
Duration: 2m 43s
Agent runtime: 2m 50s
Runtime: native
Provider: acpx
Model: claude-sonnet-5
Issue: RUN-2

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 4,
      "runsWithTokenUsage": 4,
      "runsWithReportedCost": 4,
      "inputTokens": 48,
      "outputTokens": 10037,
      "cachedInputTokens": 1248200,
      "totalTokens": 1258285,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 169579,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "4cb9472a-5e12-47e5-a8ba-a4852ca11a60",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 8,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 1916,
          "sessionReused": true,
          "rawInputTokens": 8,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:8cc1d84735a5716f313e0392ff89c36212d89bedca1a8e2b9efaad17bf7ada53",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:6dd789947d5001721ab5dc708d06a7546e9ec74506a49e1407901a1a18cc734e",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1916,
          "cachedInputTokens": 311846,
          "taskSessionReused": true,
          "persistedSessionId": "7292a5a1-68a8-4941-8ab6-e4f27d18d972",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 311846,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "487b961a-6da9-425a-b666-479d3c1a4027",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 8,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 1728,
          "sessionReused": false,
          "rawInputTokens": 8,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:82e556dfd45112bfcee73a0199478d274cf987d22a14c8cfcd43f976d1b8626d",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:7305d180d6e532cfcae140f4c85fecde0be51e85a870d6b3799ef7123f7ba2ca",
              "workspaceReused": false,
              "activeWorkspaceId": "3a1efe2c-6cf5-4f08-9625-2cf4bf4f1e91",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1728,
          "cachedInputTokens": 127304,
          "taskSessionReused": false,
          "persistedSessionId": "63622e7e-f1ea-4a48-a9f5-684086c9e384",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 127304,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "035e40a0-bc91-4be2-b3ae-6d5c72efd9f2",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 18,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 3713,
          "sessionReused": true,
          "rawInputTokens": 18,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:8cc1d84735a5716f313e0392ff89c36212d89bedca1a8e2b9efaad17bf7ada53",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:6dd789947d5001721ab5dc708d06a7546e9ec74506a49e1407901a1a18cc734e",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 3713,
          "cachedInputTokens": 540364,
          "taskSessionReused": true,
          "persistedSessionId": "7292a5a1-68a8-4941-8ab6-e4f27d18d972",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 540364,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "989bc30a-0f32-40c3-aea3-eec8a454a3fd",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 14,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 2680,
          "sessionReused": false,
          "rawInputTokens": 14,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:8cc1d84735a5716f313e0392ff89c36212d89bedca1a8e2b9efaad17bf7ada53",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:6dd789947d5001721ab5dc708d06a7546e9ec74506a49e1407901a1a18cc734e",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 2680,
          "cachedInputTokens": 268686,
          "taskSessionReused": false,
          "persistedSessionId": "7292a5a1-68a8-4941-8ab6-e4f27d18d972",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 268686,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Recover a lost send acknowledgement without repeating committed work passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens18 in · 2,316 out335,644 cached · 2/2 runs covered

LLM spend$0.0000002/2 runs provider-priced

ExecutionLocal · not metered56s agent

agent-chat-hardening.runner-acpx-claude.local.committed-send-retry

Matchers and test context

Attempt: 1
Duration: 1m 38s
Agent runtime: 56s
Runtime: native
Provider: acpx
Model: claude-sonnet-5
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 18,
      "outputTokens": 2316,
      "cachedInputTokens": 335644,
      "totalTokens": 337978,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 56277,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "69d26864-d59e-4a08-b509-4387b005c6b4",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 8,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 635,
          "sessionReused": true,
          "rawInputTokens": 8,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:bf4c94718dda43e34df6caf8f1388beef8419a382f4ee332381e6ab7defd115b",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:63fbff8190a485a893bb9d8055bf01acfcfec9cfd0172b87b8fad68e3a7e0e2f",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 635,
          "cachedInputTokens": 159204,
          "taskSessionReused": true,
          "persistedSessionId": "aaf7a62e-2696-4b34-9a9a-fe01759bad85",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 159204,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "ba8762c4-f053-44ec-8192-5a296ccfebec",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 10,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 1681,
          "sessionReused": false,
          "rawInputTokens": 10,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:bf4c94718dda43e34df6caf8f1388beef8419a382f4ee332381e6ab7defd115b",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:63fbff8190a485a893bb9d8055bf01acfcfec9cfd0172b87b8fad68e3a7e0e2f",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1681,
          "cachedInputTokens": 176440,
          "taskSessionReused": false,
          "persistedSessionId": "aaf7a62e-2696-4b34-9a9a-fe01759bad85",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 176440,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Conversation continuity across restart passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens14 in · 1,285 out215,698 cached · 3/3 runs covered

LLM spend$0.0000003/3 runs provider-priced

ExecutionLocal · not metered52s agent

agent-chat-hardening.runner-acpx-claude.local.continuity-restart

Matchers and test context

Attempt: 1
Duration: 1m 37s
Agent runtime: 52s
Runtime: native
Provider: acpx
Model: claude-sonnet-5
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 3,
      "runsWithReportedCost": 3,
      "inputTokens": 14,
      "outputTokens": 1285,
      "cachedInputTokens": 215698,
      "totalTokens": 216997,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 52159,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "77602e48-fd3b-47f9-b056-a5801301ed2b",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 4,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 381,
          "sessionReused": true,
          "rawInputTokens": 4,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:6e452d124e684896d5082c6ee4012d498e031e00ffe0122cbfdde9a77495205a",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:697fa955f7d497603136e37e017d448f06b4fe6f20b0ff29df539b27bbce9b1e",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 381,
          "cachedInputTokens": 85198,
          "taskSessionReused": true,
          "persistedSessionId": "e8e1aba6-ce80-4964-bbcb-2ed2bcd311a6",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 85198,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "c977ab15-5ba8-4e7d-aaaa-2325d722de5f",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 4,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 359,
          "sessionReused": true,
          "rawInputTokens": 4,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:6e452d124e684896d5082c6ee4012d498e031e00ffe0122cbfdde9a77495205a",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:697fa955f7d497603136e37e017d448f06b4fe6f20b0ff29df539b27bbce9b1e",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 359,
          "cachedInputTokens": 40116,
          "taskSessionReused": true,
          "persistedSessionId": "e8e1aba6-ce80-4964-bbcb-2ed2bcd311a6",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 40116,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "f36b3127-a1f9-406c-837b-0c23ae840d4c",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 6,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 545,
          "sessionReused": false,
          "rawInputTokens": 6,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:6e452d124e684896d5082c6ee4012d498e031e00ffe0122cbfdde9a77495205a",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:697fa955f7d497603136e37e017d448f06b4fe6f20b0ff29df539b27bbce9b1e",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 545,
          "cachedInputTokens": 90384,
          "taskSessionReused": false,
          "persistedSessionId": "e8e1aba6-ce80-4964-bbcb-2ed2bcd311a6",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 90384,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Stop, reset, and resume passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens12 in · 1,598 out181,167 cached · 2/4 runs covered

LLM spend$0.0000002/4 runs provider-priced

ExecutionLocal · not metered54s agent

agent-chat-hardening.runner-acpx-claude.local.stop-new-resume

Matchers and test context

Attempt: 1
Duration: 1m 24s
Agent runtime: 54s
Runtime: native
Provider: acpx
Model: claude-sonnet-5
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 4,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 12,
      "outputTokens": 1598,
      "cachedInputTokens": 181167,
      "totalTokens": 182777,
      "reportedCostUsd": 0,
      "costStatus": "partial"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 53917,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "cc083e52-f2ef-4cca-8c2d-86c830f1eed8",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 6,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 931,
          "sessionReused": false,
          "rawInputTokens": 6,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:9925352ab4853037bc90413e498eada49550d44117857e7e82cf4267d0a487dd",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:a132cb96ac9f54c7a522d4519305d58bf1b4c96da0f4a60f0d68b3838bb895e4",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 931,
          "cachedInputTokens": 90785,
          "taskSessionReused": false,
          "persistedSessionId": "5e645e12-4499-4362-af05-30634536ba35",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 90785,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "e8e99cee-9975-4522-b360-639ad277fb50",
        "usage": null
      },
      {
        "runId": "67d8755c-6bd9-4c95-aa6b-730257766802",
        "usage": null
      },
      {
        "runId": "c80f1b41-916c-4537-b287-b0ccdb94f3ca",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 6,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 667,
          "sessionReused": false,
          "rawInputTokens": 6,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:9925352ab4853037bc90413e498eada49550d44117857e7e82cf4267d0a487dd",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:a132cb96ac9f54c7a522d4519305d58bf1b4c96da0f4a60f0d68b3838bb895e4",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 667,
          "cachedInputTokens": 90382,
          "taskSessionReused": false,
          "persistedSessionId": "14b35d26-806e-4752-86cb-da50ade1d273",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 90382,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Daytona warm reusable sandboxdaytona · remote

Recover a lost send acknowledgement without repeating committed work passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens18 in · 3,052 out345,184 cached · 2/2 runs covered

LLM spend$0.0000002/2 runs provider-priced

Execution$0.007746 est.1m 13s agent · 1m 44s lease

agent-chat-hardening.runner-acpx-claude.daytona.committed-send-retry

Matchers and test context

Attempt: 1
Duration: 1m 58s
Agent runtime: 1m 13s
Environment lease: 1m 44s
Runtime: native
Provider: acpx
Model: claude-sonnet-5
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 18,
      "outputTokens": 3052,
      "cachedInputTokens": 345184,
      "totalTokens": 348254,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "daytona",
      "agentRunDurationMs": 72796,
      "leaseDurationMs": 104250,
      "leaseCount": 2,
      "cpuCores": 4,
      "memoryGiB": 4,
      "diskGiB": 10,
      "estimatedListCostUsd": 0.007745775,
      "costStatus": "estimated",
      "costSource": "daytona_public_list_price",
      "pricingAsOf": "2026-08-27",
      "pricingUrl": "https://www.daytona.io/pricing"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0.007745775,
    "observedAndEstimatedCostUsd": 0.007745775,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "5f81f181-077a-4ab6-8e68-d168b7953c7b",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 8,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 677,
          "sessionReused": true,
          "rawInputTokens": 8,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:636b5d561097baa43b5796edc4a9877c74b16cd70247d741ed3b46d20a639083",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:8666d18d93a6e270fa5aaab106cb6e836f7de78426e3d1860841186fb891fa42",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 677,
          "cachedInputTokens": 165364,
          "taskSessionReused": true,
          "persistedSessionId": "afb89fe1-7e64-4ad0-90ab-ada86e24321a",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 165364,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "4f94e5d6-0ebe-4b31-b57f-7a31d19fe845",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 10,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 2375,
          "sessionReused": false,
          "rawInputTokens": 10,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:636b5d561097baa43b5796edc4a9877c74b16cd70247d741ed3b46d20a639083",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:8666d18d93a6e270fa5aaab106cb6e836f7de78426e3d1860841186fb891fa42",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 2375,
          "cachedInputTokens": 179820,
          "taskSessionReused": false,
          "persistedSessionId": "afb89fe1-7e64-4ad0-90ab-ada86e24321a",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 179820,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Conversation continuity across restart passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens14 in · 1,308 out234,873 cached · 3/3 runs covered

LLM spend$0.0000003/3 runs provider-priced

Execution$0.007769 est.1m 6s agent · 1m 45s lease

agent-chat-hardening.runner-acpx-claude.daytona.continuity-restart

Matchers and test context

Attempt: 1
Duration: 1m 59s
Agent runtime: 1m 6s
Environment lease: 1m 45s
Runtime: native
Provider: acpx
Model: claude-sonnet-5
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 3,
      "runsWithReportedCost": 3,
      "inputTokens": 14,
      "outputTokens": 1308,
      "cachedInputTokens": 234873,
      "totalTokens": 236195,
      "reportedCostUsd": 0,
      "costStatus": "reported"
    },
    "runtime": {
      "provider": "daytona",
      "agentRunDurationMs": 65938,
      "leaseDurationMs": 104564,
      "leaseCount": 3,
      "cpuCores": 4,
      "memoryGiB": 4,
      "diskGiB": 10,
      "estimatedListCostUsd": 0.007769105199999999,
      "costStatus": "estimated",
      "costSource": "daytona_public_list_price",
      "pricingAsOf": "2026-08-27",
      "pricingUrl": "https://www.daytona.io/pricing"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0.007769105199999999,
    "observedAndEstimatedCostUsd": 0.007769105199999999,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "41f54819-3390-4cbe-99c5-a47565f6ce74",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 4,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 361,
          "sessionReused": true,
          "rawInputTokens": 4,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:b41cbb5804ed79ae42971427d098bd4da8ed731e208035f70f5a5d30e96b58e6",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:9921237179397db978953f93d12612afb868bf557b82a32d849a19fcf7d20316",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 361,
          "cachedInputTokens": 84791,
          "taskSessionReused": true,
          "persistedSessionId": "44d943de-843d-4b5f-8305-2139f21ef7fa",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 84791,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "c2e25ce1-8181-4998-97bc-3968352ee89a",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 4,
          "usageSource": "per_run",
          "freshSession": false,
          "outputTokens": 335,
          "sessionReused": true,
          "rawInputTokens": 4,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:b41cbb5804ed79ae42971427d098bd4da8ed731e208035f70f5a5d30e96b58e6",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:9921237179397db978953f93d12612afb868bf557b82a32d849a19fcf7d20316",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 335,
          "cachedInputTokens": 60016,
          "taskSessionReused": true,
          "persistedSessionId": "44d943de-843d-4b5f-8305-2139f21ef7fa",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 60016,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "65c2f67a-a4cb-41e6-b2c3-f74ac7937b8f",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 6,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 612,
          "sessionReused": false,
          "rawInputTokens": 6,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:b41cbb5804ed79ae42971427d098bd4da8ed731e208035f70f5a5d30e96b58e6",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:9921237179397db978953f93d12612afb868bf557b82a32d849a19fcf7d20316",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 612,
          "cachedInputTokens": 90066,
          "taskSessionReused": false,
          "persistedSessionId": "44d943de-843d-4b5f-8305-2139f21ef7fa",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 90066,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Stop, reset, and resume passed

Overall passed · 1/1 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (1)

Result	Check	Detail
Pass	`issue_status`	Chat workflow and durable handoff/session assertions passed

Tokens12 in · 1,406 out180,167 cached · 2/4 runs covered

LLM spend$0.0000002/4 runs provider-priced

Execution$0.006707 est.1m 4s agent · 1m 30s lease

agent-chat-hardening.runner-acpx-claude.daytona.stop-new-resume

Matchers and test context

Attempt: 1
Duration: 1m 45s
Agent runtime: 1m 4s
Environment lease: 1m 30s
Runtime: native
Provider: acpx
Model: claude-sonnet-5
Issue: RUN-1

All invariants passed

Result	Matcher	Expectation	Detail
Pass	`issue_status`	{"kind":"issue_status","expected":"in_review"}	Chat workflow and durable handoff/session assertions passed

Usage and billing metadata

{
  "billing": {
    "llm": {
      "runCount": 4,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 2,
      "inputTokens": 12,
      "outputTokens": 1406,
      "cachedInputTokens": 180167,
      "totalTokens": 181585,
      "reportedCostUsd": 0,
      "costStatus": "partial"
    },
    "runtime": {
      "provider": "daytona",
      "agentRunDurationMs": 64229,
      "leaseDurationMs": 90272,
      "leaseCount": 3,
      "cpuCores": 4,
      "memoryGiB": 4,
      "diskGiB": 10,
      "estimatedListCostUsd": 0.0067072096,
      "costStatus": "estimated",
      "costSource": "daytona_public_list_price",
      "pricingAsOf": "2026-08-27",
      "pricingUrl": "https://www.daytona.io/pricing"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0.0067072096,
    "observedAndEstimatedCostUsd": 0.0067072096,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "a6726b5a-e15a-4864-9a4e-016fd20cc0a9",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 6,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 776,
          "sessionReused": false,
          "rawInputTokens": 6,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:21bbf4432f8e768adabef6b7e2f8b5641efa3750a7bfc4acb8dfe42f2bef2627",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:868c20009acd976cc1cca13a36a5f41b2588c55c3ebc7719e8c5f18ffb9bab0f",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 776,
          "cachedInputTokens": 90215,
          "taskSessionReused": false,
          "persistedSessionId": "de8ad03a-9d3e-42e7-9aa0-52144d62d212",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 90215,
          "sessionRotationReason": null
        }
      },
      {
        "runId": "dccaab42-5e9b-4c2a-8d9f-6b125ae6aa6c",
        "usage": null
      },
      {
        "runId": "52b3da31-fd49-4e15-8612-e51303df5d6d",
        "usage": null
      },
      {
        "runId": "cddc1e76-7daa-4479-9852-8696132f3d56",
        "usage": {
          "model": "claude-sonnet-5",
          "biller": "openai",
          "costUsd": 0,
          "provider": "openai",
          "costStatus": "reported",
          "billingType": "unknown",
          "inputTokens": 6,
          "usageSource": "per_run",
          "freshSession": true,
          "outputTokens": 630,
          "sessionReused": false,
          "rawInputTokens": 6,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:21bbf4432f8e768adabef6b7e2f8b5641efa3750a7bfc4acb8dfe42f2bef2627",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:868c20009acd976cc1cca13a36a5f41b2588c55c3ebc7719e8c5f18ffb9bab0f",
              "workspaceReused": false,
              "activeWorkspaceId": null,
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 630,
          "cachedInputTokens": 89952,
          "taskSessionReused": false,
          "persistedSessionId": "a990bf95-c4e8-4d51-8af6-9430b3c7abd1",
          "cacheAdjustedCostUsd": 0,
          "rawCachedInputTokens": 89952,
          "sessionRotationReason": null
        }
      }
    ]
  }
}

Test suite

Core Runner Compatibility

Major provider, runtime generation, and execution-environment compatibility.

Configuration matrix7 profiles · 2 environments · 0 selected

Agent profile	Isolated locallocal · local	Daytona sandboxdaytona · remote
Legacy Codexlegacycodex · gpt-5.6-sol	Isolated locallocal · local Basic response not selected `core-compatibility.legacy-codex.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-codex.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-codex.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.legacy-codex.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-codex.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-codex.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Legacy Claudelegacyclaude · claude-sonnet-4-6	Isolated locallocal · local Basic response not selected `core-compatibility.legacy-claude.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-claude.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-claude.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.legacy-claude.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-claude.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-claude.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Legacy OpenCodelegacyopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Basic response not selected `core-compatibility.legacy-opencode.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-opencode.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-opencode.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.legacy-opencode.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.legacy-opencode.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.legacy-opencode.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Basic response not selected `core-compatibility.runner-codex.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-codex.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-codex.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.runner-codex.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-codex.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-codex.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Runner OpenCodenativeopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Basic response not selected `core-compatibility.runner-opencode.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-opencode.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-opencode.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.runner-opencode.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-opencode.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-opencode.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Basic response not selected `core-compatibility.runner-acpx-claude.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-acpx-claude.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-acpx-claude.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.runner-acpx-claude.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-acpx-claude.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-acpx-claude.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Codexnativeacpx · gpt-5.6-sol	Isolated locallocal · local Basic response not selected `core-compatibility.runner-acpx-codex.local.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-acpx-codex.local.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-acpx-codex.local.ask-question` Matchers and test context Not selected No matcher result was recorded.	Daytona sandboxdaytona · remote Basic response not selected `core-compatibility.runner-acpx-codex.daytona.message-marker` Matchers and test context Not selected No matcher result was recorded. Plan, revise, accept, implement not selected `core-compatibility.runner-acpx-codex.daytona.plan-revise-accept` Matchers and test context Not selected No matcher result was recorded. Ask mode question not selected `core-compatibility.runner-acpx-codex.daytona.ask-question` Matchers and test context Not selected No matcher result was recorded.

Test suite

Local Session Integrity

Structured interaction and continuation qualification for every supported local profile.

Configuration matrix7 profiles · 1 environments · 0 selected

Agent profile	Isolated locallocal · local
Legacy Codexlegacycodex · gpt-5.6-sol	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.legacy-codex.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.legacy-codex.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Legacy Claudelegacyclaude · claude-sonnet-4-6	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.legacy-claude.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.legacy-claude.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Legacy OpenCodelegacyopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.legacy-opencode.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.legacy-opencode.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.runner-codex.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.runner-codex.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Runner OpenCodenativeopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.runner-opencode.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.runner-opencode.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Claudenativeacpx · claude-sonnet-5	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.runner-acpx-claude.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.runner-acpx-claude.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.
Runner ACPX Codexnativeacpx · gpt-5.6-sol	Isolated locallocal · local Structured question, answer, resume not selected `local-session-integrity.runner-acpx-codex.local.structured-question-resume` Matchers and test context Not selected No matcher result was recorded. Structured question, server restart, answer, resume not selected `local-session-integrity.runner-acpx-codex.local.structured-question-restart-resume` Matchers and test context Not selected No matcher result was recorded.

Test suite

OpenRouter Model Breadth

Weekly-ranked tool-capable OpenRouter models through native OpenCode on isolated local workspaces.

Configuration matrix4 profiles · 1 environments · 0 selected

Agent profile	Isolated locallocal · local
#1 DeepSeek V4 Flash 0731nativeopencode · openrouter/deepseek/deepseek-v4-flash-0731	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-deepseek-deepseek-v4-flash-0731.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-deepseek-deepseek-v4-flash-0731.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded.
#3 Tencent HY 3nativeopencode · openrouter/tencent/hy3	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-tencent-hy3.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-tencent-hy3.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded.
#4 Nemotron 3 Ultra 550B A55B (free)nativeopencode · openrouter/nvidia/nemotron-3-ultra-550b-a55b:free	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded. Plan, approve, complete not selected `openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.plan-approve-complete` Matchers and test context Not selected No matcher result was recorded.
#5 GPT-5.6 Lunanativeopencode · openrouter/openai/gpt-5.6-luna	Isolated locallocal · local Hello and complete not selected `openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.hello-complete` Matchers and test context Not selected No matcher result was recorded. Ask, answer, resume not selected `openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.question-resume-complete` Matchers and test context Not selected No matcher result was recorded. Plan, approve, complete not selected `openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.plan-approve-complete` Matchers and test context Not selected No matcher result was recorded.

Test suite

Daytona Warm Continuity

Three browser-driven turns on one reusable Daytona sandbox for legacy and native Codex.

Configuration matrix2 profiles · 1 environments · 0 selected

Agent profile	Daytona warm reusable sandboxdaytona · remote
Legacy Codexlegacycodex · gpt-5.6-sol	Daytona warm reusable sandboxdaytona · remote Warm three-turn workspace continuity not selected `daytona-warm-continuity.legacy-codex.daytona.warm-three-turn` Matchers and test context Not selected No matcher result was recorded.
Runner Codexnativecodex · gpt-5.6-sol	Daytona warm reusable sandboxdaytona · remote Warm three-turn workspace continuity not selected `daytona-warm-continuity.runner-codex.daytona.warm-three-turn` Matchers and test context Not selected No matcher result was recorded.

Task continuation

Everyday Paperclip Work

First-task onboarding

Persistent Agent Chat

Agent Chat Recovery and Coordination

Core Runner Compatibility

Local Session Integrity

OpenRouter Model Breadth

Daytona Warm Continuity

Campaign trends