Full-stack acceptance campaign

Runner Full-Stack E2E

Results across runner profiles and execution environments. Declared PNG screenshots and normalized results are retained with every published campaign; additional diagnostic evidence remains in the access-controlled workflow artifact.

2026-10-21T18:00:54.028Z232d3c52Source run ↗

2/2Passed
0Failed
3m 35sTest time
Campaign usage and spend
97,587Input tokens
4,574Output tokens
479,707Cached tokens
UnavailableLLM reported subtotal
$0.000000Daytona list estimate
2m 34sAgent execution time
0msDaytona lease time
0/4Runs provider-priced

Model spend is the provider-reported subtotal; unpriced or unavailable runs are excluded, never counted as free. Daytona runtime is a public-list-price estimate from captured lease time and pinned resources, before credits, discounts, storage allowance, or invoice adjustments. Local execution has no external runtime meter.

All results

Feature coverage 0 of 191 capabilities linked · 0 of 2 tests mapped

Associations use the current feature map. Counts describe linked test scenarios; a passing journey does not establish full coverage of a capability.

Getting started and access

FeatureCapabilities linkedLinked test results
Onboarding and first work 0/5 No mapped journey
Login, invitations, and access 0/5 No mapped journey
Companies and portability 0/8 No mapped journey

Tasks and conversations

FeatureCapabilities linkedLinked test results
Task creation and lifecycle 0/6 No mapped journey
Delegation, dependencies, and signoff 0/4 No mapped journey
Inbox, decisions, and search 0/5 No mapped journey
Agent conversations and project handoff 0/4 No mapped journey
Questions and approvals 0/8 No mapped journey
Steering and queued messages 0/7 No mapped journey
Documents, attachments, and work products 0/5 No mapped journey

Agents and reusable capabilities

FeatureCapabilities linkedLinked test results
Hiring, configuration, and organization 0/9 No mapped journey
Runs, harnesses, and model accounts 0/4 No mapped journey
Skills and Skill Studio 0/5 No mapped journey
Team packages and installation 0/4 No mapped journey

Projects and execution

FeatureCapabilities linkedLinked test results
Projects and repositories 0/5 No mapped journey
Goals and work alignment 0/3 No mapped journey
Workspaces, services, and files 0/5 No mapped journey
Execution environments 0/5 No mapped journey
Recovery 0/8 No mapped journey

Apps, channels, and extensions

FeatureCapabilities linkedLinked test results
Connection setup 0/8 No mapped journey
Assistant connections (MCP) 0/5 No mapped journey
App access and action permissions 0/5 No mapped journey
External chat and email 0/6 No mapped journey
Tool gateways and access profiles 0/5 No mapped journey
Secrets and proposals 0/5 No mapped journey
Plugins 0/4 No mapped journey

Automation and structured work

FeatureCapabilities linkedLinked test results
Routines, schedules, and triggers 0/5 No mapped journey
Cases 0/5 No mapped journey
Status cards 0/4 No mapped journey

Oversight and operation

FeatureCapabilities linkedLinked test results
Costs and budgets 0/6 No mapped journey
Dashboards and audit trails 0/6 No mapped journey
Navigation, profile, and announcements 0/6 No mapped journey
Instance operations 0/6 No mapped journey
CLI/API and local worktrees 0/6 No mapped journey

Contributor surfaces

FeatureCapabilities linkedLinked test results
Developer previews and diagnostic labs 0/4 No mapped journey

Test suite

followup-stop-resume

Suite discovered from retained campaign identities; full suite size is not known to this publisher.

Pass rate100.0%2/2 passed
Tokens581,86897,587 input · 4,574 output
Known spendUnavailablereported LLM + runtime estimate
Agent time2m 34s0ms lease
Execution2/20 retries · cleanup passed
Codie staging-model diagnosticIsolated localcodex · gpt-6.1-sol
Test details5/5 checks · 1m 39s
Overall passed · 5/5 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (5)
ResultCheckDetail
PassfollowupStopResume.active-followup-before-stopOne ordinary user follow-up must persist while the original result-free provider run is still active.
PassfollowupStopResume.stop-remains-authoritativeThe acknowledged Stop must retain one cancelled run with no automatic continuation throughout the recorded quiet window before a real user resumes.
PassfollowupStopResume.one-explicit-resumptionOnly one user-triggered successor may complete the original task after Stop.
PassfollowupStopResume.retained-context-workspace-toolsThe independently seeded context, earlier follow-up, workspace, production instructions and tool contract must survive without being restated in the resume message.
PassfollowupStopResume.accessible-resumed-resultOne receipt-bound final reply must expose the independently verified result without a pending question.
Tokens53,668 in · 1,442 out231,789 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered1m 8s agent
followup-stop-resume.runner-codex.local.followup-stop-resume
Attempt
1
Duration
1m 39s
Agent runtime
1m 8s
Runtime
native
Provider
codex
Model
gpt-6.1-sol
Issue
RUN-1

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
37e3feec-745b-4da8-bfbf-3602cb42601cunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
125339ad-b546-4092-bc8c-691a33381960unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"followupStopResume.active-followup-before-stop","expected":true} One ordinary user follow-up must persist while the original result-free provider run is still active.
Pass json_path {"kind":"json_path","path":"followupStopResume.stop-remains-authoritative","expected":true} The acknowledged Stop must retain one cancelled run with no automatic continuation throughout the recorded quiet window before a real user resumes.
Pass json_path {"kind":"json_path","path":"followupStopResume.one-explicit-resumption","expected":true} Only one user-triggered successor may complete the original task after Stop.
Pass json_path {"kind":"json_path","path":"followupStopResume.retained-context-workspace-tools","expected":true} The independently seeded context, earlier follow-up, workspace, production instructions and tool contract must survive without being restated in the resume message.
Pass json_path {"kind":"json_path","path":"followupStopResume.accessible-resumed-result","expected":true} One receipt-bound final reply must expose the independently verified result without a pending question.
Usage and billing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "inputTokens": 53668,
      "outputTokens": 1442,
      "cachedInputTokens": 231789,
      "totalTokens": 286899,
      "reportedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 68327,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "37e3feec-745b-4da8-bfbf-3602cb42601c",
        "usage": {
          "model": "gpt-6.1-sol",
          "biller": "openai",
          "costUsd": null,
          "provider": "openai",
          "costStatus": "estimated",
          "billingType": "metered_api",
          "inputTokens": 27362,
          "ledgerScope": {
            "issueId": "d9f17dd5-060d-480f-ab80-a1197806fb51",
            "projectId": "01fb592e-3b88-435a-af35-39d7f0a6ba96",
            "billingCode": null
          },
          "usageSource": "per_run",
          "costUsdExact": "0.076840000",
          "freshSession": true,
          "outputTokens": 907,
          "usageByModel": null,
          "sessionReused": false,
          "budgetDispatch": {
            "admittedAt": "2026-10-21T17:58:32.525Z",
            "handedOffAt": "2026-10-21T17:58:32.552Z",
            "reservationId": "6c550587-e066-4296-b963-4c85c5046fea",
            "recoveryLeaseOwner": null
          },
          "budgetExposure": {
            "sequence": 9,
            "sourceId": "faec6d3f-9eae-45ca-bf34-b45c9fc6123f",
            "costCents": "7.6840000"
          },
          "rawInputTokens": 27362,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [
                "effective run configuration fingerprint metadata is missing"
              ],
              "nextFingerprint": "v1:sha256:0dbfe70c4e1858bc4ee3a33d77d2b293af0a5b77a0fd5fd33407d8ff0f7ca620",
              "changedCategories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "reuse",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": true,
              "nextFingerprint": "v1:sha256:33959aa0c1bf3f7dcd3735f62eb2f08653c34f7e7f8f5da7279141bf0a214741",
              "workspaceReused": true,
              "activeWorkspaceId": "d6ee872e-8ea3-4f9b-8756-60fc0def84be",
              "changedCategories": [],
              "storedFingerprint": "v1:sha256:33959aa0c1bf3f7dcd3735f62eb2f08653c34f7e7f8f5da7279141bf0a214741",
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": "d6ee872e-8ea3-4f9b-8756-60fc0def84be",
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": true
            }
          },
          "rawOutputTokens": 907,
          "cacheWriteTokens": 0,
          "cachedInputTokens": 130460,
          "pricingProvenance": {
            "source": "rate_card",
            "version": "openai-standard-2026-09-30",
            "evidence": "https://developers.openai.com/api/docs/pricing; standard processing assumed; short per-request context assumed; cache writes reported",
            "contextTier": "short",
            "serviceTier": "standard",
            "inputCentsPerMillion": "200.0000000",
            "outputCentsPerMillion": "1000.0000000",
            "cacheWriteCentsPerMillion": "250.0000000",
            "cachedInputCentsPerMillion": "10.0000000"
          },
          "providerRequestId": null,
          "taskSessionReused": false,
          "persistedSessionId": "01a15f9d-6c8f-7c20-9ef3-22ca8647916a",
          "accountingReceiptId": "f6e546ef-ed49-4282-a126-11b606da2f78",
          "cacheAdjustedCostUsd": null,
          "rawCachedInputTokens": 130460,
          "sessionRotationReason": null,
          "accountingReceiptReady": true,
          "rawInputIncludesCached": false,
          "accountingReceiptSequence": 9,
          "accountingReceiptSourceId": "faec6d3f-9eae-45ca-bf34-b45c9fc6123f",
          "accountingReceiptReceivedAt": "2026-10-21T17:59:09.995Z"
        }
      },
      {
        "runId": "125339ad-b546-4092-bc8c-691a33381960",
        "usage": {
          "model": "gpt-6.1-sol",
          "biller": "openai",
          "costUsd": null,
          "provider": "openai",
          "costStatus": "estimated",
          "billingType": "metered_api",
          "inputTokens": 26306,
          "ledgerScope": {
            "issueId": "d9f17dd5-060d-480f-ab80-a1197806fb51",
            "projectId": "01fb592e-3b88-435a-af35-39d7f0a6ba96",
            "billingCode": null
          },
          "usageSource": "per_run",
          "costUsdExact": "0.068094900",
          "outputTokens": 535,
          "usageByModel": null,
          "budgetDispatch": {
            "admittedAt": "2026-10-21T17:57:53.824Z",
            "handedOffAt": "2026-10-21T17:57:53.856Z",
            "reservationId": "bdd21012-488b-45ac-afa0-c5ce0a87e44a",
            "recoveryLeaseOwner": null
          },
          "budgetExposure": {
            "sequence": 6,
            "sourceId": "6388be6d-a229-42ac-afae-6f4faf61538f",
            "costCents": "6.8094900"
          },
          "cacheWriteTokens": 0,
          "cachedInputTokens": 101329,
          "pricingProvenance": {
            "source": "rate_card",
            "version": "openai-standard-2026-09-30",
            "evidence": "https://developers.openai.com/api/docs/pricing; standard processing assumed; short per-request context assumed; cache writes reported",
            "contextTier": "short",
            "serviceTier": "standard",
            "inputCentsPerMillion": "200.0000000",
            "outputCentsPerMillion": "1000.0000000",
            "cacheWriteCentsPerMillion": "250.0000000",
            "cachedInputCentsPerMillion": "10.0000000"
          },
          "providerRequestId": null,
          "accountingReceiptId": "72c74530-c99b-4314-9491-fa02248ef4f7",
          "cacheAdjustedCostUsd": null,
          "accountingReceiptReady": true,
          "accountingReceiptSequence": 6,
          "accountingReceiptSourceId": "6388be6d-a229-42ac-afae-6f4faf61538f",
          "accountingReceiptReceivedAt": "2026-10-21T17:58:22.853Z"
        }
      }
    ]
  }
}
Claude staging-model diagnosticIsolated localacpx · claude-opus-5-5
Test details5/5 checks · 1m 56s
Overall passed · 5/5 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (5)
ResultCheckDetail
PassfollowupStopResume.active-followup-before-stopOne ordinary user follow-up must persist while the original result-free provider run is still active.
PassfollowupStopResume.stop-remains-authoritativeThe acknowledged Stop must retain one cancelled run with no automatic continuation throughout the recorded quiet window before a real user resumes.
PassfollowupStopResume.one-explicit-resumptionOnly one user-triggered successor may complete the original task after Stop.
PassfollowupStopResume.retained-context-workspace-toolsThe independently seeded context, earlier follow-up, workspace, production instructions and tool contract must survive without being restated in the resume message.
PassfollowupStopResume.accessible-resumed-resultOne receipt-bound final reply must expose the independently verified result without a pending question.
Tokens43,919 in · 3,132 out247,918 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered1m 26s agent
followup-stop-resume.runner-acpx-claude.local.followup-stop-resume
Attempt
1
Duration
1m 56s
Agent runtime
1m 26s
Runtime
native
Provider
acpx
Model
claude-opus-5-5
Issue
RUN-1

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
775832ce-8303-402b-8716-92fc52429d61unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
a541a5db-d425-4250-8477-b25bfc448eb7unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"followupStopResume.active-followup-before-stop","expected":true} One ordinary user follow-up must persist while the original result-free provider run is still active.
Pass json_path {"kind":"json_path","path":"followupStopResume.stop-remains-authoritative","expected":true} The acknowledged Stop must retain one cancelled run with no automatic continuation throughout the recorded quiet window before a real user resumes.
Pass json_path {"kind":"json_path","path":"followupStopResume.one-explicit-resumption","expected":true} Only one user-triggered successor may complete the original task after Stop.
Pass json_path {"kind":"json_path","path":"followupStopResume.retained-context-workspace-tools","expected":true} The independently seeded context, earlier follow-up, workspace, production instructions and tool contract must survive without being restated in the resume message.
Pass json_path {"kind":"json_path","path":"followupStopResume.accessible-resumed-result","expected":true} One receipt-bound final reply must expose the independently verified result without a pending question.
Usage and billing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "inputTokens": 43919,
      "outputTokens": 3132,
      "cachedInputTokens": 247918,
      "totalTokens": 294969,
      "reportedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 86126,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "775832ce-8303-402b-8716-92fc52429d61",
        "usage": {
          "model": "claude-opus-5-5",
          "biller": "anthropic",
          "costUsd": null,
          "provider": "anthropic",
          "costStatus": "estimated",
          "billingType": "metered_api",
          "inputTokens": 14905,
          "ledgerScope": {
            "issueId": "fc5096e3-8e16-4123-b3a7-a7834337a8ec",
            "projectId": "89d0210c-18ca-4f2e-adce-9963b2d2efb9",
            "billingCode": null
          },
          "usageSource": "per_run",
          "costUsdExact": "0.195753600",
          "freshSession": true,
          "outputTokens": 2174,
          "usageByModel": null,
          "sessionReused": false,
          "budgetDispatch": {
            "admittedAt": "2026-10-21T17:58:33.082Z",
            "handedOffAt": "2026-10-21T17:58:33.102Z",
            "reservationId": "f4b597ba-a3bc-4fd4-98a6-9f3058930b13",
            "recoveryLeaseOwner": null
          },
          "budgetExposure": {
            "sequence": 17,
            "sourceId": "b30ef8f4-c8a3-4e0d-8a3a-970343e0322b",
            "costCents": "19.5753600"
          },
          "rawInputTokens": 14905,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [
                "effective run configuration fingerprint metadata is missing"
              ],
              "nextFingerprint": "v1:sha256:d07834e43321ccf1f90a91f7c488c6c7424d5c90dd157eed0f38a84078ccf54d",
              "changedCategories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "reuse",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": true,
              "nextFingerprint": "v1:sha256:cde34825df898b94faa3e483dec063f8af51089f4b0aeb2e59c636434c7792c7",
              "workspaceReused": true,
              "activeWorkspaceId": "9029a229-0831-4957-bc54-ca58aed92964",
              "changedCategories": [],
              "storedFingerprint": "v1:sha256:cde34825df898b94faa3e483dec063f8af51089f4b0aeb2e59c636434c7792c7",
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": "9029a229-0831-4957-bc54-ca58aed92964",
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": true
            }
          },
          "rawOutputTokens": 2174,
          "cacheWriteTokens": 14893,
          "cachedInputTokens": 165408,
          "pricingProvenance": {
            "source": "rate_card",
            "version": "anthropic-standard-2026-10-12",
            "evidence": "https://platform.claude.com/docs/en/about-claude/pricing; standard global API pricing assumed; cache-write TTL unavailable, one-hour upper rate used; not an invoice",
            "serviceTier": "standard",
            "inputCentsPerMillion": "400",
            "outputCentsPerMillion": "2000",
            "cacheWriteCentsPerMillion": "800",
            "cachedInputCentsPerMillion": "20"
          },
          "providerRequestId": null,
          "taskSessionReused": false,
          "persistedSessionId": "87ee3602-a5df-4f60-999a-2e1023935b32",
          "accountingReceiptId": "48ecc4a1-a1bb-4c8c-a642-42d90f53afd3",
          "cacheAdjustedCostUsd": null,
          "rawCachedInputTokens": 165408,
          "sessionRotationReason": null,
          "accountingReceiptReady": true,
          "rawInputIncludesCached": false,
          "accountingReceiptSequence": 17,
          "accountingReceiptSourceId": "b30ef8f4-c8a3-4e0d-8a3a-970343e0322b",
          "accountingReceiptReceivedAt": "2026-10-21T17:59:16.599Z"
        }
      },
      {
        "runId": "a541a5db-d425-4250-8477-b25bfc448eb7",
        "usage": {
          "model": "claude-opus-5-5",
          "biller": "anthropic",
          "costUsd": null,
          "provider": "anthropic",
          "costStatus": "estimated",
          "billingType": "metered_api",
          "inputTokens": 29014,
          "ledgerScope": {
            "issueId": "fc5096e3-8e16-4123-b3a7-a7834337a8ec",
            "projectId": "89d0210c-18ca-4f2e-adce-9963b2d2efb9",
            "billingCode": null
          },
          "usageSource": "per_run",
          "costUsdExact": "0.267742000",
          "outputTokens": 958,
          "usageByModel": null,
          "budgetDispatch": {
            "admittedAt": "2026-10-21T17:57:41.699Z",
            "handedOffAt": "2026-10-21T17:57:41.718Z",
            "reservationId": "b4ecbeb7-43b9-4762-bfb9-38e36f060658",
            "recoveryLeaseOwner": null
          },
          "budgetExposure": {
            "sequence": 13,
            "sourceId": "871ce665-5100-4abf-8944-024f10e5c30a",
            "costCents": "26.7742000"
          },
          "cacheWriteTokens": 29006,
          "cachedInputTokens": 82510,
          "pricingProvenance": {
            "source": "rate_card",
            "version": "anthropic-standard-2026-10-12",
            "evidence": "https://platform.claude.com/docs/en/about-claude/pricing; standard global API pricing assumed; cache-write TTL unavailable, one-hour upper rate used; not an invoice",
            "serviceTier": "standard",
            "inputCentsPerMillion": "400.0000000",
            "outputCentsPerMillion": "2000.0000000",
            "cacheWriteCentsPerMillion": "800.0000000",
            "cachedInputCentsPerMillion": "20.0000000"
          },
          "providerRequestId": null,
          "accountingReceiptId": "3e466651-1616-40d9-a5e7-bbe33ada17aa",
          "cacheAdjustedCostUsd": null,
          "accountingReceiptReady": true,
          "accountingReceiptSequence": 13,
          "accountingReceiptSourceId": "871ce665-5100-4abf-8944-024f10e5c30a",
          "accountingReceiptReceivedAt": "2026-10-21T17:58:22.304Z"
        }
      }
    ]
  }
}