Full-stack acceptance campaign

Runner Full-Stack E2E

Results across runner profiles and execution environments. Declared PNG screenshots and normalized results are retained with every published campaign; additional diagnostic evidence remains in the access-controlled workflow artifact.

2026-10-21T14:11:31.021Zd942a5c8Source run ↗

0/4Passed
4Failed
5m 48sTest time
Campaign usage and spend
146,653Input tokens
9,082Output tokens
1,142,703Cached tokens
UnavailableLLM reported subtotal
$0.000000Daytona list estimate
4m 19sAgent execution time
0msDaytona lease time
0/5Runs provider-priced

Model spend is the provider-reported subtotal; unpriced or unavailable runs are excluded, never counted as free. Daytona runtime is a public-list-price estimate from captured lease time and pinned resources, before credits, discounts, storage allowance, or invoice adjustments. Local execution has no external runtime meter.

All results

Feature coverage 0 of 191 capabilities linked · 0 of 4 tests mapped

Associations use the current feature map. Counts describe linked test scenarios; a passing journey does not establish full coverage of a capability.

Getting started and access

FeatureCapabilities linkedLinked test results
Onboarding and first work 0/5 No mapped journey
Login, invitations, and access 0/5 No mapped journey
Companies and portability 0/8 No mapped journey

Tasks and conversations

FeatureCapabilities linkedLinked test results
Task creation and lifecycle 0/6 No mapped journey
Delegation, dependencies, and signoff 0/4 No mapped journey
Inbox, decisions, and search 0/5 No mapped journey
Agent conversations and project handoff 0/4 No mapped journey
Questions and approvals 0/8 No mapped journey
Steering and queued messages 0/7 No mapped journey
Documents, attachments, and work products 0/5 No mapped journey

Agents and reusable capabilities

FeatureCapabilities linkedLinked test results
Hiring, configuration, and organization 0/9 No mapped journey
Runs, harnesses, and model accounts 0/4 No mapped journey
Skills and Skill Studio 0/5 No mapped journey
Team packages and installation 0/4 No mapped journey

Projects and execution

FeatureCapabilities linkedLinked test results
Projects and repositories 0/5 No mapped journey
Goals and work alignment 0/3 No mapped journey
Workspaces, services, and files 0/5 No mapped journey
Execution environments 0/5 No mapped journey
Recovery 0/8 No mapped journey

Apps, channels, and extensions

FeatureCapabilities linkedLinked test results
Connection setup 0/8 No mapped journey
Assistant connections (MCP) 0/5 No mapped journey
App access and action permissions 0/5 No mapped journey
External chat and email 0/6 No mapped journey
Tool gateways and access profiles 0/5 No mapped journey
Secrets and proposals 0/5 No mapped journey
Plugins 0/4 No mapped journey

Automation and structured work

FeatureCapabilities linkedLinked test results
Routines, schedules, and triggers 0/5 No mapped journey
Cases 0/5 No mapped journey
Status cards 0/4 No mapped journey

Oversight and operation

FeatureCapabilities linkedLinked test results
Costs and budgets 0/6 No mapped journey
Dashboards and audit trails 0/6 No mapped journey
Navigation, profile, and announcements 0/6 No mapped journey
Instance operations 0/6 No mapped journey
CLI/API and local worktrees 0/6 No mapped journey

Contributor surfaces

FeatureCapabilities linkedLinked test results
Developer previews and diagnostic labs 0/4 No mapped journey

Test suite

configured-repository

Suite discovered from retained campaign identities; full suite size is not known to this publisher.

Pass rate0.0%0/1 passed
Tokens125,74725,803 input · 882 output
Known spendUnavailablereported LLM + runtime estimate
Agent time38s0ms lease
Execution1/10 retries · cleanup passed
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · 6/6 behavioral checks passed

No behavioral matcher failed. The overall failure came from a separate run, cleanup, or evidence check.

See all behavioral checks (6)
ResultCheckDetail
PassrepositoryVerification.production-conversionConversion must start with a real legacy agent and use its production runner transition.
PassrepositoryVerification.retained-configurationConfigured model, source directory, secret references, timeout, runtime settings, environment, instructions, and equivalent permissions must survive.
PassrepositoryVerification.actual-native-runtimeOne actual native admission on the configured provider and model must commit the task result.
PassrepositoryVerification.retained-repositoryThe independently seeded source reference must survive byte for byte in the configured checkout.
PassrepositoryVerification.independent-resultDownloaded bytes must agree with the independent source-file and Git baseline.
PassrepositoryVerification.accessible-deliveryThe originating task must render the downloadable result with no unanswered interaction.

permanent infrastructure

Required evidence missing: snapshots/api-state.json
Test details6/6 checks · 56s
Tokens25,803 in · 882 out99,062 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered38s agent
configured-repository.runner-codex.local.repository-output
Attempt
1
Duration
56s
Agent runtime
38s
Runtime
native
Provider
codex
Model
gpt-6.1-sol
Issue
RUN-1

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
2f1b2087-d206-4437-bfc5-f90f667636d3unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"repositoryVerification.production-conversion","expected":true} Conversion must start with a real legacy agent and use its production runner transition.
Pass json_path {"kind":"json_path","path":"repositoryVerification.retained-configuration","expected":true} Configured model, source directory, secret references, timeout, runtime settings, environment, instructions, and equivalent permissions must survive.
Pass json_path {"kind":"json_path","path":"repositoryVerification.actual-native-runtime","expected":true} One actual native admission on the configured provider and model must commit the task result.
Pass json_path {"kind":"json_path","path":"repositoryVerification.retained-repository","expected":true} The independently seeded source reference must survive byte for byte in the configured checkout.
Pass json_path {"kind":"json_path","path":"repositoryVerification.independent-result","expected":true} Downloaded bytes must agree with the independent source-file and Git baseline.
Pass json_path {"kind":"json_path","path":"repositoryVerification.accessible-delivery","expected":true} The originating task must render the downloadable result with no unanswered interaction.
Usage and billing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "inputTokens": 25803,
      "outputTokens": 882,
      "cachedInputTokens": 99062,
      "totalTokens": 125747,
      "reportedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 37988,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "model": "gpt-6.1-sol",
    "biller": "openai",
    "costUsd": null,
    "provider": "openai",
    "costStatus": "estimated",
    "billingType": "metered_api",
    "inputTokens": 25803,
    "ledgerScope": {
      "issueId": "50db80cd-e560-493f-860b-de2a6b04e7ed",
      "projectId": "3c3f3f90-92d5-4f25-8d27-d2bbd4000573",
      "billingCode": null
    },
    "usageSource": "per_run",
    "costUsdExact": "0.070332200",
    "freshSession": true,
    "outputTokens": 882,
    "usageByModel": null,
    "sessionReused": false,
    "rawInputTokens": 25803,
    "sessionRotated": false,
    "configFreshness": {
      "session": {
        "reset": true,
        "categories": [
          "adapter",
          "adapterConfig",
          "agentRuntimeConfig",
          "instructions",
          "issueOverrides",
          "workspaceConfig",
          "environment",
          "envBindings",
          "secrets",
          "runtimeSkills"
        ],
        "resetReasons": [],
        "nextFingerprint": "v1:sha256:93d914ba5e5b721993be309ba62a1b2f34db37a150aec7b799ab69413e95f2e2",
        "changedCategories": [],
        "taskSessionReused": false,
        "fingerprintVersion": 1,
        "taskSessionAvailable": false,
        "storedFingerprintPresent": false
      },
      "version": 1,
      "workspace": {
        "action": "create",
        "reasons": [],
        "categories": [
          "mode",
          "projectWorkspace",
          "strategy",
          "repo",
          "lifecycleCommands",
          "runtimeServices",
          "environment",
          "realization"
        ],
        "reuseRequested": false,
        "nextFingerprint": "v1:sha256:754d8b60da16936dc46df4b52b6e22534388e573cb51a545e212f1b921ca02f1",
        "workspaceReused": false,
        "activeWorkspaceId": "1e8035da-86af-4690-a1a9-e03bff3edc6f",
        "changedCategories": [],
        "storedFingerprint": null,
        "fingerprintVersion": 1,
        "inferredFingerprint": null,
        "previousWorkspaceId": null,
        "configSnapshotRefreshed": false,
        "storedFingerprintPresent": false
      }
    },
    "rawOutputTokens": 882,
    "cacheWriteTokens": 0,
    "cachedInputTokens": 99062,
    "pricingProvenance": {
      "source": "rate_card",
      "version": "openai-standard-2026-09-30",
      "evidence": "https://developers.openai.com/api/docs/pricing; standard processing assumed; short per-request context assumed; cache writes reported",
      "contextTier": "short",
      "serviceTier": "standard",
      "inputCentsPerMillion": "200.0000000",
      "outputCentsPerMillion": "1000.0000000",
      "cacheWriteCentsPerMillion": "250.0000000",
      "cachedInputCentsPerMillion": "10.0000000"
    },
    "providerRequestId": null,
    "taskSessionReused": false,
    "persistedSessionId": "01a15ec6-0086-7673-9dca-8bb411df6fd1",
    "accountingReceiptId": "30618e80-fa00-44c4-a2b4-3b7606d8a027",
    "cacheAdjustedCostUsd": null,
    "rawCachedInputTokens": 99062,
    "sessionRotationReason": null,
    "accountingReceiptReady": true,
    "rawInputIncludesCached": false,
    "accountingReceiptSequence": 8,
    "accountingReceiptSourceId": "222f3bac-954b-4566-98a4-70a50f6b2e5b",
    "accountingReceiptReceivedAt": "2026-10-21T14:03:49.165Z"
  }
}

Test suite

legacy-conversion

Suite discovered from retained campaign identities; full suite size is not known to this publisher.

Pass rate0.0%0/2 passed
Tokens332,08157,702 input · 3,540 output
Known spendUnavailablereported LLM + runtime estimate
Agent time1m 34s0ms lease
Execution2/20 retries · cleanup passed
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · 6/6 behavioral checks passed

No behavioral matcher failed. The overall failure came from a separate run, cleanup, or evidence check.

See all behavioral checks (6)
ResultCheckDetail
PassrepositoryVerification.production-conversionConversion must start with a real legacy agent and use its production runner transition.
PassrepositoryVerification.retained-configurationConfigured model, source directory, secret references, timeout, runtime settings, environment, instructions, and equivalent permissions must survive.
PassrepositoryVerification.actual-native-runtimeOne actual native admission on the configured provider and model must commit the task result.
PassrepositoryVerification.retained-repositoryThe independently seeded source reference must survive byte for byte in the configured checkout.
PassrepositoryVerification.independent-resultDownloaded bytes must agree with the independent source-file and Git baseline.
PassrepositoryVerification.accessible-deliveryThe originating task must render the downloadable result with no unanswered interaction.

permanent infrastructure

Required evidence missing: snapshots/api-state.json
Test details6/6 checks · 1m 5s
Tokens25,797 in · 864 out98,953 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered45s agent
legacy-conversion.runner-codex.local.convert-and-deliver
Attempt
1
Duration
1m 5s
Agent runtime
45s
Runtime
native
Provider
codex
Model
gpt-6.1-sol
Issue
RUN-1

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
6e4c3054-cf34-4d1a-b395-a7429271b166unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"repositoryVerification.production-conversion","expected":true} Conversion must start with a real legacy agent and use its production runner transition.
Pass json_path {"kind":"json_path","path":"repositoryVerification.retained-configuration","expected":true} Configured model, source directory, secret references, timeout, runtime settings, environment, instructions, and equivalent permissions must survive.
Pass json_path {"kind":"json_path","path":"repositoryVerification.actual-native-runtime","expected":true} One actual native admission on the configured provider and model must commit the task result.
Pass json_path {"kind":"json_path","path":"repositoryVerification.retained-repository","expected":true} The independently seeded source reference must survive byte for byte in the configured checkout.
Pass json_path {"kind":"json_path","path":"repositoryVerification.independent-result","expected":true} Downloaded bytes must agree with the independent source-file and Git baseline.
Pass json_path {"kind":"json_path","path":"repositoryVerification.accessible-delivery","expected":true} The originating task must render the downloadable result with no unanswered interaction.
Usage and billing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "inputTokens": 25797,
      "outputTokens": 864,
      "cachedInputTokens": 98953,
      "totalTokens": 125614,
      "reportedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 44784,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "model": "gpt-6.1-sol",
    "biller": "openai",
    "costUsd": null,
    "provider": "openai",
    "costStatus": "estimated",
    "billingType": "metered_api",
    "inputTokens": 25797,
    "ledgerScope": {
      "issueId": "d8d0a75c-dfd8-4a33-9953-c0edc81fb4c0",
      "projectId": "af46fdd2-f042-4cdc-b062-84b6c8b318b4",
      "billingCode": null
    },
    "usageSource": "per_run",
    "costUsdExact": "0.070129300",
    "freshSession": true,
    "outputTokens": 864,
    "usageByModel": null,
    "sessionReused": false,
    "rawInputTokens": 25797,
    "sessionRotated": false,
    "configFreshness": {
      "session": {
        "reset": true,
        "categories": [
          "adapter",
          "adapterConfig",
          "agentRuntimeConfig",
          "instructions",
          "issueOverrides",
          "workspaceConfig",
          "environment",
          "envBindings",
          "secrets",
          "runtimeSkills"
        ],
        "resetReasons": [],
        "nextFingerprint": "v1:sha256:4356fec4cd2eae8f5419b38450117f69acae7e00353a671e9fa6f6f7d65a1fd1",
        "changedCategories": [],
        "taskSessionReused": false,
        "fingerprintVersion": 1,
        "taskSessionAvailable": false,
        "storedFingerprintPresent": false
      },
      "version": 1,
      "workspace": {
        "action": "create",
        "reasons": [],
        "categories": [
          "mode",
          "projectWorkspace",
          "strategy",
          "repo",
          "lifecycleCommands",
          "runtimeServices",
          "environment",
          "realization"
        ],
        "reuseRequested": false,
        "nextFingerprint": "v1:sha256:657b4401f185cb233a95e4e57d4c4a88e403cd67f3bcf9ee78d22d0049e8491e",
        "workspaceReused": false,
        "activeWorkspaceId": "acffac3b-cc5e-48a9-ac1b-99f49486dd13",
        "changedCategories": [],
        "storedFingerprint": null,
        "fingerprintVersion": 1,
        "inferredFingerprint": null,
        "previousWorkspaceId": null,
        "configSnapshotRefreshed": false,
        "storedFingerprintPresent": false
      }
    },
    "rawOutputTokens": 864,
    "cacheWriteTokens": 0,
    "cachedInputTokens": 98953,
    "pricingProvenance": {
      "source": "rate_card",
      "version": "openai-standard-2026-09-30",
      "evidence": "https://developers.openai.com/api/docs/pricing; standard processing assumed; short per-request context assumed; cache writes reported",
      "contextTier": "short",
      "serviceTier": "standard",
      "inputCentsPerMillion": "200.0000000",
      "outputCentsPerMillion": "1000.0000000",
      "cacheWriteCentsPerMillion": "250.0000000",
      "cachedInputCentsPerMillion": "10.0000000"
    },
    "providerRequestId": null,
    "taskSessionReused": false,
    "persistedSessionId": "01a15ecb-68bd-7da3-a75b-6557ab16f3df",
    "accountingReceiptId": "7b296a5c-cbf2-4421-a9ed-536bfc0a1533",
    "cacheAdjustedCostUsd": null,
    "rawCachedInputTokens": 98953,
    "sessionRotationReason": null,
    "accountingReceiptReady": true,
    "rawInputIncludesCached": false,
    "accountingReceiptSequence": 8,
    "accountingReceiptSourceId": "ed543332-1af1-4692-b839-908ec7e3631d",
    "accountingReceiptReceivedAt": "2026-10-21T14:09:49.829Z"
  }
}
Runner ACPX ClaudeIsolated localacpx · claude-sonnet-5
Overall failed · 6/6 behavioral checks passed

No behavioral matcher failed. The overall failure came from a separate run, cleanup, or evidence check.

See all behavioral checks (6)
ResultCheckDetail
PassrepositoryVerification.production-conversionConversion must start with a real legacy agent and use its production runner transition.
PassrepositoryVerification.retained-configurationConfigured model, source directory, secret references, timeout, runtime settings, environment, instructions, and equivalent permissions must survive.
PassrepositoryVerification.actual-native-runtimeOne actual native admission on the configured provider and model must commit the task result.
PassrepositoryVerification.retained-repositoryThe independently seeded source reference must survive byte for byte in the configured checkout.
PassrepositoryVerification.independent-resultDownloaded bytes must agree with the independent source-file and Git baseline.
PassrepositoryVerification.accessible-deliveryThe originating task must render the downloadable result with no unanswered interaction.

permanent infrastructure

Required evidence missing: snapshots/api-state.json
Test details6/6 checks · 1m 4s
Tokens31,905 in · 2,676 out171,886 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered49s agent
legacy-conversion.runner-acpx-claude.local.convert-and-deliver
Attempt
1
Duration
1m 4s
Agent runtime
49s
Runtime
native
Provider
acpx
Model
claude-opus-5-5
Issue
RUN-1

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
448da8ca-dce8-4171-a657-eb86f6991af8unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"repositoryVerification.production-conversion","expected":true} Conversion must start with a real legacy agent and use its production runner transition.
Pass json_path {"kind":"json_path","path":"repositoryVerification.retained-configuration","expected":true} Configured model, source directory, secret references, timeout, runtime settings, environment, instructions, and equivalent permissions must survive.
Pass json_path {"kind":"json_path","path":"repositoryVerification.actual-native-runtime","expected":true} One actual native admission on the configured provider and model must commit the task result.
Pass json_path {"kind":"json_path","path":"repositoryVerification.retained-repository","expected":true} The independently seeded source reference must survive byte for byte in the configured checkout.
Pass json_path {"kind":"json_path","path":"repositoryVerification.independent-result","expected":true} Downloaded bytes must agree with the independent source-file and Git baseline.
Pass json_path {"kind":"json_path","path":"repositoryVerification.accessible-delivery","expected":true} The originating task must render the downloadable result with no unanswered interaction.
Usage and billing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "inputTokens": 31905,
      "outputTokens": 2676,
      "cachedInputTokens": 171886,
      "totalTokens": 206467,
      "reportedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 49024,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "model": "claude-opus-5-5",
    "biller": "anthropic",
    "costUsd": null,
    "provider": "anthropic",
    "costStatus": "estimated",
    "billingType": "metered_api",
    "inputTokens": 31905,
    "ledgerScope": {
      "issueId": "13ff6a65-baa7-43ab-920a-553e7bfd4725",
      "projectId": "17161b44-dd81-4b77-ad13-e33054046bd2",
      "billingCode": null
    },
    "usageSource": "per_run",
    "costUsdExact": "0.343081200",
    "freshSession": true,
    "outputTokens": 2676,
    "usageByModel": null,
    "sessionReused": false,
    "rawInputTokens": 31905,
    "sessionRotated": false,
    "configFreshness": {
      "session": {
        "reset": true,
        "categories": [
          "adapter",
          "adapterConfig",
          "agentRuntimeConfig",
          "instructions",
          "issueOverrides",
          "workspaceConfig",
          "environment",
          "envBindings",
          "secrets",
          "runtimeSkills"
        ],
        "resetReasons": [],
        "nextFingerprint": "v1:sha256:741e5d7cb38c33c15f365a53bff518b5b4d3667248d626e794a2546c28ae5773",
        "changedCategories": [],
        "taskSessionReused": false,
        "fingerprintVersion": 1,
        "taskSessionAvailable": false,
        "storedFingerprintPresent": false
      },
      "version": 1,
      "workspace": {
        "action": "create",
        "reasons": [],
        "categories": [
          "mode",
          "projectWorkspace",
          "strategy",
          "repo",
          "lifecycleCommands",
          "runtimeServices",
          "environment",
          "realization"
        ],
        "reuseRequested": false,
        "nextFingerprint": "v1:sha256:e6158bcc69a0d7d21ba55b38a1929c7a8dddf0eaa3982e572a19dd6beff6e89a",
        "workspaceReused": false,
        "activeWorkspaceId": "f0594411-528f-4465-a0e8-725f928bf291",
        "changedCategories": [],
        "storedFingerprint": null,
        "fingerprintVersion": 1,
        "inferredFingerprint": null,
        "previousWorkspaceId": null,
        "configSnapshotRefreshed": false,
        "storedFingerprintPresent": false
      }
    },
    "rawOutputTokens": 2676,
    "cacheWriteTokens": 31891,
    "cachedInputTokens": 171886,
    "pricingProvenance": {
      "source": "rate_card",
      "version": "anthropic-standard-2026-10-12",
      "evidence": "https://platform.claude.com/docs/en/about-claude/pricing; standard global API pricing assumed; cache-write TTL unavailable, one-hour upper rate used; not an invoice",
      "serviceTier": "standard",
      "inputCentsPerMillion": "400",
      "outputCentsPerMillion": "2000",
      "cacheWriteCentsPerMillion": "800",
      "cachedInputCentsPerMillion": "20"
    },
    "providerRequestId": null,
    "taskSessionReused": false,
    "persistedSessionId": "afc4a339-881a-48e1-99a5-0b61980911de",
    "accountingReceiptId": "e809baf5-71ce-4038-8e3e-48b37f8a9934",
    "cacheAdjustedCostUsd": null,
    "rawCachedInputTokens": 171886,
    "sessionRotationReason": null,
    "accountingReceiptReady": true,
    "rawInputIncludesCached": false,
    "accountingReceiptSequence": 19,
    "accountingReceiptSourceId": "807ad5e9-2ac9-492a-bb04-39397f48eb90",
    "accountingReceiptReceivedAt": "2026-10-21T14:07:25.541Z"
  }
}

Test suite

automatic-repository-configured-models

Suite discovered from retained campaign identities; full suite size is not known to this publisher.

Pass rate0.0%0/1 passed
Tokens840,61063,148 input · 4,660 output
Known spendUnavailablereported LLM + runtime estimate
Agent time2m 8s0ms lease
Execution1/10 retries · cleanup passed
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · 5/6 behavioral checks passed

Failed checks:

  • automaticRepository.server-owned-continuation — Repository setup must continue through the saved same-agent wake without a timer or user message.
See all behavioral checks (6)
ResultCheckDetail
PassautomaticRepository.durable-completionTwo committed provider admissions must finish the requested result.
FailautomaticRepository.server-owned-continuationRepository setup must continue through the saved same-agent wake without a timer or user message.
PassautomaticRepository.retained-workspaceBoth admissions must retain the same task workspace and its prepared repository.
PassautomaticRepository.retained-contextThe first admission's independently downloaded unpredictable reference must survive setup byte for byte.
PassautomaticRepository.independent-resultDownloaded result bytes must agree with the independently inspected checkout and original reference.
PassautomaticRepository.accessible-deliveryThe originating task must render its result link without an unanswered question.

candidate failure

Automatic repository oracle failure: server-owned-continuation
Test details5/6 checks · 2m 42s
Tokens63,148 in · 4,660 out772,802 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered2m 8s agent
automatic-repository-configured-models.runner-codex.local.automatic-repository-resume
Attempt
1
Duration
2m 42s
Agent runtime
2m 8s
Runtime
native
Provider
codex
Model
gpt-6.1-sol
Issue
RUN-1

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
251eab7c-7c07-44b8-a194-a3fa793a197bunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ca242378-92f4-40b3-a0fa-f0decb2ce33aunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"automaticRepository.durable-completion","expected":true} Two committed provider admissions must finish the requested result.
Fail json_path {"kind":"json_path","path":"automaticRepository.server-owned-continuation","expected":true} Repository setup must continue through the saved same-agent wake without a timer or user message.
Pass json_path {"kind":"json_path","path":"automaticRepository.retained-workspace","expected":true} Both admissions must retain the same task workspace and its prepared repository.
Pass json_path {"kind":"json_path","path":"automaticRepository.retained-context","expected":true} The first admission's independently downloaded unpredictable reference must survive setup byte for byte.
Pass json_path {"kind":"json_path","path":"automaticRepository.independent-result","expected":true} Downloaded result bytes must agree with the independently inspected checkout and original reference.
Pass json_path {"kind":"json_path","path":"automaticRepository.accessible-delivery","expected":true} The originating task must render its result link without an unanswered question.
Usage and billing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "inputTokens": 63148,
      "outputTokens": 4660,
      "cachedInputTokens": 772802,
      "totalTokens": 840610,
      "reportedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 127675,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "251eab7c-7c07-44b8-a194-a3fa793a197b",
        "usage": {
          "model": "gpt-6.1-sol",
          "biller": "openai",
          "costUsd": null,
          "provider": "openai",
          "costStatus": "estimated",
          "billingType": "metered_api",
          "inputTokens": 35098,
          "ledgerScope": {
            "issueId": "b0050db1-03c5-4461-9181-9af3802c7896",
            "projectId": null,
            "billingCode": null
          },
          "usageSource": "per_run",
          "costUsdExact": "0.149422600",
          "freshSession": false,
          "outputTokens": 3079,
          "usageByModel": null,
          "sessionReused": true,
          "rawInputTokens": 35098,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": false,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:274b66c3c2e7122df0f6da9bec378738ae05ae825b6f6e31b50cd7a524e6cdc8",
              "changedCategories": [],
              "taskSessionReused": true,
              "fingerprintVersion": 1,
              "taskSessionAvailable": true,
              "storedFingerprintPresent": true
            },
            "version": 1,
            "workspace": {
              "action": "reuse",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": true,
              "nextFingerprint": "v1:sha256:16c36c9d5c8d82012658a21f14efa222c759e897680162c2c71ec669eb500472",
              "workspaceReused": true,
              "activeWorkspaceId": "e56cb48c-09f7-4a1c-8f73-75519dd6be43",
              "changedCategories": [],
              "storedFingerprint": "v1:sha256:16c36c9d5c8d82012658a21f14efa222c759e897680162c2c71ec669eb500472",
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": "e56cb48c-09f7-4a1c-8f73-75519dd6be43",
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": true
            }
          },
          "rawOutputTokens": 3079,
          "cacheWriteTokens": 0,
          "cachedInputTokens": 484366,
          "pricingProvenance": {
            "source": "rate_card",
            "version": "openai-standard-2026-09-30",
            "evidence": "https://developers.openai.com/api/docs/pricing; standard processing assumed; short per-request context assumed; cache writes reported",
            "contextTier": "short",
            "serviceTier": "standard",
            "inputCentsPerMillion": "200.0000000",
            "outputCentsPerMillion": "1000.0000000",
            "cacheWriteCentsPerMillion": "250.0000000",
            "cachedInputCentsPerMillion": "10.0000000"
          },
          "providerRequestId": null,
          "taskSessionReused": true,
          "persistedSessionId": "01a15ec6-0235-7342-bc0a-0850a4ee0e4d",
          "accountingReceiptId": "844e5ce6-ec10-40eb-9c2b-c2c0067443ea",
          "cacheAdjustedCostUsd": null,
          "rawCachedInputTokens": 484366,
          "sessionRotationReason": null,
          "accountingReceiptReady": true,
          "rawInputIncludesCached": false,
          "accountingReceiptSequence": 9,
          "accountingReceiptSourceId": "0f8856b8-c221-4d91-a276-db2d4f03def2",
          "accountingReceiptReceivedAt": "2026-10-21T14:05:37.542Z"
        }
      },
      {
        "runId": "ca242378-92f4-40b3-a0fa-f0decb2ce33a",
        "usage": {
          "model": "gpt-6.1-sol",
          "biller": "openai",
          "costUsd": null,
          "provider": "openai",
          "costStatus": "estimated",
          "billingType": "metered_api",
          "inputTokens": 28050,
          "ledgerScope": {
            "issueId": "b0050db1-03c5-4461-9181-9af3802c7896",
            "projectId": null,
            "billingCode": null
          },
          "usageSource": "per_run",
          "costUsdExact": "0.100753600",
          "freshSession": true,
          "outputTokens": 1581,
          "usageByModel": null,
          "sessionReused": false,
          "rawInputTokens": 28050,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:274b66c3c2e7122df0f6da9bec378738ae05ae825b6f6e31b50cd7a524e6cdc8",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:16c36c9d5c8d82012658a21f14efa222c759e897680162c2c71ec669eb500472",
              "workspaceReused": false,
              "activeWorkspaceId": "e56cb48c-09f7-4a1c-8f73-75519dd6be43",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1581,
          "cacheWriteTokens": 0,
          "cachedInputTokens": 288436,
          "pricingProvenance": {
            "source": "rate_card",
            "version": "openai-standard-2026-09-30",
            "evidence": "https://developers.openai.com/api/docs/pricing; standard processing assumed; short per-request context assumed; cache writes reported",
            "contextTier": "short",
            "serviceTier": "standard",
            "inputCentsPerMillion": "200.0000000",
            "outputCentsPerMillion": "1000.0000000",
            "cacheWriteCentsPerMillion": "250.0000000",
            "cachedInputCentsPerMillion": "10.0000000"
          },
          "providerRequestId": null,
          "taskSessionReused": false,
          "persistedSessionId": "01a15ec6-0235-7342-bc0a-0850a4ee0e4d",
          "accountingReceiptId": "5089d85e-705f-490c-88b7-52838cd884b5",
          "cacheAdjustedCostUsd": null,
          "rawCachedInputTokens": 288436,
          "sessionRotationReason": null,
          "accountingReceiptReady": true,
          "rawInputIncludesCached": false,
          "accountingReceiptSequence": 15,
          "accountingReceiptSourceId": "a6e68372-2f99-479f-be2c-40ccba674e29",
          "accountingReceiptReceivedAt": "2026-10-21T14:04:23.985Z"
        }
      }
    ]
  }
}