Full-stack acceptance campaign

Runner Full-Stack E2E

Results across runner profiles and execution environments. Declared PNG screenshots and normalized results are retained with every published campaign; additional diagnostic evidence remains in the access-controlled workflow artifact.

2026-10-21T12:28:40.572Z507bd45aSource run ↗

0/1Passed
1Failed
2m 13sTest time
Campaign usage and spend
29,357 (partial: 1/2 runs)Input tokens
4,086 (partial: 1/2 runs)Output tokens
310,895 (partial: 1/2 runs)Cached tokens
UnavailableLLM reported subtotal
$0.000000Daytona list estimate
1m 24sAgent execution time
0msDaytona lease time
0/2Runs provider-priced

Model spend is the provider-reported subtotal; unpriced or unavailable runs are excluded, never counted as free. Daytona runtime is a public-list-price estimate from captured lease time and pinned resources, before credits, discounts, storage allowance, or invoice adjustments. Local execution has no external runtime meter.

All results

Feature coverage 0 of 191 capabilities linked · 0 of 1 tests mapped

Associations use the current feature map. Counts describe linked test scenarios; a passing journey does not establish full coverage of a capability.

Getting started and access

FeatureCapabilities linkedLinked test results
Onboarding and first work 0/5 No mapped journey
Login, invitations, and access 0/5 No mapped journey
Companies and portability 0/8 No mapped journey

Tasks and conversations

FeatureCapabilities linkedLinked test results
Task creation and lifecycle 0/6 No mapped journey
Delegation, dependencies, and signoff 0/4 No mapped journey
Inbox, decisions, and search 0/5 No mapped journey
Agent conversations and project handoff 0/4 No mapped journey
Questions and approvals 0/8 No mapped journey
Steering and queued messages 0/7 No mapped journey
Documents, attachments, and work products 0/5 No mapped journey

Agents and reusable capabilities

FeatureCapabilities linkedLinked test results
Hiring, configuration, and organization 0/9 No mapped journey
Runs, harnesses, and model accounts 0/4 No mapped journey
Skills and Skill Studio 0/5 No mapped journey
Team packages and installation 0/4 No mapped journey

Projects and execution

FeatureCapabilities linkedLinked test results
Projects and repositories 0/5 No mapped journey
Goals and work alignment 0/3 No mapped journey
Workspaces, services, and files 0/5 No mapped journey
Execution environments 0/5 No mapped journey
Recovery 0/8 No mapped journey

Apps, channels, and extensions

FeatureCapabilities linkedLinked test results
Connection setup 0/8 No mapped journey
Assistant connections (MCP) 0/5 No mapped journey
App access and action permissions 0/5 No mapped journey
External chat and email 0/6 No mapped journey
Tool gateways and access profiles 0/5 No mapped journey
Secrets and proposals 0/5 No mapped journey
Plugins 0/4 No mapped journey

Automation and structured work

FeatureCapabilities linkedLinked test results
Routines, schedules, and triggers 0/5 No mapped journey
Cases 0/5 No mapped journey
Status cards 0/4 No mapped journey

Oversight and operation

FeatureCapabilities linkedLinked test results
Costs and budgets 0/6 No mapped journey
Dashboards and audit trails 0/6 No mapped journey
Navigation, profile, and announcements 0/6 No mapped journey
Instance operations 0/6 No mapped journey
CLI/API and local worktrees 0/6 No mapped journey

Contributor surfaces

FeatureCapabilities linkedLinked test results
Developer previews and diagnostic labs 0/4 No mapped journey

Test suite

automatic-repository

Suite discovered from retained campaign identities; full suite size is not known to this publisher.

Pass rate0.0%0/1 passed
Tokens344,338 (partial: 1/2 runs)29,357 (partial: 1/2 runs) input · 4,086 (partial: 1/2 runs) output
Known spendUnavailablereported LLM + runtime estimate
Agent time1m 24s0ms lease
Execution1/10 retries · cleanup passed
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · 0/6 behavioral checks passed

Failed checks:

  • automaticRepository.durable-completion — Two committed provider admissions must finish the requested result.
  • automaticRepository.server-owned-continuation — Repository setup must continue through the saved same-agent wake without a timer or user message.
  • automaticRepository.retained-workspace — Both admissions must retain the same task workspace and its prepared repository.
  • automaticRepository.retained-context — The first admission's independently downloaded unpredictable reference must survive setup byte for byte.
  • automaticRepository.independent-result — Downloaded result bytes must agree with the independently inspected checkout and original reference.
  • automaticRepository.accessible-delivery — The originating task must render its result link without an unanswered question.
See all behavioral checks (6)
ResultCheckDetail
FailautomaticRepository.durable-completionTwo committed provider admissions must finish the requested result.
FailautomaticRepository.server-owned-continuationRepository setup must continue through the saved same-agent wake without a timer or user message.
FailautomaticRepository.retained-workspaceBoth admissions must retain the same task workspace and its prepared repository.
FailautomaticRepository.retained-contextThe first admission's independently downloaded unpredictable reference must survive setup byte for byte.
FailautomaticRepository.independent-resultDownloaded result bytes must agree with the independently inspected checkout and original reference.
FailautomaticRepository.accessible-deliveryThe originating task must render its result link without an unanswered question.

transient infrastructure

Stopped waiting for repository setup and automatic result delivery: A provider admission failed
Test details0/6 checks · 2m 13s
Tokens29,357 (partial: 1/2 runs) in · 4,086 (partial: 1/2 runs) out310,895 (partial: 1/2 runs) cached · 1/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered1m 24s agent
automatic-repository.runner-codex.local.automatic-repository-resume
Attempt
1
Duration
2m 13s
Agent runtime
1m 24s
Runtime
native
Provider
codex
Model
gpt-5.6-sol
Issue
RUN-1

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
966320fa-f72b-4e9a-a56f-dc77411429aaunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
64caa558-dcb3-4d71-83be-ea65f11c91f0unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Fail json_path {"kind":"json_path","path":"automaticRepository.durable-completion","expected":true} Two committed provider admissions must finish the requested result.
Fail json_path {"kind":"json_path","path":"automaticRepository.server-owned-continuation","expected":true} Repository setup must continue through the saved same-agent wake without a timer or user message.
Fail json_path {"kind":"json_path","path":"automaticRepository.retained-workspace","expected":true} Both admissions must retain the same task workspace and its prepared repository.
Fail json_path {"kind":"json_path","path":"automaticRepository.retained-context","expected":true} The first admission's independently downloaded unpredictable reference must survive setup byte for byte.
Fail json_path {"kind":"json_path","path":"automaticRepository.independent-result","expected":true} Downloaded result bytes must agree with the independently inspected checkout and original reference.
Fail json_path {"kind":"json_path","path":"automaticRepository.accessible-delivery","expected":true} The originating task must render its result link without an unanswered question.
Usage and billing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "inputTokens": 29357,
      "outputTokens": 4086,
      "cachedInputTokens": 310895,
      "totalTokens": 344338,
      "reportedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 83652,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "966320fa-f72b-4e9a-a56f-dc77411429aa",
        "usage": {
          "ledgerScope": {
            "issueId": "18266039-42fb-4d18-be91-b7afd10c7a8e",
            "projectId": null,
            "billingCode": null
          }
        }
      },
      {
        "runId": "64caa558-dcb3-4d71-83be-ea65f11c91f0",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": null,
          "provider": "openai",
          "costStatus": "estimated",
          "billingType": "metered_api",
          "inputTokens": 29357,
          "ledgerScope": {
            "issueId": "18266039-42fb-4d18-be91-b7afd10c7a8e",
            "projectId": null,
            "billingCode": null
          },
          "usageSource": "per_run",
          "costUsdExact": "0.323506000",
          "freshSession": true,
          "outputTokens": 4086,
          "usageByModel": null,
          "sessionReused": false,
          "rawInputTokens": 29357,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:a1ac6a4dc6299ce1a9a0a37a01b11536ff4bf1f22f7a420feca11c1cd4d0e7e0",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:32b0a5649b40706544482bcf16a7f271e051ee9a088d3f54a9aa985c4d96ca9b",
              "workspaceReused": false,
              "activeWorkspaceId": "015580ec-30ff-4673-a06c-011efa73779a",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 4086,
          "cacheWriteTokens": 0,
          "cachedInputTokens": 310895,
          "pricingProvenance": {
            "source": "rate_card",
            "version": "openai-standard-2026-09-30",
            "evidence": "https://developers.openai.com/api/docs/pricing; standard processing assumed; short per-request context assumed; cache writes reported",
            "contextTier": "short",
            "serviceTier": "standard",
            "inputCentsPerMillion": "400.0000000",
            "outputCentsPerMillion": "2000.0000000",
            "cacheWriteCentsPerMillion": "500.0000000",
            "cachedInputCentsPerMillion": "40.0000000"
          },
          "providerRequestId": null,
          "taskSessionReused": false,
          "persistedSessionId": "01a15e6c-29a6-7b52-8367-6d46daf13dbf",
          "accountingReceiptId": "40d8967b-dd0d-45b7-8795-fe7ff761198d",
          "cacheAdjustedCostUsd": null,
          "rawCachedInputTokens": 310895,
          "sessionRotationReason": null,
          "accountingReceiptReady": true,
          "rawInputIncludesCached": false,
          "accountingReceiptSequence": 16,
          "accountingReceiptSourceId": "5ab65194-abc8-4496-a5d7-cdeb7a16e0ab",
          "accountingReceiptReceivedAt": "2026-10-21T12:26:27.721Z"
        }
      }
    ]
  }
}