Full-stack acceptance campaign

Runner Full-Stack E2E

Results across runner profiles and execution environments. Declared PNG screenshots and normalized results are retained with every published campaign; additional diagnostic evidence remains in the access-controlled workflow artifact.

2026-10-21T03:45:35.750Zde801674Source run ↗

0/1Passed
1Failed
1m 6sTest time
Campaign usage and spend
30,671Input tokens
2,527Output tokens
261,962Cached tokens
UnavailableLLM reported subtotal
$0.000000Daytona list estimate
55sAgent execution time
0msDaytona lease time
0/1Runs provider-priced

Model spend is the provider-reported subtotal; unpriced or unavailable runs are excluded, never counted as free. Daytona runtime is a public-list-price estimate from captured lease time and pinned resources, before credits, discounts, storage allowance, or invoice adjustments. Local execution has no external runtime meter.

All results

Feature coverage 0 of 191 capabilities linked · 0 of 1 tests mapped

Associations use the current feature map. Counts describe linked test scenarios; a passing journey does not establish full coverage of a capability.

Getting started and access

FeatureCapabilities linkedLinked test results
Onboarding and first work 0/5 No mapped journey
Login, invitations, and access 0/5 No mapped journey
Companies and portability 0/8 No mapped journey

Tasks and conversations

FeatureCapabilities linkedLinked test results
Task creation and lifecycle 0/6 No mapped journey
Delegation, dependencies, and signoff 0/4 No mapped journey
Inbox, decisions, and search 0/5 No mapped journey
Agent conversations and project handoff 0/4 No mapped journey
Questions and approvals 0/8 No mapped journey
Steering and queued messages 0/7 No mapped journey
Documents, attachments, and work products 0/5 No mapped journey

Agents and reusable capabilities

FeatureCapabilities linkedLinked test results
Hiring, configuration, and organization 0/9 No mapped journey
Runs, harnesses, and model accounts 0/4 No mapped journey
Skills and Skill Studio 0/5 No mapped journey
Team packages and installation 0/4 No mapped journey

Projects and execution

FeatureCapabilities linkedLinked test results
Projects and repositories 0/5 No mapped journey
Goals and work alignment 0/3 No mapped journey
Workspaces, services, and files 0/5 No mapped journey
Execution environments 0/5 No mapped journey
Recovery 0/8 No mapped journey

Apps, channels, and extensions

FeatureCapabilities linkedLinked test results
Connection setup 0/8 No mapped journey
Assistant connections (MCP) 0/5 No mapped journey
App access and action permissions 0/5 No mapped journey
External chat and email 0/6 No mapped journey
Tool gateways and access profiles 0/5 No mapped journey
Secrets and proposals 0/5 No mapped journey
Plugins 0/4 No mapped journey

Automation and structured work

FeatureCapabilities linkedLinked test results
Routines, schedules, and triggers 0/5 No mapped journey
Cases 0/5 No mapped journey
Status cards 0/4 No mapped journey

Oversight and operation

FeatureCapabilities linkedLinked test results
Costs and budgets 0/6 No mapped journey
Dashboards and audit trails 0/6 No mapped journey
Navigation, profile, and announcements 0/6 No mapped journey
Instance operations 0/6 No mapped journey
CLI/API and local worktrees 0/6 No mapped journey

Contributor surfaces

FeatureCapabilities linkedLinked test results
Developer previews and diagnostic labs 0/4 No mapped journey

Test suite

automatic-repository

Suite discovered from retained campaign identities; full suite size is not known to this publisher.

Pass rate0.0%0/1 passed
Tokens295,16030,671 input · 2,527 output
Known spendUnavailablereported LLM + runtime estimate
Agent time55s0ms lease
Execution1/10 retries · cleanup passed
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · 0/6 behavioral checks passed

Failed checks:

  • automaticRepository.durable-completion — Two committed provider admissions must finish the requested result.
  • automaticRepository.server-owned-continuation — Repository setup must continue through the saved same-agent wake without a timer or user message.
  • automaticRepository.retained-workspace — Both admissions must retain the same task workspace and its prepared repository.
  • automaticRepository.retained-context — The first admission's independently downloaded unpredictable reference must survive setup byte for byte.
  • automaticRepository.independent-result — Downloaded result bytes must agree with the independently inspected checkout and original reference.
  • automaticRepository.accessible-delivery — The originating task must render its result link without an unanswered question.
See all behavioral checks (6)
ResultCheckDetail
FailautomaticRepository.durable-completionTwo committed provider admissions must finish the requested result.
FailautomaticRepository.server-owned-continuationRepository setup must continue through the saved same-agent wake without a timer or user message.
FailautomaticRepository.retained-workspaceBoth admissions must retain the same task workspace and its prepared repository.
FailautomaticRepository.retained-contextThe first admission's independently downloaded unpredictable reference must survive setup byte for byte.
FailautomaticRepository.independent-resultDownloaded result bytes must agree with the independently inspected checkout and original reference.
FailautomaticRepository.accessible-deliveryThe originating task must render its result link without an unanswered question.

candidate failure

Stopped waiting for repository setup and automatic result delivery: Repository setup stopped in blocked; see retained task state
Test details0/6 checks · 1m 6s
Tokens30,671 in · 2,527 out261,962 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered55s agent
automatic-repository.runner-codex.local.automatic-repository-resume
Attempt
1
Duration
1m 6s
Agent runtime
55s
Runtime
native
Provider
codex
Model
gpt-5.6-sol
Issue
RUN-1

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
c9e8d06c-0043-417b-8ed4-9402b3979b30unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Fail json_path {"kind":"json_path","path":"automaticRepository.durable-completion","expected":true} Two committed provider admissions must finish the requested result.
Fail json_path {"kind":"json_path","path":"automaticRepository.server-owned-continuation","expected":true} Repository setup must continue through the saved same-agent wake without a timer or user message.
Fail json_path {"kind":"json_path","path":"automaticRepository.retained-workspace","expected":true} Both admissions must retain the same task workspace and its prepared repository.
Fail json_path {"kind":"json_path","path":"automaticRepository.retained-context","expected":true} The first admission's independently downloaded unpredictable reference must survive setup byte for byte.
Fail json_path {"kind":"json_path","path":"automaticRepository.independent-result","expected":true} Downloaded result bytes must agree with the independently inspected checkout and original reference.
Fail json_path {"kind":"json_path","path":"automaticRepository.accessible-delivery","expected":true} The originating task must render its result link without an unanswered question.
Usage and billing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "inputTokens": 30671,
      "outputTokens": 2527,
      "cachedInputTokens": 261962,
      "totalTokens": 295160,
      "reportedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 55130,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "model": "gpt-5.6-sol",
    "biller": "openai",
    "costUsd": null,
    "provider": "openai",
    "costStatus": "estimated",
    "billingType": "metered_api",
    "inputTokens": 30671,
    "ledgerScope": {
      "issueId": "de597890-91a1-4315-a5d5-03760383e9c1",
      "projectId": null,
      "billingCode": null
    },
    "usageSource": "per_run",
    "costUsdExact": "0.278008800",
    "freshSession": true,
    "outputTokens": 2527,
    "usageByModel": null,
    "sessionReused": false,
    "rawInputTokens": 30671,
    "sessionRotated": false,
    "configFreshness": {
      "session": {
        "reset": true,
        "categories": [
          "adapter",
          "adapterConfig",
          "agentRuntimeConfig",
          "instructions",
          "issueOverrides",
          "workspaceConfig",
          "environment",
          "envBindings",
          "secrets",
          "runtimeSkills"
        ],
        "resetReasons": [],
        "nextFingerprint": "v1:sha256:b068277cb603d82246572742a93c877976f59dd4ad889d39e5d6b62a968a0e3d",
        "changedCategories": [],
        "taskSessionReused": false,
        "fingerprintVersion": 1,
        "taskSessionAvailable": false,
        "storedFingerprintPresent": false
      },
      "version": 1,
      "workspace": {
        "action": "create",
        "reasons": [],
        "categories": [
          "mode",
          "projectWorkspace",
          "strategy",
          "repo",
          "lifecycleCommands",
          "runtimeServices",
          "environment",
          "realization"
        ],
        "reuseRequested": false,
        "nextFingerprint": "v1:sha256:1ad2c96b99a8a164c85b0ab5ac6122091636a69a39f69af1c45a131155afb644",
        "workspaceReused": false,
        "activeWorkspaceId": "415d5969-d16c-4898-a3c2-d6c85fa94dd1",
        "changedCategories": [],
        "storedFingerprint": null,
        "fingerprintVersion": 1,
        "inferredFingerprint": null,
        "previousWorkspaceId": null,
        "configSnapshotRefreshed": false,
        "storedFingerprintPresent": false
      }
    },
    "rawOutputTokens": 2527,
    "cacheWriteTokens": 0,
    "cachedInputTokens": 261962,
    "pricingProvenance": {
      "source": "rate_card",
      "version": "openai-standard-2026-09-30",
      "evidence": "https://developers.openai.com/api/docs/pricing; standard processing assumed; short per-request context assumed; cache writes reported",
      "contextTier": "short",
      "serviceTier": "standard",
      "inputCentsPerMillion": "400.0000000",
      "outputCentsPerMillion": "2000.0000000",
      "cacheWriteCentsPerMillion": "500.0000000",
      "cachedInputCentsPerMillion": "40.0000000"
    },
    "providerRequestId": null,
    "taskSessionReused": false,
    "persistedSessionId": "01a15c8e-7b77-76c3-a405-b8ca127d92be",
    "accountingReceiptId": "554dfb9e-bd64-4c62-a1a3-68ba6444e644",
    "cacheAdjustedCostUsd": null,
    "rawCachedInputTokens": 261962,
    "sessionRotationReason": null,
    "accountingReceiptReady": true,
    "rawInputIncludesCached": false,
    "accountingReceiptSequence": 14,
    "accountingReceiptSourceId": "c05c0ac5-c133-40b2-9241-b913d95b68ec",
    "accountingReceiptReceivedAt": "2026-10-21T03:44:13.335Z"
  }
}