Full-stack acceptance campaign

Runner Full-Stack E2E

Results across runner profiles and execution environments. Declared PNG screenshots and normalized results are retained with every published campaign; additional diagnostic evidence remains in the access-controlled workflow artifact.

2026-10-21T13:07:27.846Z0cd0746dSource run ↗

0/1Passed
1Failed
1m 16sTest time
Campaign usage and spend
29,480 (partial: 1/2 runs)Input tokens
1,491 (partial: 1/2 runs)Output tokens
239,169 (partial: 1/2 runs)Cached tokens
UnavailableLLM reported subtotal
$0.000000Daytona list estimate
58sAgent execution time
0msDaytona lease time
0/2Runs provider-priced

Model spend is the provider-reported subtotal; unpriced or unavailable runs are excluded, never counted as free. Daytona runtime is a public-list-price estimate from captured lease time and pinned resources, before credits, discounts, storage allowance, or invoice adjustments. Local execution has no external runtime meter.

All results

Feature coverage 0 of 191 capabilities linked · 0 of 1 tests mapped

Associations use the current feature map. Counts describe linked test scenarios; a passing journey does not establish full coverage of a capability.

Getting started and access

FeatureCapabilities linkedLinked test results
Onboarding and first work 0/5 No mapped journey
Login, invitations, and access 0/5 No mapped journey
Companies and portability 0/8 No mapped journey

Tasks and conversations

FeatureCapabilities linkedLinked test results
Task creation and lifecycle 0/6 No mapped journey
Delegation, dependencies, and signoff 0/4 No mapped journey
Inbox, decisions, and search 0/5 No mapped journey
Agent conversations and project handoff 0/4 No mapped journey
Questions and approvals 0/8 No mapped journey
Steering and queued messages 0/7 No mapped journey
Documents, attachments, and work products 0/5 No mapped journey

Agents and reusable capabilities

FeatureCapabilities linkedLinked test results
Hiring, configuration, and organization 0/9 No mapped journey
Runs, harnesses, and model accounts 0/4 No mapped journey
Skills and Skill Studio 0/5 No mapped journey
Team packages and installation 0/4 No mapped journey

Projects and execution

FeatureCapabilities linkedLinked test results
Projects and repositories 0/5 No mapped journey
Goals and work alignment 0/3 No mapped journey
Workspaces, services, and files 0/5 No mapped journey
Execution environments 0/5 No mapped journey
Recovery 0/8 No mapped journey

Apps, channels, and extensions

FeatureCapabilities linkedLinked test results
Connection setup 0/8 No mapped journey
Assistant connections (MCP) 0/5 No mapped journey
App access and action permissions 0/5 No mapped journey
External chat and email 0/6 No mapped journey
Tool gateways and access profiles 0/5 No mapped journey
Secrets and proposals 0/5 No mapped journey
Plugins 0/4 No mapped journey

Automation and structured work

FeatureCapabilities linkedLinked test results
Routines, schedules, and triggers 0/5 No mapped journey
Cases 0/5 No mapped journey
Status cards 0/4 No mapped journey

Oversight and operation

FeatureCapabilities linkedLinked test results
Costs and budgets 0/6 No mapped journey
Dashboards and audit trails 0/6 No mapped journey
Navigation, profile, and announcements 0/6 No mapped journey
Instance operations 0/6 No mapped journey
CLI/API and local worktrees 0/6 No mapped journey

Contributor surfaces

FeatureCapabilities linkedLinked test results
Developer previews and diagnostic labs 0/4 No mapped journey

Test suite

automatic-repository-configured-models

Suite discovered from retained campaign identities; full suite size is not known to this publisher.

Pass rate0.0%0/1 passed
Tokens270,140 (partial: 1/2 runs)29,480 (partial: 1/2 runs) input · 1,491 (partial: 1/2 runs) output
Known spendUnavailablereported LLM + runtime estimate
Agent time58s0ms lease
Execution1/10 retries · cleanup passed
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · 0/6 behavioral checks passed

Failed checks:

  • automaticRepository.durable-completion — Two committed provider admissions must finish the requested result.
  • automaticRepository.server-owned-continuation — Repository setup must continue through the saved same-agent wake without a timer or user message.
  • automaticRepository.retained-workspace — Both admissions must retain the same task workspace and its prepared repository.
  • automaticRepository.retained-context — The first admission's independently downloaded unpredictable reference must survive setup byte for byte.
  • automaticRepository.independent-result — Downloaded result bytes must agree with the independently inspected checkout and original reference.
  • automaticRepository.accessible-delivery — The originating task must render its result link without an unanswered question.
See all behavioral checks (6)
ResultCheckDetail
FailautomaticRepository.durable-completionTwo committed provider admissions must finish the requested result.
FailautomaticRepository.server-owned-continuationRepository setup must continue through the saved same-agent wake without a timer or user message.
FailautomaticRepository.retained-workspaceBoth admissions must retain the same task workspace and its prepared repository.
FailautomaticRepository.retained-contextThe first admission's independently downloaded unpredictable reference must survive setup byte for byte.
FailautomaticRepository.independent-resultDownloaded result bytes must agree with the independently inspected checkout and original reference.
FailautomaticRepository.accessible-deliveryThe originating task must render its result link without an unanswered question.

transient infrastructure

Stopped waiting for repository setup and automatic result delivery: A provider admission failed
Test details0/6 checks · 1m 16s
Tokens29,480 (partial: 1/2 runs) in · 1,491 (partial: 1/2 runs) out239,169 (partial: 1/2 runs) cached · 1/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered58s agent
automatic-repository-configured-models.runner-codex.local.automatic-repository-resume
Attempt
1
Duration
1m 16s
Agent runtime
58s
Runtime
native
Provider
codex
Model
gpt-6.1-sol
Issue
RUN-1

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
348b2394-0e15-4e62-9f10-c800d735ab58unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ff814d1f-5781-4c30-8553-e9fcd48ab736unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Fail json_path {"kind":"json_path","path":"automaticRepository.durable-completion","expected":true} Two committed provider admissions must finish the requested result.
Fail json_path {"kind":"json_path","path":"automaticRepository.server-owned-continuation","expected":true} Repository setup must continue through the saved same-agent wake without a timer or user message.
Fail json_path {"kind":"json_path","path":"automaticRepository.retained-workspace","expected":true} Both admissions must retain the same task workspace and its prepared repository.
Fail json_path {"kind":"json_path","path":"automaticRepository.retained-context","expected":true} The first admission's independently downloaded unpredictable reference must survive setup byte for byte.
Fail json_path {"kind":"json_path","path":"automaticRepository.independent-result","expected":true} Downloaded result bytes must agree with the independently inspected checkout and original reference.
Fail json_path {"kind":"json_path","path":"automaticRepository.accessible-delivery","expected":true} The originating task must render its result link without an unanswered question.
Usage and billing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "inputTokens": 29480,
      "outputTokens": 1491,
      "cachedInputTokens": 239169,
      "totalTokens": 270140,
      "reportedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 58119,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "348b2394-0e15-4e62-9f10-c800d735ab58",
        "usage": {
          "ledgerScope": {
            "issueId": "1991fe68-1906-4f8c-bda5-4fe2da187e27",
            "projectId": null,
            "billingCode": null
          }
        }
      },
      {
        "runId": "ff814d1f-5781-4c30-8553-e9fcd48ab736",
        "usage": {
          "model": "gpt-6.1-sol",
          "biller": "openai",
          "costUsd": null,
          "provider": "openai",
          "costStatus": "estimated",
          "billingType": "metered_api",
          "inputTokens": 29480,
          "ledgerScope": {
            "issueId": "1991fe68-1906-4f8c-bda5-4fe2da187e27",
            "projectId": null,
            "billingCode": null
          },
          "usageSource": "per_run",
          "costUsdExact": "0.097786900",
          "freshSession": true,
          "outputTokens": 1491,
          "usageByModel": null,
          "sessionReused": false,
          "rawInputTokens": 29480,
          "sessionRotated": false,
          "configFreshness": {
            "session": {
              "reset": true,
              "categories": [
                "adapter",
                "adapterConfig",
                "agentRuntimeConfig",
                "instructions",
                "issueOverrides",
                "workspaceConfig",
                "environment",
                "envBindings",
                "secrets",
                "runtimeSkills"
              ],
              "resetReasons": [],
              "nextFingerprint": "v1:sha256:680551a2c345a65430896a66908f3dd7ddd7365872e6dba098680a006c903815",
              "changedCategories": [],
              "taskSessionReused": false,
              "fingerprintVersion": 1,
              "taskSessionAvailable": false,
              "storedFingerprintPresent": false
            },
            "version": 1,
            "workspace": {
              "action": "create",
              "reasons": [],
              "categories": [
                "mode",
                "projectWorkspace",
                "strategy",
                "repo",
                "lifecycleCommands",
                "runtimeServices",
                "environment",
                "realization"
              ],
              "reuseRequested": false,
              "nextFingerprint": "v1:sha256:fae228ce90584ff11a4b173d94fd87c73d4d30e0f9e98cd13b320c5826a2e633",
              "workspaceReused": false,
              "activeWorkspaceId": "5ae5e690-89af-41a6-84b2-65793a838f6b",
              "changedCategories": [],
              "storedFingerprint": null,
              "fingerprintVersion": 1,
              "inferredFingerprint": null,
              "previousWorkspaceId": null,
              "configSnapshotRefreshed": false,
              "storedFingerprintPresent": false
            }
          },
          "rawOutputTokens": 1491,
          "cacheWriteTokens": 0,
          "cachedInputTokens": 239169,
          "pricingProvenance": {
            "source": "rate_card",
            "version": "openai-standard-2026-09-30",
            "evidence": "https://developers.openai.com/api/docs/pricing; standard processing assumed; short per-request context assumed; cache writes reported",
            "contextTier": "short",
            "serviceTier": "standard",
            "inputCentsPerMillion": "200.0000000",
            "outputCentsPerMillion": "1000.0000000",
            "cacheWriteCentsPerMillion": "250.0000000",
            "cachedInputCentsPerMillion": "10.0000000"
          },
          "providerRequestId": null,
          "taskSessionReused": false,
          "persistedSessionId": "01a15e90-c433-7ed0-8160-242f57d92da7",
          "accountingReceiptId": "2c143270-2364-47a0-aebb-0d7383146501",
          "cacheAdjustedCostUsd": null,
          "rawCachedInputTokens": 239169,
          "sessionRotationReason": null,
          "accountingReceiptReady": true,
          "rawInputIncludesCached": false,
          "accountingReceiptSequence": 13,
          "accountingReceiptSourceId": "3f938be3-e8b6-40f2-8659-4acadd088434",
          "accountingReceiptReceivedAt": "2026-10-21T13:06:01.111Z"
        }
      }
    ]
  }
}