E2E campaign

E2E tests

App and agent journeys across deployment targets, profiles, and execution environments. Declared PNG screenshots and normalized results are retained with every published campaign; additional diagnostic evidence remains in the access-controlled workflow artifact.

2026-11-02T16:57:51.552Zaab87ce7Source run ↗

1/2Passed
1Failed
Unknown (9m 22s retained subtotal)Summed attempt time
Campaign usage and spend
0 / 0Complaints / suggestions · retained attempts0 distinct items · 0 attempts with incomplete collection · 0 failed submissions · 0 unresolved submissions
1Retained attempts1 missing attempts · 0 out-of-scope artifacts
31,374 (partial: 1/2 runs)Input tokens
1,659 (partial: 1/2 runs)Output tokens
258,870 (partial: 1/2 runs)Cached tokens
UnavailableLLM reported subtotal
$0.2622 (partial: 1/2 runs)LLM estimated subtotal
$0.003862Daytona list estimate
9m 22sObserved attempt window1 retained attempts · 1 missing attempts

Attempt durations include setup and cleanup captured inside each attempt. The observed window spans the earliest retained start to the latest retained finish, including gaps and overlap. Carried-forward evidence can span older runs, so this window is not the current workflow's duration. Neither measure is CI queue/setup time or provider-billed runtime.

UnknownAgent execution time
UnknownDaytona lease time
0/2Runs provider-priced

Campaign costs include retained attempts, including failed retries. Result cards show the selected attempt. Provider-reported amounts and model estimates are separate; unpriced or unavailable runs are excluded, never counted as free. Coverage describes captured usage; unobserved setup, subscriptions, tools, CI and storage require additional accounting. Daytona runtime is a public-list-price estimate from captured lease time and pinned resources, before credits, discounts, storage allowance, or invoice adjustments. Local execution has no external runtime meter.

Unknown (4s observed)Worker setup time
Unknown (9m 18s observed)Worker execution time
Unknown (125ms observed)Worker feedback time
Unknown (231ms observed)Worker cleanup time
Unknown (1ms observed)Worker finalization time

1/1 complete worker receipts; 0 partial; 1 missing attempts. Worker phases cover the test callback through finalization before result publication. Browser/server startup, parent cleanup, CI queue/build time and provider-billed runtime are outside these measurements. An interrupted phase has no inferred end time.

Campaign feedback review

0 distinct feedback items await review. Collection gaps and failed submissions remain separate findings.

Full bodies and review rationale stay in private evidence. Exact duplicate bodies are grouped once; related causes can be linked by a reviewed duplicate disposition.

All results

Feature coverage 0 of 192 capabilities linked · 0 of 2 tests mapped

Associations use the current feature map. Counts describe linked test scenarios; a passing journey does not establish full coverage of a capability.

Getting started and access

FeatureCapabilities linkedLinked test results
Onboarding and first work 0/5 No mapped journey
Login, invitations, and access 0/5 No mapped journey
Companies and portability 0/8 No mapped journey

Tasks and conversations

FeatureCapabilities linkedLinked test results
Task creation and lifecycle 0/6 No mapped journey
Delegation, dependencies, and signoff 0/4 No mapped journey
Inbox, decisions, and search 0/5 No mapped journey
Agent conversations and project handoff 0/4 No mapped journey
Questions and approvals 0/8 No mapped journey
Steering and queued messages 0/7 No mapped journey
Documents, attachments, and work products 0/5 No mapped journey

Agents and reusable capabilities

FeatureCapabilities linkedLinked test results
Hiring, configuration, and organization 0/9 No mapped journey
Runs, harnesses, and model accounts 0/5 No mapped journey
Skills and Skill Studio 0/5 No mapped journey
Team packages and installation 0/4 No mapped journey

Projects and execution

FeatureCapabilities linkedLinked test results
Projects and repositories 0/5 No mapped journey
Goals and work alignment 0/3 No mapped journey
Workspaces, services, and files 0/5 No mapped journey
Execution environments 0/5 No mapped journey
Recovery 0/8 No mapped journey

Apps, channels, and extensions

FeatureCapabilities linkedLinked test results
Connection setup 0/8 No mapped journey
Assistant connections (MCP) 0/5 No mapped journey
App access and action permissions 0/5 No mapped journey
External chat and email 0/6 No mapped journey
Tool gateways and access profiles 0/5 No mapped journey
Secrets and proposals 0/5 No mapped journey
Plugins 0/4 No mapped journey

Automation and structured work

FeatureCapabilities linkedLinked test results
Routines, schedules, and triggers 0/5 No mapped journey
Cases 0/5 No mapped journey
Status cards 0/4 No mapped journey

Oversight and operation

FeatureCapabilities linkedLinked test results
Costs and budgets 0/6 No mapped journey
Dashboards and audit trails 0/6 No mapped journey
Navigation, profile, and announcements 0/6 No mapped journey
Instance operations 0/6 No mapped journey
CLI/API and local worktrees 0/6 No mapped journey

Contributor surfaces

FeatureCapabilities linkedLinked test results
Developer previews and diagnostic labs 0/4 No mapped journey

Test suite

Verified API artifact transfer

Install an authorized complete API artifact in Daytona and independently verify the delivered bytes.

Pass rate100.0%1/1 passed
Tokens291,90331,374 input · 1,659 output
Known spend$0.2661reported LLM + model/runtime estimates estimate
Agent time50s52s lease
Execution1/10 retries · cleanup passed
Runner CodexDaytona sandboxcodex · gpt-5.6-sol
Test details5/5 checks · 9m 22s
Environment
Daytona sandbox
Model
gpt-5.6-sol
Runtime
native · codex
  • Passmatched
  • Passmatched
  • Passmatched
  • Passmatched
  • Passmatched
Tokens31,374 in · 1,659 out258,870 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
LLM estimate$0.2622Estimated from captured usage
Execution$0.003862 est.50s agent · 52s lease

Task chat

RUN-2: Transfer diagnostic issue API artifact · 7 entries

Recorded task brief, messages, requests and answers, with native agent progress when available. This is a read-only recording of the saved task conversation.

Task brief
Inspect diagnostic evidence task 83861b4b-815b-49ef-8a29-0f8636306dbe using Paperclip API tools. Discover GET /api/issues/{id}, call it for that task, and retain its returned response artifact identity. Use download\_artifact to copy that exact artifact into api-response-proof.txt in the execution workspace, passing its returned artifactId, byteSize and sha256. Do not reconstruct, retype, rewrite, or execute the artifact contents. Do not fetch the response through shell credentials or substitute another reader. Report a missing download capability as a failure. Verify the installed file as JSON, including its source issue ID, complete description and Evidence code. Deliver the unchanged full JSON file as an attachment named api-response-proof.txt. Do not edit the evidence task or create children. Finish this task with paperclip\_finish, reportedWorkDisposition done, and summary API\_ARTIFACT\_TRANSFER\_c77ee54ee18a-1.
Runner E2E runner-codex c77ee54ee18a-1
I’m locating the exact issue-read operation first, then I’ll preserve and verify the returned artifact without rewriting its contents.
Runner E2E runner-codex c77ee54ee18a-1
The exact `GET /api/issues/{id}` operation is confirmed. I’m now capturing its immutable response artifact metadata and transferring that artifact directly into the workspace.
Runner E2E runner-codex c77ee54ee18a-1
The direct install was rejected by the artifact service, so I’m checking the workspace target itself (without reading or altering the artifact) and will retry only if the destination can be made compliant.
Runner E2E runner-codex c77ee54ee18a-1
The exact artifact is now installed unchanged. I’m validating its hash and JSON structure, then checking the source ID, full description field, and Evidence code before registering the attachment.
Runner E2E runner-codex c77ee54ee18a-1
Prepared Diagnostic issue API response proof for this response.
Runner E2E runner-codex c77ee54ee18a-1
API_ARTIFACT_TRANSFER_c77ee54ee18a-1 Verified and prepared unchanged as `api-response-proof.txt`. SHA-256 and JSON evidence checks passed.
RUN-1: Synthetic diagnostic evidence c77ee54ee18a-1 · 1 entries

Recorded task brief, messages, requests and answers, with native agent progress when available. This is a read-only recording of the saved task conversation.

Task brief
Synthetic diagnostic data: snowman ☃, quote ", backslash \, newline Synthetic diagnostic data: snowman ☃, quote ", backslash \, newline Synthetic diagnostic data: snowman ☃, quote ", backslash \, newline Synthetic diagnostic data: snowman ☃, quote ", backslash \, newline Synthetic diagnostic data: snowman ☃, quote ", backslash \, newline Synthetic diagnostic data: snowman ☃, quote ", backslash \, newline Synthetic diagnostic data: snowman ☃, quote ", backslash \, newline Synthetic diagnostic data: snowman ☃, quote ", backslash \, newline Synthetic diagnostic data: snowman ☃, quote ", backslash \, newline Synthetic diagnostic data: snowman ☃, quote ", backslash \, newline Synthetic diagnostic data: snowman ☃, quote ", backslash \, newline Synthetic diagnostic data: snowman ☃, quote ", backslash \, newline Synthetic diagnostic data: snowman ☃, quote ", backslash \, newline Synthetic diagnostic data: snowman ☃, quote ", backslash \, newline Synthetic diagnostic data: snowman ☃, quote ", backslash \, newline Synthetic diagnostic data: snowman ☃, quote ", backslash \, newline Synthetic diagnostic data: snowman ☃, quote ", backslash \, newline Synthetic diagnostic data: snowman ☃, quote
Diagnostics
Overall passed · 5/5 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (5)
ResultCheckDetail
Passmessage_containsmatched
Passissue_statusmatched
Passrun_statusmatched
Passruntime_modematched
Passenvironmentmatched

Worker phase timing: complete.

Feedback: 0 complaints · 0 suggestions · 0 distinct items; see campaign feedback review. Saved-feedback collection: complete; invocation coverage: complete. Tool receipts: 0 failed · 0 unresolved. Full bodies: access-controlled snapshots/agent-feedback.json or snapshots/agent-feedback-recovered.json.

api-artifact-transfer.runner-codex.daytona.verified-artifact-copy
Attempt
1
Duration
9m 22s
Agent runtime
50s
Environment lease
52s
Runtime
native
Provider
codex
Model
gpt-5.6-sol
Issue
RUN-2
Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
1adc1d11-4560-4fcd-975e-a82f33c8bb14unknown fresh (created)fresh (created)fresh (created)unknown (evidence_missing)fresh (created) unknown
ResultMatcherExpectationDetail
Pass message_contains {"kind":"message_contains","expected":"api-response-proof.txt"} matched
Pass issue_status {"kind":"issue_status","expected":"done"} matched
Pass run_status {"kind":"run_status","expected":"succeeded"} matched
Pass runtime_mode {"kind":"runtime_mode","expected":"native"} matched
Pass environment {"kind":"environment","expected":"daytona"} matched
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 1,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 31374,
      "outputTokens": 1659,
      "cachedInputTokens": 258870,
      "totalTokens": 291903,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0.262224,
      "costStatus": "estimated"
    },
    "runtime": {
      "provider": "daytona",
      "agentRunDurationMs": 50369,
      "leaseDurationMs": 51972,
      "leaseCount": 2,
      "cpuCores": 4,
      "memoryGiB": 4,
      "diskGiB": 10,
      "estimatedListCostUsd": 0.0038615196,
      "costStatus": "estimated",
      "costSource": "daytona_public_list_price",
      "pricingAsOf": "2026-08-27",
      "pricingUrl": "https://www.daytona.io/pricing"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0.0038615196,
    "observedAndEstimatedCostUsd": 0.2660855196,
    "complete": true
  },
  "rawUsage": {
    "model": "gpt-5.6-sol",
    "biller": "openai",
    "costUsd": null,
    "provider": "openai",
    "costStatus": "estimated",
    "billingType": "metered_api",
    "inputTokens": 31374,
    "ledgerScope": {
      "issueId": "81725479-fd88-46f4-a6d9-5f782e0690d0",
      "projectId": null,
      "billingCode": null
    },
    "usageSource": "per_run",
    "costUsdExact": "0.262224000",
    "outputTokens": 1659,
    "usageByModel": null,
    "budgetDispatch": {
      "admittedAt": "2026-11-02T16:55:28.581Z",
      "handedOffAt": "2026-11-02T16:55:28.592Z",
      "reservationId": "f6461bcc-0ec4-4177-bbd2-c28e67c83916",
      "recoveryLeaseOwner": null
    },
    "budgetExposure": {
      "sequence": 244,
      "sourceId": "696f4815-f3f0-5d24-a60a-3fa3929c8f81",
      "costCents": "26.2224000"
    },
    "cacheWriteTokens": 0,
    "cachedInputTokens": 258870,
    "pricingProvenance": {
      "source": "rate_card",
      "version": "openai-standard-2026-09-30",
      "evidence": "https://developers.openai.com/api/docs/pricing; standard processing assumed; short per-request context assumed; cache writes reported",
      "contextTier": "short",
      "serviceTier": "standard",
      "inputCentsPerMillion": "400.0000000",
      "outputCentsPerMillion": "2000.0000000",
      "cacheWriteCentsPerMillion": "500.0000000",
      "cachedInputCentsPerMillion": "40.0000000"
    },
    "providerRequestId": null,
    "accountingReceiptId": "f8319ae4-f639-596b-abde-e68873e85fa4",
    "cacheAdjustedCostUsd": null,
    "accountingReceiptOwner": "native_producer",
    "accountingReceiptReady": true,
    "accountingReceiptSequence": 244,
    "accountingReceiptSourceId": "696f4815-f3f0-5d24-a60a-3fa3929c8f81",
    "accountingReceiptReceivedAt": "2026-11-02T16:56:09.682Z"
  },
  "workerTiming": {
    "version": 1,
    "scope": "worker",
    "status": "complete",
    "executionId": "api-artifact-transfer.runner-codex.daytona.verified-artifact-copy",
    "attempt": 1,
    "startedAt": "2026-11-02T16:47:02.637Z",
    "finishedAt": "2026-11-02T16:56:25.088Z",
    "segments": [
      {
        "phase": "setup",
        "startedAt": "2026-11-02T16:47:02.637Z",
        "finishedAt": "2026-11-02T16:47:06.539Z"
      },
      {
        "phase": "execution",
        "startedAt": "2026-11-02T16:47:06.539Z",
        "finishedAt": "2026-11-02T16:56:24.731Z"
      },
      {
        "phase": "cleanup",
        "startedAt": "2026-11-02T16:56:24.731Z",
        "finishedAt": "2026-11-02T16:56:24.927Z"
      },
      {
        "phase": "feedback",
        "startedAt": "2026-11-02T16:56:24.927Z",
        "finishedAt": "2026-11-02T16:56:25.052Z"
      },
      {
        "phase": "cleanup",
        "startedAt": "2026-11-02T16:56:25.052Z",
        "finishedAt": "2026-11-02T16:56:25.087Z"
      },
      {
        "phase": "finalization",
        "startedAt": "2026-11-02T16:56:25.087Z",
        "finishedAt": "2026-11-02T16:56:25.088Z"
      }
    ]
  },
  "startupReuse": [
    {
      "runId": "1adc1d11-4560-4fcd-975e-a82f33c8bb14",
      "warmth": "unknown",
      "layers": {
        "environment": {
          "state": "fresh",
          "reason": "created"
        },
        "workspace": {
          "state": "fresh",
          "reason": "created"
        },
        "runner": {
          "state": "fresh",
          "reason": "created"
        },
        "provider_process": {
          "state": "unknown",
          "reason": "evidence_missing"
        },
        "provider_session": {
          "state": "fresh",
          "reason": "created"
        }
      },
      "providerLaunchCount": null
    }
  ]
}

Test suite

Daytona Warm Continuity

Three browser-driven turns on one reusable Daytona sandbox for legacy and native Codex.

Pass rate0.0%0/1 passed
TokensUnavailableUnavailable input · Unavailable output
Known spendUnavailablereported LLM + model/runtime estimates estimate
Agent timeUnknownUnknown lease
Execution0/10 retries · cleanup failed
Runner CodexDaytona warm reusable sandboxcodex · gpt-5.6-sol
Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded
Test detailsNo checks recorded · 0ms
Tested URL
Not recorded
Environment
Daytona warm reusable sandbox
Model
gpt-5.6-sol
Runtime
native · codex
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionUnavailable
Diagnostics

Worker phase timing: not captured.

Feedback was not captured for this attempt.

daytona-warm-continuity.runner-codex.daytona.warm-three-turn
Attempt
0
Duration
0ms
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

No result artifact was uploaded

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "daytona",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "unavailable",
      "costSource": "provider_cost_unavailable"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null,
  "startupReuse": []
}