E2E campaign

E2E tests

App and agent journeys across deployment targets, profiles, and execution environments. Declared PNG screenshots and normalized results are retained with every published campaign; additional diagnostic evidence remains in the access-controlled workflow artifact.

2026-11-06T18:31:22.783Z5d25117fSource run ↗

0/1Passed
1Failed
8m 5sSummed attempt time
Campaign usage and spend
0 / 0Complaints / suggestions · retained attempts0 distinct items · 0 attempts with incomplete collection · 0 failed submissions · 0 unresolved submissions
1Retained attempts0 missing attempts · 0 out-of-scope artifacts
38,565Input tokens
7,024Output tokens
656,672Cached tokens
UnavailableLLM reported subtotal
$0.5574LLM estimated subtotal
$0.0300Daytona list estimate
8m 5sObserved attempt window1 retained attempts · 0 missing attempts

Attempt durations include setup and cleanup captured inside each attempt. The observed window spans the earliest retained start to the latest retained finish, including gaps and overlap. Carried-forward evidence can span older runs, so this window is not the current workflow's duration. Neither measure is CI queue/setup time or provider-billed runtime.

5m 17sAgent execution time
6m 44sDaytona lease time
0/3Runs provider-priced

Campaign costs include retained attempts, including failed retries. Result cards show the selected attempt. Provider-reported amounts and model estimates are separate; unpriced or unavailable runs are excluded, never counted as free. Coverage describes captured usage; unobserved setup, subscriptions, tools, CI and storage require additional accounting. Daytona runtime is a public-list-price estimate from captured lease time and pinned resources, before credits, discounts, storage allowance, or invoice adjustments. Local execution has no external runtime meter.

1m 1sWorker setup time
6m 53sWorker execution time
375msWorker feedback time
11sWorker cleanup time
0msWorker finalization time

1/1 complete worker receipts; 0 partial; 0 missing attempts. Worker phases cover the test callback through finalization before result publication. Browser/server startup, parent cleanup, CI queue/build time and provider-billed runtime are outside these measurements. An interrupted phase has no inferred end time.

Campaign feedback review

0 distinct feedback items await review. Collection gaps and failed submissions remain separate findings.

Full bodies and review rationale stay in private evidence. Exact duplicate bodies are grouped once; related causes can be linked by a reviewed duplicate disposition.

All results

Feature coverage 2 of 192 capabilities linked · 1 of 1 tests mapped

Associations use the current feature map. Counts describe linked test scenarios; a passing journey does not establish full coverage of a capability.

Getting started and access

FeatureCapabilities linkedLinked test results
Onboarding and first work 0/5 No mapped journey
Login, invitations, and access 0/5 No mapped journey
Companies and portability 0/8 No mapped journey

Tasks and conversations

FeatureCapabilities linkedLinked test results
Task creation and lifecycle 0/6 No mapped journey
Delegation, dependencies, and signoff 0/4 No mapped journey
Inbox, decisions, and search 0/5 No mapped journey
Agent conversations and project handoff 0/4 No mapped journey
Questions and approvals 0/8 No mapped journey
Steering and queued messages 0/7 No mapped journey
Work products 1/5 0/1 passed · 1 failed or incomplete

Agents and reusable capabilities

FeatureCapabilities linkedLinked test results
Hiring, configuration, and organization 0/9 No mapped journey
Runs, harnesses, and model accounts 0/5 No mapped journey
Skills and Skill Studio 0/5 No mapped journey
Team packages and installation 0/4 No mapped journey

Projects and execution

FeatureCapabilities linkedLinked test results
Projects and repositories 0/5 No mapped journey
Goals and work alignment 0/3 No mapped journey
Workspaces, services, and files 0/5 No mapped journey
Execution environments 0/5 No mapped journey
User continuation 1/8 0/1 passed · 1 failed or incomplete

Apps, channels, and extensions

FeatureCapabilities linkedLinked test results
Connection setup 0/8 No mapped journey
Assistant connections (MCP) 0/5 No mapped journey
App access and action permissions 0/5 No mapped journey
External chat and email 0/6 No mapped journey
Tool gateways and access profiles 0/5 No mapped journey
Secrets and proposals 0/5 No mapped journey
Plugins 0/4 No mapped journey

Automation and structured work

FeatureCapabilities linkedLinked test results
Routines, schedules, and triggers 0/5 No mapped journey
Cases 0/5 No mapped journey
Status cards 0/4 No mapped journey

Oversight and operation

FeatureCapabilities linkedLinked test results
Costs and budgets 0/6 No mapped journey
Dashboards and audit trails 0/6 No mapped journey
Navigation, profile, and announcements 0/6 No mapped journey
Instance operations 0/6 No mapped journey
CLI/API and local worktrees 0/6 No mapped journey

Contributor surfaces

FeatureCapabilities linkedLinked test results
Developer previews and diagnostic labs 0/4 No mapped journey

Test suite

Everyday Paperclip Work

Real user requests, useful downloaded work, and durable continuation using production instructions.

Pass rate0.0%0/1 passed
Tokens702,26138,565 input · 7,024 output
Known spend$0.5874reported LLM + model/runtime estimates estimate
Agent time5m 17s6m 44s lease
Execution1/10 retries · cleanup passed
Runner CodexDaytona warm reusable sandboxcodex · gpt-5.6-sol
Overall failed · No behavioral checks recorded

candidate failure

Stopped waiting for original remote run committed with workspace receipt: Original remote turn completed with failed tools or conflicting/repeated execution receipts
Test detailsNo checks recorded · 8m 5s
Environment
Daytona warm reusable sandbox
Model
gpt-5.6-sol
Runtime
native · codex
Tokens38,565 in · 7,024 out656,672 cached · 3/3 runs covered
LLM spendUnavailable0/3 runs provider-priced
LLM estimate$0.5574Estimated from captured usage
Execution$0.0300 est.5m 17s agent · 6m 44s lease

Task chat

RUN-1: Build dependency-free Python slugify CLI · 17 entries

Recorded task brief, messages, requests and answers, with native agent progress when available. This is a read-only recording of the saved task conversation.

Task brief
Build a small dependency-free Python command-line tool in slugify.py. It accepts one positional string and prints its slug: trim whitespace, lowercase, replace each sequence outside ASCII a-z and 0-9 with one hyphen, then trim hyphens. Expose slugify(text) for reuse. Include a README and automated tests. Deliver the source and tests as a downloadable ZIP. Work in the project workspace.
Studio Lead 0a9064097e73-1
I’m inspecting the workspace, then I’ll implement the CLI, tests, README, and package the verified files into a ZIP.
Studio Lead 0a9064097e73-1
The workspace is empty, so there’s no existing code to preserve. I’m adding a compact standard-library implementation and tests covering whitespace, punctuation runs, Unicode, empty results, reuse, and CLI behavior.
Studio Lead 0a9064097e73-1
Prepared Slugify CLI source, tests, and README for this response.
Studio Lead 0a9064097e73-1
Implementation and all seven tests pass. The archive contains only the requested source, tests, and README; I’m registering that verified ZIP for download now.
Studio Lead 0a9064097e73-1
Built and packaged the dependency-free slugify CLI. - Includes `slugify.py`, tests, and README - All 7 tests pass - Python compilation verified - Download: [slugify-tool.zip](/api/attachments/bec7d02a-5f70-4ee2-a7dc-0935b937596d/content?download=1)
You
Add an optional --separator argument that accepts either - or \_. Keep - as the default and preserve the earlier behavior. Deliver an updated ZIP, keeping the previous download available.
You
Also support --max-length as a positive integer. Truncate the final slug to that length, then remove any trailing separator. In particular, input " Queue--Ready!! " with --max-length 7 must print "queue-r". Preserve the default behavior.
Studio Lead 0a9064097e73-1
I’ll add `--separator` with choices `-` and `_`, retain `-` as the default, and extend tests to prove both the unchanged default and underscore mode. I’ll create a separately named updated archive so the prior download remains untouched.
Studio Lead 0a9064097e73-1
Prepared Updated Slugify CLI with configurable separator for this response.
Studio Lead 0a9064097e73-1
The code and documentation now support both separators, while calls that omit the option still produce hyphenated slugs exactly as before. I’m running the expanded suite and checking both the old archive’s integrity and the new archive contents.
Studio Lead 0a9064097e73-1
All 10 tests pass, including default compatibility and underscore output. The original ZIP still has its original checksum; the updated ZIP is separate and is being prepared for download.
Studio Lead 0a9064097e73-1
Added `--separator` supporting `-` and `_`, with `-` remaining the default. All 10 tests pass. - [Download updated ZIP](/api/attachments/b14f8a91-5a4e-4d28-8f94-f8ae7aeefe51/content?download=1) - [Previous ZIP](/api/attachments/bec7d02a-5f70-4ee2-a7dc-0935b937596d/content?download=1) remains available.
Studio Lead 0a9064097e73-1
I’ll add a positive-integer `--max-length`, apply truncation after slug construction, and strip a separator only if truncation leaves one at the end. I’ll cover the exact `queue-r` example and preserve both prior ZIPs unchanged.
Studio Lead 0a9064097e73-1
The exact required example now prints `queue-r`; combined underscore/truncation behavior also works, and invalid zero/negative lengths are rejected. All 15 tests pass, and the checksums confirm both earlier ZIPs remain unchanged.
Studio Lead 0a9064097e73-1
Prepared Updated Slugify CLI with max length support for this response.
Studio Lead 0a9064097e73-1
Added positive-integer `--max-length` support. The required example prints `queue-r`; all 15 tests pass. [Download slugify-tool-v3.zip](/api/attachments/521f0b8c-7ee9-47b5-83f6-494de4ed454e/content?download=1) Both earlier ZIPs remain unchanged and available.
Diagnostics

Worker phase timing: complete.

Feedback: 0 complaints · 0 suggestions · 0 distinct items; see campaign feedback review. Saved-feedback collection: complete; invocation coverage: complete. Tool receipts: 0 failed · 0 unresolved. Full bodies: access-controlled snapshots/agent-feedback.json or snapshots/agent-feedback-recovered.json.

everyday-workflows.runner-codex.daytona.recover-controller
  • Recovery · User continuation
  • Documents, attachments, and work products · Work products
Attempt
1
Duration
8m 5s
Agent runtime
5m 17s
Environment lease
6m 44s
Runtime
native
Provider
codex
Model
gpt-5.6-sol
Issue
RUN-1
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 3,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 3,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 38565,
      "outputTokens": 7024,
      "cachedInputTokens": 656672,
      "totalTokens": 702261,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0.5574088,
      "costStatus": "estimated"
    },
    "runtime": {
      "provider": "daytona",
      "agentRunDurationMs": 316754,
      "leaseDurationMs": 403522,
      "leaseCount": 4,
      "cpuCores": 4,
      "memoryGiB": 4,
      "diskGiB": 10,
      "estimatedListCostUsd": 0.029981684600000003,
      "costStatus": "estimated",
      "costSource": "daytona_public_list_price",
      "pricingAsOf": "2026-08-27",
      "pricingUrl": "https://www.daytona.io/pricing"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0.029981684600000003,
    "observedAndEstimatedCostUsd": 0.5873904846,
    "complete": true
  },
  "rawUsage": {
    "runs": [
      {
        "runId": "79d68244-7fad-4a50-940c-b8b0e2336385",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": null,
          "provider": "openai",
          "costStatus": "estimated",
          "billingType": "metered_api",
          "inputTokens": 4138,
          "ledgerScope": {
            "issueId": "e0ec479b-79d8-470f-b1d9-e1c566b76c91",
            "projectId": "c7920284-16f1-460f-b652-db11d8c3a9f2",
            "billingCode": null
          },
          "usageSource": "per_run",
          "costUsdExact": "0.134551200",
          "outputTokens": 2274,
          "usageByModel": null,
          "budgetDispatch": {
            "admittedAt": "2026-11-06T18:25:13.177Z",
            "handedOffAt": "2026-11-06T18:25:13.187Z",
            "reservationId": "4985a555-cad2-4501-b5e0-889d7ccb4111",
            "recoveryLeaseOwner": null
          },
          "budgetExposure": {
            "sequence": 317,
            "sourceId": "f5e1c524-4a4f-5d4b-ad94-d08e54cf9ebd",
            "costCents": "13.4551200"
          },
          "cacheWriteTokens": 0,
          "cachedInputTokens": 181298,
          "pricingProvenance": {
            "source": "rate_card",
            "version": "openai-standard-2026-09-30",
            "evidence": "https://developers.openai.com/api/docs/pricing; standard processing assumed; short per-request context assumed; cache writes reported",
            "contextTier": "short",
            "serviceTier": "standard",
            "inputCentsPerMillion": "400.0000000",
            "outputCentsPerMillion": "2000.0000000",
            "cacheWriteCentsPerMillion": "500.0000000",
            "cachedInputCentsPerMillion": "40.0000000"
          },
          "providerRequestId": null,
          "accountingReceiptId": "7123660b-8781-58bd-aba4-8cc62e2fca5d",
          "cacheAdjustedCostUsd": null,
          "accountingReceiptOwner": "native_producer",
          "accountingReceiptReady": true,
          "accountingReceiptSequence": 317,
          "accountingReceiptSourceId": "f5e1c524-4a4f-5d4b-ad94-d08e54cf9ebd",
          "accountingReceiptReceivedAt": "2026-11-06T18:25:46.562Z"
        }
      },
      {
        "runId": "29a5eda7-2174-41b0-b06d-09ca9c5e050e",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": null,
          "provider": "openai",
          "costStatus": "estimated",
          "billingType": "metered_api",
          "inputTokens": 6794,
          "ledgerScope": {
            "issueId": "e0ec479b-79d8-470f-b1d9-e1c566b76c91",
            "projectId": "c7920284-16f1-460f-b652-db11d8c3a9f2",
            "billingCode": null
          },
          "usageSource": "per_run",
          "costUsdExact": "0.206010400",
          "outputTokens": 2532,
          "usageByModel": null,
          "budgetDispatch": {
            "admittedAt": "2026-11-06T18:24:09.164Z",
            "handedOffAt": "2026-11-06T18:24:09.204Z",
            "reservationId": "42846d08-e2d9-4de7-be7a-65224bb503d7",
            "recoveryLeaseOwner": "54b9846f-8dfa-475a-985d-c224cd3d6764:2:6b3bedcd-3cf9-4db4-8782-959e6371e5d8"
          },
          "budgetExposure": {
            "sequence": 477,
            "sourceId": "a2d48092-3325-5e39-afc6-16e344c21996",
            "costCents": "20.6010400"
          },
          "cacheWriteTokens": 0,
          "cachedInputTokens": 320486,
          "pricingProvenance": {
            "source": "rate_card",
            "version": "openai-standard-2026-09-30",
            "evidence": "https://developers.openai.com/api/docs/pricing; standard processing assumed; short per-request context assumed; cache writes reported",
            "contextTier": "short",
            "serviceTier": "standard",
            "inputCentsPerMillion": "400.0000000",
            "outputCentsPerMillion": "2000.0000000",
            "cacheWriteCentsPerMillion": "500.0000000",
            "cachedInputCentsPerMillion": "40.0000000"
          },
          "providerRequestId": null,
          "accountingReceiptId": "d4686575-bb97-5e96-a4f7-b3ed481b8d3e",
          "cacheAdjustedCostUsd": null,
          "accountingReceiptOwner": "native_producer",
          "accountingReceiptReady": true,
          "accountingReceiptSequence": 477,
          "accountingReceiptSourceId": "a2d48092-3325-5e39-afc6-16e344c21996",
          "accountingReceiptReceivedAt": "2026-11-06T18:24:31.220Z"
        }
      },
      {
        "runId": "c22bf549-14a9-4f88-88e2-989e7406d681",
        "usage": {
          "model": "gpt-5.6-sol",
          "biller": "openai",
          "costUsd": null,
          "provider": "openai",
          "costStatus": "estimated",
          "billingType": "metered_api",
          "inputTokens": 27633,
          "ledgerScope": {
            "issueId": "e0ec479b-79d8-470f-b1d9-e1c566b76c91",
            "projectId": "c7920284-16f1-460f-b652-db11d8c3a9f2",
            "billingCode": null
          },
          "usageSource": "per_run",
          "costUsdExact": "0.216847200",
          "outputTokens": 2218,
          "usageByModel": null,
          "budgetDispatch": {
            "admittedAt": "2026-11-06T18:19:53.515Z",
            "handedOffAt": "2026-11-06T18:19:53.526Z",
            "reservationId": "cf2a08af-a27c-4562-9410-2108ddc46e6b",
            "recoveryLeaseOwner": null
          },
          "budgetExposure": {
            "sequence": 509,
            "sourceId": "ca0d504f-90e7-5af6-a1c1-802401392d39",
            "costCents": "21.6847200"
          },
          "cacheWriteTokens": 0,
          "cachedInputTokens": 154888,
          "pricingProvenance": {
            "source": "rate_card",
            "version": "openai-standard-2026-09-30",
            "evidence": "https://developers.openai.com/api/docs/pricing; standard processing assumed; short per-request context assumed; cache writes reported",
            "contextTier": "short",
            "serviceTier": "standard",
            "inputCentsPerMillion": "400.0000000",
            "outputCentsPerMillion": "2000.0000000",
            "cacheWriteCentsPerMillion": "500.0000000",
            "cachedInputCentsPerMillion": "40.0000000"
          },
          "providerRequestId": null,
          "accountingReceiptId": "3310dad9-f5d0-5e26-a915-b6453c3e7f44",
          "cacheAdjustedCostUsd": null,
          "accountingReceiptOwner": "native_producer",
          "accountingReceiptReady": true,
          "accountingReceiptSequence": 509,
          "accountingReceiptSourceId": "ca0d504f-90e7-5af6-a1c1-802401392d39",
          "accountingReceiptReceivedAt": "2026-11-06T18:20:51.532Z"
        }
      }
    ]
  },
  "workerTiming": {
    "version": 1,
    "scope": "worker",
    "status": "complete",
    "executionId": "everyday-workflows.runner-codex.daytona.recover-controller",
    "attempt": 1,
    "startedAt": "2026-11-06T18:18:26.959Z",
    "finishedAt": "2026-11-06T18:26:31.745Z",
    "segments": [
      {
        "phase": "setup",
        "startedAt": "2026-11-06T18:18:26.959Z",
        "finishedAt": "2026-11-06T18:19:27.744Z"
      },
      {
        "phase": "execution",
        "startedAt": "2026-11-06T18:19:27.744Z",
        "finishedAt": "2026-11-06T18:26:20.581Z"
      },
      {
        "phase": "cleanup",
        "startedAt": "2026-11-06T18:26:20.581Z",
        "finishedAt": "2026-11-06T18:26:20.943Z"
      },
      {
        "phase": "feedback",
        "startedAt": "2026-11-06T18:26:20.943Z",
        "finishedAt": "2026-11-06T18:26:21.318Z"
      },
      {
        "phase": "cleanup",
        "startedAt": "2026-11-06T18:26:21.318Z",
        "finishedAt": "2026-11-06T18:26:31.745Z"
      },
      {
        "phase": "finalization",
        "startedAt": "2026-11-06T18:26:31.745Z",
        "finishedAt": "2026-11-06T18:26:31.745Z"
      }
    ]
  },
  "startupReuse": [
    {
      "runId": "79d68244-7fad-4a50-940c-b8b0e2336385",
      "warmth": "unknown",
      "layers": {
        "environment": {
          "state": "unknown",
          "reason": "evidence_missing"
        },
        "workspace": {
          "state": "unknown",
          "reason": "evidence_missing"
        },
        "runner": {
          "state": "unknown",
          "reason": "evidence_missing"
        },
        "provider_process": {
          "state": "unknown",
          "reason": "evidence_missing"
        },
        "provider_session": {
          "state": "unknown",
          "reason": "evidence_missing"
        }
      },
      "providerLaunchCount": null
    },
    {
      "runId": "29a5eda7-2174-41b0-b06d-09ca9c5e050e",
      "warmth": "unknown",
      "layers": {
        "environment": {
          "state": "unknown",
          "reason": "evidence_missing"
        },
        "workspace": {
          "state": "unknown",
          "reason": "evidence_missing"
        },
        "runner": {
          "state": "unknown",
          "reason": "evidence_missing"
        },
        "provider_process": {
          "state": "unknown",
          "reason": "evidence_missing"
        },
        "provider_session": {
          "state": "unknown",
          "reason": "evidence_missing"
        }
      },
      "providerLaunchCount": null
    },
    {
      "runId": "c22bf549-14a9-4f88-88e2-989e7406d681",
      "warmth": "unknown",
      "layers": {
        "environment": {
          "state": "unknown",
          "reason": "evidence_missing"
        },
        "workspace": {
          "state": "unknown",
          "reason": "evidence_missing"
        },
        "runner": {
          "state": "unknown",
          "reason": "evidence_missing"
        },
        "provider_process": {
          "state": "unknown",
          "reason": "evidence_missing"
        },
        "provider_session": {
          "state": "unknown",
          "reason": "evidence_missing"
        }
      },
      "providerLaunchCount": null
    }
  ]
}