Failed checks:
- message_occurrences — expected {"kind":"message_occurrences","expected":"PAPERCLIP_E2E_WARM_T1_d16bbd10ed81-1","count":1}; observed 0
- message_ordered — expected {"kind":"message_ordered","expected":["PAPERCLIP_E2E_WARM_T1_d16bbd10ed81-1","PAPERCLIP_E2E_WARM_T2_d16bbd10ed81-1","PAPERCLIP_E2E_WARM_T3_d16bbd10ed81-1"]}; observed "PAPERCLIP_E2E_WARM_T2_d16bbd10ed81-1\nPrepared Warm continuity turn 3 file for this response.\nPAPERCLIP_E2E_WARM_T3_d16bbd10ed81-1"
See all behavioral checks (9)
| Result | Check | Detail |
|---|---|---|
| Fail | message_occurrences | expected {"kind":"message_occurrences","expected":"PAPERCLIP_E2E_WARM_T1_d16bbd10ed81-1","count":1}; observed 0 |
| Pass | message_occurrences | matched |
| Pass | message_occurrences | matched |
| Fail | message_ordered | expected {"kind":"message_ordered","expected":["PAPERCLIP_E2E_WARM_T1_d16bbd10ed81-1","PAPERCLIP_E2E_WARM_T2_d16bbd10ed81-1","PAPERCLIP_E2E_WARM_T3_d16bbd10ed81-1"]}; observed "PAPERCLIP_E2E_WARM_T2_d16bbd10ed81-1\nPrepared Warm continuity turn 3 file for this response.\nPAPERCLIP_E2E_WARM_T3_d16bbd10ed81-1" |
| Pass | file_exact | matched |
| Pass | issue_status | matched |
| Pass | run_status | matched |
| Pass | runtime_mode | matched |
| Pass | environment | matched |
candidate failure
Test details7/9 checks · 2m 18s
- Tested URL
- http://127.0.0.1:39689/
- Environment
- Daytona warm reusable sandbox
- Model
- gpt-5.6-sol
- Runtime
- native · codex
- Failexpected {"kind":"message_occurrences","expected":"PAPERCLIP_E2E_WARM_T1_d16bbd10ed81-1","count":1}; observed 0
- Passmatched
- Passmatched
- Failexpected {"kind":"message_ordered","expected":["PAPERCLIP_E2E_WARM_T1_d16bbd10ed81-1","PAPERCLIP_E2E_WARM_T2_d16bbd10ed81-1","PAPERCLIP_E2E_WARM_T3_d16bbd10ed81-1"]}; observed "PAPERCLIP_E2E_WARM_T2_d16bbd10ed81-1\nPrepared Warm continuity turn 3 file for this response.\nPAPERCLIP_E2E_WARM_T3_d16bbd10ed81-1"
- Passmatched
- Passmatched
- Passmatched
- Passmatched
- Passmatched
Task chat
RUN-1: Create warm continuity turn 1 files · 21 entries
Recorded task brief, messages, requests and answers, with native agent progress when available. This is a read-only recording of the saved task conversation.
Diagnostics
Worker phase timing: complete.
Feedback: 0 complaints · 0 suggestions · 0 distinct items; see campaign feedback review. Saved-feedback collection: complete; invocation coverage: complete. Tool receipts: 0 failed · 0 unresolved. Full bodies: access-controlled snapshots/agent-feedback.json or snapshots/agent-feedback-recovered.json.
daytona-warm-continuity.runner-codex.daytona.warm-three-turn
- Attempt
- 1
- Duration
- 2m 18s
- Agent runtime
- 1m 34s
- Environment lease
- 1m 58s
- Runtime
- native
- Provider
- codex
- Model
- gpt-5.6-sol
- Issue
- RUN-1
| Turn | Run | Lease | Scheduler | Run duration | Final settlement (legacy response field) |
|---|---|---|---|---|---|
| 1 | 357989ab-8e07-4564-be35-68a2845678a2 |
created | 4s | 34s | 38s |
| 2 | c8ffdcee-7d64-4079-a8d4-6ce6f3fc5398 |
resumed | 343ms | 28s | 28s |
| 3 | 7411c59b-bb49-4a3a-bfc9-832454b22c03 |
resumed | 348ms | 32s | 32s |
| Run | Warmth | Environment/lease | Workspace | Runner | Provider process | Provider session | Provider launches |
|---|---|---|---|---|---|---|---|
357989ab-8e07-4564-be35-68a2845678a2 | unknown | fresh (created) | fresh (created) | fresh (created) | unknown (evidence_missing) | fresh (created) | unknown |
c8ffdcee-7d64-4079-a8d4-6ce6f3fc5398 | partial_reuse | reused (verified_reuse) | reused (verified_reuse) | reused (verified_reuse) | unknown (evidence_missing) | reused (verified_reuse) | unknown |
7411c59b-bb49-4a3a-bfc9-832454b22c03 | partial_reuse | reused (verified_reuse) | reused (verified_reuse) | reused (verified_reuse) | unknown (evidence_missing) | reused (verified_reuse) | unknown |
| Result | Matcher | Expectation | Detail |
|---|---|---|---|
| Fail | message_occurrences |
{"kind":"message_occurrences","expected":"PAPERCLIP_E2E_WARM_T1_d16bbd10ed81-1","count":1} | expected {"kind":"message_occurrences","expected":"PAPERCLIP_E2E_WARM_T1_d16bbd10ed81-1","count":1}; observed 0 |
| Pass | message_occurrences |
{"kind":"message_occurrences","expected":"PAPERCLIP_E2E_WARM_T2_d16bbd10ed81-1","count":1} | matched |
| Pass | message_occurrences |
{"kind":"message_occurrences","expected":"PAPERCLIP_E2E_WARM_T3_d16bbd10ed81-1","count":1} | matched |
| Fail | message_ordered |
{"kind":"message_ordered","expected":["PAPERCLIP_E2E_WARM_T1_d16bbd10ed81-1","PAPERCLIP_E2E_WARM_T2_d16bbd10ed81-1","PAPERCLIP_E2E_WARM_T3_d16bbd10ed81-1"]} | expected {"kind":"message_ordered","expected":["PAPERCLIP_E2E_WARM_T1_d16bbd10ed81-1","PAPERCLIP_E2E_WARM_T2_d16bbd10ed81-1","PAPERCLIP_E2E_WARM_T3_d16bbd10ed81-1"]}; observed "PAPERCLIP_E2E_WARM_T2_d16bbd10ed81-1\nPrepared Warm continuity turn 3 file for this response.\nPAPERCLIP_E2E_WARM_T3_d16bbd10ed81-1" |
| Pass | file_exact |
{"kind":"file_exact","path":"daytona-warm-d16bbd10ed81-1.txt","expected":"T1-d16bbd10ed81-1\nT2-d16bbd10ed81-1\nT3-d16bbd10ed81-1\n"} | matched |
| Pass | issue_status |
{"kind":"issue_status","expected":"done"} | matched |
| Pass | run_status |
{"kind":"run_status","expected":"succeeded"} | matched |
| Pass | runtime_mode |
{"kind":"runtime_mode","expected":"native"} | matched |
| Pass | environment |
{"kind":"environment","expected":"daytona"} | matched |
Usage, billing and timing metadata
{
"billing": {
"llm": {
"runCount": 3,
"runsWithTokenUsage": 3,
"runsWithReportedCost": 0,
"runsWithEstimatedCost": 3,
"runsWithPartialReportedCost": 0,
"inputTokens": 33331,
"outputTokens": 4896,
"cachedInputTokens": 574523,
"totalTokens": 612750,
"reportedCostUsd": 0,
"estimatedCostUsd": 0.4610532,
"costStatus": "estimated"
},
"runtime": {
"provider": "daytona",
"agentRunDurationMs": 93592,
"leaseDurationMs": 117686,
"leaseCount": 4,
"cpuCores": 4,
"memoryGiB": 4,
"diskGiB": 10,
"estimatedListCostUsd": 0.0087440698,
"costStatus": "estimated",
"costSource": "daytona_public_list_price",
"pricingAsOf": "2026-08-27",
"pricingUrl": "https://www.daytona.io/pricing"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0.0087440698,
"observedAndEstimatedCostUsd": 0.4697972698,
"complete": true
},
"rawUsage": {
"runs": [
{
"runId": "7411c59b-bb49-4a3a-bfc9-832454b22c03",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": null,
"provider": "openai",
"costStatus": "estimated",
"billingType": "metered_api",
"inputTokens": 3944,
"ledgerScope": {
"issueId": "10b5db92-ae76-4869-a04f-edc5c1d65128",
"projectId": "f436bebf-f464-4a4b-96d2-30bc789c94f9",
"billingCode": null
},
"usageSource": "per_run",
"costUsdExact": "0.166171200",
"freshSession": false,
"outputTokens": 1867,
"usageByModel": null,
"sessionReused": true,
"budgetDispatch": {
"admittedAt": "2026-11-02T18:03:18.712Z",
"handedOffAt": "2026-11-02T18:03:18.723Z",
"reservationId": "cb0629e5-bb74-42d2-ba15-08d6b47f46fe",
"recoveryLeaseOwner": null
},
"budgetExposure": {
"sequence": 239,
"sourceId": "2487f2d4-e0e9-5cc5-a634-c682ee826132",
"costCents": "16.6171200"
},
"rawInputTokens": 3944,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:939eb800b3898ee972e15223657a4e4155f6b0fee2765096f7082662704c9317",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "reuse",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": true,
"nextFingerprint": "v1:sha256:04415b26251d2c9a0021115cbfcd8bc8fcef3b0ed8179aaf0ec21e05aecd0d7e",
"workspaceReused": true,
"activeWorkspaceId": "ac358e00-12fc-4120-bce6-d198e35c6f5c",
"changedCategories": [],
"storedFingerprint": "v1:sha256:04415b26251d2c9a0021115cbfcd8bc8fcef3b0ed8179aaf0ec21e05aecd0d7e",
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": "ac358e00-12fc-4120-bce6-d198e35c6f5c",
"configSnapshotRefreshed": false,
"storedFingerprintPresent": true
}
},
"rawOutputTokens": 1867,
"cacheWriteTokens": 0,
"cachedInputTokens": 282638,
"pricingProvenance": {
"source": "rate_card",
"version": "openai-standard-2026-09-30",
"evidence": "https://developers.openai.com/api/docs/pricing; standard processing assumed; short per-request context assumed; cache writes reported",
"contextTier": "short",
"serviceTier": "standard",
"inputCentsPerMillion": "400.0000000",
"outputCentsPerMillion": "2000.0000000",
"cacheWriteCentsPerMillion": "500.0000000",
"cachedInputCentsPerMillion": "40.0000000"
},
"providerRequestId": null,
"taskSessionReused": true,
"persistedSessionId": "01a19d6d-0c82-7fb0-85b6-f4bcb4e5aac8",
"accountingReceiptId": "87d40ab4-397a-5b27-a77f-d1a764fae5e0",
"cacheAdjustedCostUsd": null,
"rawCachedInputTokens": 282638,
"sessionRotationReason": null,
"accountingReceiptOwner": "native_producer",
"accountingReceiptReady": true,
"rawInputIncludesCached": false,
"accountingReceiptSequence": 239,
"accountingReceiptSourceId": "2487f2d4-e0e9-5cc5-a634-c682ee826132",
"accountingReceiptReceivedAt": "2026-11-02T18:03:45.223Z"
}
},
{
"runId": "c8ffdcee-7d64-4079-a8d4-6ce6f3fc5398",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": null,
"provider": "openai",
"costStatus": "estimated",
"billingType": "metered_api",
"inputTokens": 3196,
"ledgerScope": {
"issueId": "10b5db92-ae76-4869-a04f-edc5c1d65128",
"projectId": "f436bebf-f464-4a4b-96d2-30bc789c94f9",
"billingCode": null
},
"usageSource": "per_run",
"costUsdExact": "0.109970400",
"freshSession": false,
"outputTokens": 1517,
"usageByModel": null,
"sessionReused": true,
"budgetDispatch": {
"admittedAt": "2026-11-02T18:02:43.339Z",
"handedOffAt": "2026-11-02T18:02:43.351Z",
"reservationId": "7657b9c7-0ebb-46c3-907c-405b309c74ce",
"recoveryLeaseOwner": null
},
"budgetExposure": {
"sequence": 214,
"sourceId": "9a9a3284-4740-5778-aa22-257e2f5ae9db",
"costCents": "10.9970400"
},
"rawInputTokens": 3196,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:939eb800b3898ee972e15223657a4e4155f6b0fee2765096f7082662704c9317",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "reuse",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": true,
"nextFingerprint": "v1:sha256:04415b26251d2c9a0021115cbfcd8bc8fcef3b0ed8179aaf0ec21e05aecd0d7e",
"workspaceReused": true,
"activeWorkspaceId": "ac358e00-12fc-4120-bce6-d198e35c6f5c",
"changedCategories": [],
"storedFingerprint": "v1:sha256:04415b26251d2c9a0021115cbfcd8bc8fcef3b0ed8179aaf0ec21e05aecd0d7e",
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": "ac358e00-12fc-4120-bce6-d198e35c6f5c",
"configSnapshotRefreshed": false,
"storedFingerprintPresent": true
}
},
"rawOutputTokens": 1517,
"cacheWriteTokens": 0,
"cachedInputTokens": 167116,
"pricingProvenance": {
"source": "rate_card",
"version": "openai-standard-2026-09-30",
"evidence": "https://developers.openai.com/api/docs/pricing; standard processing assumed; short per-request context assumed; cache writes reported",
"contextTier": "short",
"serviceTier": "standard",
"inputCentsPerMillion": "400.0000000",
"outputCentsPerMillion": "2000.0000000",
"cacheWriteCentsPerMillion": "500.0000000",
"cachedInputCentsPerMillion": "40.0000000"
},
"providerRequestId": null,
"taskSessionReused": true,
"persistedSessionId": "01a19d6d-0c82-7fb0-85b6-f4bcb4e5aac8",
"accountingReceiptId": "cb3c0809-d19b-5956-a4fd-46572a7cb57c",
"cacheAdjustedCostUsd": null,
"rawCachedInputTokens": 167116,
"sessionRotationReason": null,
"accountingReceiptOwner": "native_producer",
"accountingReceiptReady": true,
"rawInputIncludesCached": false,
"accountingReceiptSequence": 214,
"accountingReceiptSourceId": "9a9a3284-4740-5778-aa22-257e2f5ae9db",
"accountingReceiptReceivedAt": "2026-11-02T18:03:05.500Z"
}
},
{
"runId": "357989ab-8e07-4564-be35-68a2845678a2",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": null,
"provider": "openai",
"costStatus": "estimated",
"billingType": "metered_api",
"inputTokens": 26191,
"ledgerScope": {
"issueId": "10b5db92-ae76-4869-a04f-edc5c1d65128",
"projectId": "f436bebf-f464-4a4b-96d2-30bc789c94f9",
"billingCode": null
},
"usageSource": "per_run",
"costUsdExact": "0.184911600",
"outputTokens": 1512,
"usageByModel": null,
"budgetDispatch": {
"admittedAt": "2026-11-02T18:02:06.456Z",
"handedOffAt": "2026-11-02T18:02:06.467Z",
"reservationId": "27bf3e67-cc3b-4eaf-aa95-ff5ff1033d94",
"recoveryLeaseOwner": null
},
"budgetExposure": {
"sequence": 213,
"sourceId": "63d4f60a-c2a0-5565-afa1-6a0343ab23df",
"costCents": "18.4911600"
},
"cacheWriteTokens": 0,
"cachedInputTokens": 124769,
"pricingProvenance": {
"source": "rate_card",
"version": "openai-standard-2026-09-30",
"evidence": "https://developers.openai.com/api/docs/pricing; standard processing assumed; short per-request context assumed; cache writes reported",
"contextTier": "short",
"serviceTier": "standard",
"inputCentsPerMillion": "400.0000000",
"outputCentsPerMillion": "2000.0000000",
"cacheWriteCentsPerMillion": "500.0000000",
"cachedInputCentsPerMillion": "40.0000000"
},
"providerRequestId": null,
"accountingReceiptId": "95acfd81-b106-5b63-ad33-2d38230fd7f4",
"cacheAdjustedCostUsd": null,
"accountingReceiptOwner": "native_producer",
"accountingReceiptReady": true,
"accountingReceiptSequence": 213,
"accountingReceiptSourceId": "63d4f60a-c2a0-5565-afa1-6a0343ab23df",
"accountingReceiptReceivedAt": "2026-11-02T18:02:30.001Z"
}
}
]
},
"workerTiming": {
"version": 1,
"scope": "worker",
"status": "complete",
"executionId": "daytona-warm-continuity.runner-codex.daytona.warm-three-turn",
"attempt": 1,
"startedAt": "2026-11-02T18:01:43.102Z",
"finishedAt": "2026-11-02T18:04:01.193Z",
"segments": [
{
"phase": "setup",
"startedAt": "2026-11-02T18:01:43.102Z",
"finishedAt": "2026-11-02T18:01:46.698Z"
},
{
"phase": "execution",
"startedAt": "2026-11-02T18:01:46.698Z",
"finishedAt": "2026-11-02T18:03:56.259Z"
},
{
"phase": "cleanup",
"startedAt": "2026-11-02T18:03:56.259Z",
"finishedAt": "2026-11-02T18:03:56.460Z"
},
{
"phase": "feedback",
"startedAt": "2026-11-02T18:03:56.460Z",
"finishedAt": "2026-11-02T18:03:56.683Z"
},
{
"phase": "cleanup",
"startedAt": "2026-11-02T18:03:56.683Z",
"finishedAt": "2026-11-02T18:04:01.193Z"
},
{
"phase": "finalization",
"startedAt": "2026-11-02T18:04:01.193Z",
"finishedAt": "2026-11-02T18:04:01.193Z"
}
]
},
"startupReuse": [
{
"runId": "357989ab-8e07-4564-be35-68a2845678a2",
"warmth": "unknown",
"layers": {
"environment": {
"state": "fresh",
"reason": "created"
},
"workspace": {
"state": "fresh",
"reason": "created"
},
"runner": {
"state": "fresh",
"reason": "created"
},
"provider_process": {
"state": "unknown",
"reason": "evidence_missing"
},
"provider_session": {
"state": "fresh",
"reason": "created"
}
},
"providerLaunchCount": null
},
{
"runId": "c8ffdcee-7d64-4079-a8d4-6ce6f3fc5398",
"warmth": "partial_reuse",
"layers": {
"environment": {
"state": "reused",
"reason": "verified_reuse"
},
"workspace": {
"state": "reused",
"reason": "verified_reuse"
},
"runner": {
"state": "reused",
"reason": "verified_reuse"
},
"provider_process": {
"state": "unknown",
"reason": "evidence_missing"
},
"provider_session": {
"state": "reused",
"reason": "verified_reuse"
}
},
"providerLaunchCount": null
},
{
"runId": "7411c59b-bb49-4a3a-bfc9-832454b22c03",
"warmth": "partial_reuse",
"layers": {
"environment": {
"state": "reused",
"reason": "verified_reuse"
},
"workspace": {
"state": "reused",
"reason": "verified_reuse"
},
"runner": {
"state": "reused",
"reason": "verified_reuse"
},
"provider_process": {
"state": "unknown",
"reason": "evidence_missing"
},
"provider_session": {
"state": "reused",
"reason": "verified_reuse"
}
},
"providerLaunchCount": null
}
]
}