followup-stop-resume
failed
Failed checks:
- followupStopResume.one-explicit-resumption — Only one user-triggered successor may complete the original task after Stop.
- followupStopResume.retained-context-workspace-tools — The independently seeded context, earlier follow-up, workspace, production instructions and tool contract must survive without being restated in the resume message.
- followupStopResume.accessible-resumed-result — One receipt-bound final reply must expose the independently verified result without a pending question.
See all behavioral checks (5)
| Result | Check | Detail |
|---|---|---|
| Pass | followupStopResume.active-followup-before-stop | One ordinary user follow-up must persist while the original result-free provider run is still active. |
| Pass | followupStopResume.stop-remains-authoritative | The acknowledged Stop must retain one cancelled run with no automatic continuation throughout the recorded quiet window before a real user resumes. |
| Fail | followupStopResume.one-explicit-resumption | Only one user-triggered successor may complete the original task after Stop. |
| Fail | followupStopResume.retained-context-workspace-tools | The independently seeded context, earlier follow-up, workspace, production instructions and tool contract must survive without being restated in the resume message. |
| Fail | followupStopResume.accessible-resumed-result | One receipt-bound final reply must expose the independently verified result without a pending question. |
candidate failure
Timed out waiting for one explicit resumed admission with verified output; the observed state did not satisfy the condition. See the saved state evidence.
Test details2/5 checks · 11m 31s
Tokens26,253 in · 477 out75,276 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered23s agent
followup-stop-resume.runner-codex.local.followup-stop-resume
- Attempt
- 1
- Duration
- 11m 31s
- Agent runtime
- 23s
- Runtime
- native
- Provider
- codex
- Model
- gpt-6.1-sol
- Issue
- RUN-1
No result artifact was uploaded
| Run | Warmth | Environment/lease | Workspace | Runner | Provider process | Provider session | Provider launches |
|---|---|---|---|---|---|---|---|
43bb2d93-5203-49c5-8ee6-dc58b5ea2869 | unknown | unknown (evidence_missing) | unknown (evidence_missing) | unknown (evidence_missing) | unknown (evidence_missing) | unknown (evidence_missing) | unknown |
| Result | Matcher | Expectation | Detail |
|---|---|---|---|
| Pass | json_path |
{"kind":"json_path","path":"followupStopResume.active-followup-before-stop","expected":true} | One ordinary user follow-up must persist while the original result-free provider run is still active. |
| Pass | json_path |
{"kind":"json_path","path":"followupStopResume.stop-remains-authoritative","expected":true} | The acknowledged Stop must retain one cancelled run with no automatic continuation throughout the recorded quiet window before a real user resumes. |
| Fail | json_path |
{"kind":"json_path","path":"followupStopResume.one-explicit-resumption","expected":true} | Only one user-triggered successor may complete the original task after Stop. |
| Fail | json_path |
{"kind":"json_path","path":"followupStopResume.retained-context-workspace-tools","expected":true} | The independently seeded context, earlier follow-up, workspace, production instructions and tool contract must survive without being restated in the resume message. |
| Fail | json_path |
{"kind":"json_path","path":"followupStopResume.accessible-resumed-result","expected":true} | One receipt-bound final reply must expose the independently verified result without a pending question. |
Usage and billing metadata
{
"billing": {
"llm": {
"runCount": 1,
"runsWithTokenUsage": 1,
"runsWithReportedCost": 0,
"inputTokens": 26253,
"outputTokens": 477,
"cachedInputTokens": 75276,
"totalTokens": 102006,
"reportedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 23384,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"model": "gpt-6.1-sol",
"biller": "openai",
"costUsd": null,
"provider": "openai",
"costStatus": "estimated",
"billingType": "metered_api",
"inputTokens": 26253,
"ledgerScope": {
"issueId": "838693ff-4783-45e5-8a4a-40c967a534cd",
"projectId": "ad9c0077-9537-42a0-9c71-2a50105dac67",
"billingCode": null
},
"usageSource": "per_run",
"costUsdExact": "0.064803600",
"outputTokens": 477,
"usageByModel": null,
"budgetDispatch": {
"admittedAt": "2026-10-21T16:47:59.899Z",
"handedOffAt": "2026-10-21T16:47:59.921Z",
"reservationId": "e9f4f5f6-a7bd-4c74-951a-ea0f39fa1523",
"recoveryLeaseOwner": null
},
"budgetExposure": {
"sequence": 5,
"sourceId": "9718106b-0b69-45c8-82b9-64007d65277e",
"costCents": "6.4803600"
},
"cacheWriteTokens": 0,
"cachedInputTokens": 75276,
"pricingProvenance": {
"source": "rate_card",
"version": "openai-standard-2026-09-30",
"evidence": "https://developers.openai.com/api/docs/pricing; standard processing assumed; short per-request context assumed; cache writes reported",
"contextTier": "short",
"serviceTier": "standard",
"inputCentsPerMillion": "200.0000000",
"outputCentsPerMillion": "1000.0000000",
"cacheWriteCentsPerMillion": "250.0000000",
"cachedInputCentsPerMillion": "10.0000000"
},
"providerRequestId": null,
"accountingReceiptId": "16e29e2f-18d0-4d08-9a95-1ceb30a125ae",
"cacheAdjustedCostUsd": null,
"accountingReceiptReady": true,
"accountingReceiptSequence": 5,
"accountingReceiptSourceId": "9718106b-0b69-45c8-82b9-64007d65277e",
"accountingReceiptReceivedAt": "2026-10-21T16:48:23.756Z"
}
}