Test details19/19 checks · 1m 22s
No behavioral matcher failed.
See all behavioral checks (19)
| Result | Check | Detail |
|---|---|---|
| Pass | continuation.recorded-continuation | Initial and final turns must both be recorded. |
| Pass | continuation.initial.no-premature-output | initial: only a plan may exist before the required answer/approval; documents=, attachments=0, status=in_review |
| Pass | continuation.updated-output | Durable output must contain the user's current word, without the superseded or injected word. |
| Pass | continuation.completed-parent | Final parent status: done |
| Pass | continuation.successful-provider-turns | Every recorded turn succeeded in the selected runtime. |
| Pass | continuation.no-unrequested-children | No checkpoint may contain an unrequested child task. |
| Pass | continuation.lifecycle.evidence-present | Every checkpoint must retain lifecycle evidence from the public task API. |
| Pass | continuation.lifecycle.task-owner-preserved | Waiting and resuming retain the same task and assigned agent. |
| Pass | continuation.lifecycle.initial.durable-wait | Waiting must have an identifiable pending interaction, not only an assistant message. |
| Pass | continuation.lifecycle.initial.wait-state | A settled wait is in_review with no execution lock, retry, recovery or monitor. A bound native provider question may keep its paused run and lock. |
| Pass | continuation.lifecycle.final.no-active-path | Completed work has no live run, execution lock, scheduled retry, recovery or monitor. |
| Pass | continuation.lifecycle.final.no-pending-interaction | Completion has no unresolved interaction. |
| Pass | continuation.lifecycle.answer:580be468-768d-4f82-a469-d03c759a6e0b | Every observed pending question retains exactly one answered identity, including later questions. |
| Pass | continuation.lifecycle.final.preserved-runs | All intermediate run receipts survive in the final snapshot without duplicated or empty IDs. |
| Pass | continuation.necessary-question.form | One bound text-only question must show the required prompt and its explanation before delivery. |
| Pass | continuation.necessary-question.visible | The browser must observe the actual question and context, not only its title. |
| Pass | continuation.necessary-question.answer | One real user answer must remain attached to the unchanged question. |
| Pass | continuation.necessary-question.one-continuation | The answer must resume its bound provider run or admit exactly one bound semantic successor, without duplicate work. |
| Pass | continuation.necessary-question.result | The final reply must open this task's saved confirmation and show its exact answer. |
necessary-question.runner-codex.local.necessary-free-text
- Attempt
- 1
- Duration
- 1m 22s
- Agent runtime
- 52s
- Runtime
- native
- Provider
- codex
- Model
- gpt-6.1-sol
- Issue
- RUN-1
All invariants passed
| Run | Warmth | Environment/lease | Workspace | Runner | Provider process | Provider session | Provider launches |
|---|---|---|---|---|---|---|---|
a84fb6cf-9944-497e-9477-366adf777729 | unknown | unknown (evidence_missing) | unknown (evidence_missing) | unknown (evidence_missing) | unknown (evidence_missing) | unknown (evidence_missing) | unknown |
1f3618c8-9070-4ce8-bec8-8e643a272f71 | unknown | unknown (evidence_missing) | unknown (evidence_missing) | unknown (evidence_missing) | unknown (evidence_missing) | unknown (evidence_missing) | unknown |
| Result | Matcher | Expectation | Detail |
|---|---|---|---|
| Pass | json_path |
{"kind":"json_path","path":"continuation.recorded-continuation","expected":true} | Initial and final turns must both be recorded. |
| Pass | json_path |
{"kind":"json_path","path":"continuation.initial.no-premature-output","expected":true} | initial: only a plan may exist before the required answer/approval; documents=, attachments=0, status=in_review |
| Pass | json_path |
{"kind":"json_path","path":"continuation.updated-output","expected":true} | Durable output must contain the user's current word, without the superseded or injected word. |
| Pass | json_path |
{"kind":"json_path","path":"continuation.completed-parent","expected":true} | Final parent status: done |
| Pass | json_path |
{"kind":"json_path","path":"continuation.successful-provider-turns","expected":true} | Every recorded turn succeeded in the selected runtime. |
| Pass | json_path |
{"kind":"json_path","path":"continuation.no-unrequested-children","expected":true} | No checkpoint may contain an unrequested child task. |
| Pass | json_path |
{"kind":"json_path","path":"continuation.lifecycle.evidence-present","expected":true} | Every checkpoint must retain lifecycle evidence from the public task API. |
| Pass | json_path |
{"kind":"json_path","path":"continuation.lifecycle.task-owner-preserved","expected":true} | Waiting and resuming retain the same task and assigned agent. |
| Pass | json_path |
{"kind":"json_path","path":"continuation.lifecycle.initial.durable-wait","expected":true} | Waiting must have an identifiable pending interaction, not only an assistant message. |
| Pass | json_path |
{"kind":"json_path","path":"continuation.lifecycle.initial.wait-state","expected":true} | A settled wait is in_review with no execution lock, retry, recovery or monitor. A bound native provider question may keep its paused run and lock. |
| Pass | json_path |
{"kind":"json_path","path":"continuation.lifecycle.final.no-active-path","expected":true} | Completed work has no live run, execution lock, scheduled retry, recovery or monitor. |
| Pass | json_path |
{"kind":"json_path","path":"continuation.lifecycle.final.no-pending-interaction","expected":true} | Completion has no unresolved interaction. |
| Pass | json_path |
{"kind":"json_path","path":"continuation.lifecycle.answer:580be468-768d-4f82-a469-d03c759a6e0b","expected":true} | Every observed pending question retains exactly one answered identity, including later questions. |
| Pass | json_path |
{"kind":"json_path","path":"continuation.lifecycle.final.preserved-runs","expected":true} | All intermediate run receipts survive in the final snapshot without duplicated or empty IDs. |
| Pass | json_path |
{"kind":"json_path","path":"continuation.necessary-question.form","expected":true} | One bound text-only question must show the required prompt and its explanation before delivery. |
| Pass | json_path |
{"kind":"json_path","path":"continuation.necessary-question.visible","expected":true} | The browser must observe the actual question and context, not only its title. |
| Pass | json_path |
{"kind":"json_path","path":"continuation.necessary-question.answer","expected":true} | One real user answer must remain attached to the unchanged question. |
| Pass | json_path |
{"kind":"json_path","path":"continuation.necessary-question.one-continuation","expected":true} | The answer must resume its bound provider run or admit exactly one bound semantic successor, without duplicate work. |
| Pass | json_path |
{"kind":"json_path","path":"continuation.necessary-question.result","expected":true} | The final reply must open this task's saved confirmation and show its exact answer. |
Usage and billing metadata
{
"billing": {
"llm": {
"runCount": 2,
"runsWithTokenUsage": 2,
"runsWithReportedCost": 0,
"inputTokens": 69716,
"outputTokens": 1568,
"cachedInputTokens": 434195,
"totalTokens": 505479,
"reportedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 51886,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "a84fb6cf-9944-497e-9477-366adf777729",
"usage": {
"model": "gpt-6.1-sol",
"biller": "openai",
"costUsd": null,
"provider": "openai",
"costStatus": "estimated",
"billingType": "metered_api",
"inputTokens": 36092,
"ledgerScope": {
"issueId": "acb5becf-09ec-4c94-b259-8b6eb6e7d9a1",
"projectId": null,
"billingCode": null
},
"usageSource": "per_run",
"costUsdExact": "0.108456600",
"freshSession": false,
"outputTokens": 922,
"usageByModel": null,
"sessionReused": true,
"budgetDispatch": {
"admittedAt": "2026-10-21T14:47:08.867Z",
"handedOffAt": "2026-10-21T14:47:08.902Z",
"reservationId": "03db837f-297a-4de6-b671-f25129813681",
"recoveryLeaseOwner": null
},
"budgetExposure": {
"sequence": 6,
"sourceId": "697e4a0d-0ecb-4141-bf74-4f76ae9c55b0",
"costCents": "10.8456600"
},
"rawInputTokens": 36092,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": false,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:d86546ada0e2727dd7e6f21bd23c63a2d832a5001c8adb255a0906f89fb553f6",
"changedCategories": [],
"taskSessionReused": true,
"fingerprintVersion": 1,
"taskSessionAvailable": true,
"storedFingerprintPresent": true
},
"version": 1,
"workspace": {
"action": "reuse",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": true,
"nextFingerprint": "v1:sha256:cdfeeff8aa564ce97d967bb60197e344137522996d1174cc2d1de2747db20738",
"workspaceReused": true,
"activeWorkspaceId": "e9eea465-4477-4f13-8c9f-3d7ba8e8b945",
"changedCategories": [],
"storedFingerprint": "v1:sha256:cdfeeff8aa564ce97d967bb60197e344137522996d1174cc2d1de2747db20738",
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": "e9eea465-4477-4f13-8c9f-3d7ba8e8b945",
"configSnapshotRefreshed": false,
"storedFingerprintPresent": true
}
},
"rawOutputTokens": 922,
"cacheWriteTokens": 0,
"cachedInputTokens": 270526,
"pricingProvenance": {
"source": "rate_card",
"version": "openai-standard-2026-09-30",
"evidence": "https://developers.openai.com/api/docs/pricing; standard processing assumed; short per-request context assumed; cache writes reported",
"contextTier": "short",
"serviceTier": "standard",
"inputCentsPerMillion": "200.0000000",
"outputCentsPerMillion": "1000.0000000",
"cacheWriteCentsPerMillion": "250.0000000",
"cachedInputCentsPerMillion": "10.0000000"
},
"providerRequestId": null,
"taskSessionReused": true,
"persistedSessionId": "01a15eed-8674-7ff0-99ed-4bc86f8b93e8",
"accountingReceiptId": "9b52b6e9-ee7d-4945-95fa-bce145d8019e",
"cacheAdjustedCostUsd": null,
"rawCachedInputTokens": 270526,
"sessionRotationReason": null,
"accountingReceiptReady": true,
"rawInputIncludesCached": false,
"accountingReceiptSequence": 6,
"accountingReceiptSourceId": "697e4a0d-0ecb-4141-bf74-4f76ae9c55b0",
"accountingReceiptReceivedAt": "2026-10-21T14:47:25.468Z"
}
},
{
"runId": "1f3618c8-9070-4ce8-bec8-8e643a272f71",
"usage": {
"model": "gpt-6.1-sol",
"biller": "openai",
"costUsd": null,
"provider": "openai",
"costStatus": "estimated",
"billingType": "metered_api",
"inputTokens": 33624,
"ledgerScope": {
"issueId": "acb5becf-09ec-4c94-b259-8b6eb6e7d9a1",
"projectId": null,
"billingCode": null
},
"usageSource": "per_run",
"costUsdExact": "0.090074900",
"freshSession": true,
"outputTokens": 646,
"usageByModel": null,
"sessionReused": false,
"budgetDispatch": {
"admittedAt": "2026-10-21T14:46:25.470Z",
"handedOffAt": "2026-10-21T14:46:25.490Z",
"reservationId": "41e5fc1d-0615-4cbd-a657-50fc5feb6ead",
"recoveryLeaseOwner": null
},
"budgetExposure": {
"sequence": 10,
"sourceId": "3491d04f-f3ca-4999-82ba-0ce5333c45c8",
"costCents": "9.0074900"
},
"rawInputTokens": 33624,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:d86546ada0e2727dd7e6f21bd23c63a2d832a5001c8adb255a0906f89fb553f6",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:cdfeeff8aa564ce97d967bb60197e344137522996d1174cc2d1de2747db20738",
"workspaceReused": false,
"activeWorkspaceId": "e9eea465-4477-4f13-8c9f-3d7ba8e8b945",
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 646,
"cacheWriteTokens": 0,
"cachedInputTokens": 163669,
"pricingProvenance": {
"source": "rate_card",
"version": "openai-standard-2026-09-30",
"evidence": "https://developers.openai.com/api/docs/pricing; standard processing assumed; short per-request context assumed; cache writes reported",
"contextTier": "short",
"serviceTier": "standard",
"inputCentsPerMillion": "200.0000000",
"outputCentsPerMillion": "1000.0000000",
"cacheWriteCentsPerMillion": "250.0000000",
"cachedInputCentsPerMillion": "10.0000000"
},
"providerRequestId": null,
"taskSessionReused": false,
"persistedSessionId": "01a15eed-8674-7ff0-99ed-4bc86f8b93e8",
"accountingReceiptId": "3317fba6-fc55-4bf2-b00e-bbd3c0d80afa",
"cacheAdjustedCostUsd": null,
"rawCachedInputTokens": 163669,
"sessionRotationReason": null,
"accountingReceiptReady": true,
"rawInputIncludesCached": false,
"accountingReceiptSequence": 10,
"accountingReceiptSourceId": "3491d04f-f3ca-4999-82ba-0ce5333c45c8",
"accountingReceiptReceivedAt": "2026-10-21T14:46:58.493Z"
}
}
]
}
}