Test details9/9 checks · 1m 37s
No behavioral matcher failed.
See all behavioral checks (9)
| Result | Check | Detail |
|---|---|---|
| Pass | chat.complete-runtime-observation | Saved agent configuration, attribution and actual rendered replies are independently required. |
| Pass | chat.saved-requested-manager | Morgan reports to the real same-company Riley. |
| Pass | chat.reporting-tree-valid | Every reporting chain terminates without a cycle or missing company manager. |
| Pass | chat.unrelated-config-and-tasks-retained | Changing the manager preserves accounts, permissions and existing tasks. |
| Pass | chat.attributed-agent-change | The saved reporting-line change is independently attributed to the actual agent. |
| Pass | chat.catalog-complete-conditions | No known catalog condition is omitted. |
| Pass | chat.catalog-original-human-query | The persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared. |
| Pass | chat.catalog-query-attachment-receipts | Only declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes. |
| Pass | chat.catalog-bounded-native-runs | Observed provider runs satisfy declared count, company, native runtime and allowed outcome bounds. |
Worker phase timing: not captured.
Feedback was not captured for this attempt.
chat-features.runner-opencode.local.agents.change-manager
- Attempt
- 1
- Duration
- 1m 37s
- Agent runtime
- 36s
- Runtime
- native
- Provider
- opencode
- Model
- openrouter/deepseek/deepseek-v4.1-flash-1017
All invariants passed
| Run | Warmth | Environment/lease | Workspace | Runner | Provider process | Provider session | Provider launches |
|---|---|---|---|---|---|---|---|
4dc17692-b6ec-4206-9efc-72a15f28e97d | unknown | unknown (evidence_missing) | unknown (evidence_missing) | unknown (evidence_missing) | unknown (evidence_missing) | unknown (evidence_missing) | unknown |
| Result | Matcher | Expectation | Detail |
|---|---|---|---|
| Pass | json_path |
{"kind":"json_path","path":"chat.complete-runtime-observation","expected":true} | Saved agent configuration, attribution and actual rendered replies are independently required. |
| Pass | json_path |
{"kind":"json_path","path":"chat.saved-requested-manager","expected":true} | Morgan reports to the real same-company Riley. |
| Pass | json_path |
{"kind":"json_path","path":"chat.reporting-tree-valid","expected":true} | Every reporting chain terminates without a cycle or missing company manager. |
| Pass | json_path |
{"kind":"json_path","path":"chat.unrelated-config-and-tasks-retained","expected":true} | Changing the manager preserves accounts, permissions and existing tasks. |
| Pass | json_path |
{"kind":"json_path","path":"chat.attributed-agent-change","expected":true} | The saved reporting-line change is independently attributed to the actual agent. |
| Pass | json_path |
{"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} | No known catalog condition is omitted. |
| Pass | json_path |
{"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} | The persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared. |
| Pass | json_path |
{"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} | Only declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes. |
| Pass | json_path |
{"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} | Observed provider runs satisfy declared count, company, native runtime and allowed outcome bounds. |
Usage, billing and timing metadata
{
"billing": {
"llm": {
"runCount": 1,
"runsWithTokenUsage": 1,
"runsWithReportedCost": 0,
"runsWithEstimatedCost": 0,
"runsWithPartialReportedCost": 0,
"inputTokens": 63862,
"outputTokens": 753,
"cachedInputTokens": 136448,
"totalTokens": 201063,
"reportedCostUsd": 0,
"estimatedCostUsd": 0,
"costStatus": "unpriced"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": 35779,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": null,
"workerTiming": null
}