access.sign-in
failed
No behavioral matcher failed. The overall failure came from a separate run, cleanup, or evidence check.
See all behavioral checks (6)
| Result | Check | Detail |
|---|---|---|
| Pass | boundary.real-invalidated-human-session | A previously usable real human session is revoked by the server; the expired browser cannot read or compose in its conversation. |
| Pass | boundary.configured-safe-sign-in-return | The ordinary configured sign-in form authenticates the same person and returns to the same real company conversation. |
| Pass | boundary.authentication-retains-resource-checks | A different genuinely signed-in nonmember remains unable to access either the company or the original conversation. |
| Pass | boundary.no-expired-query-or-dispatch | The boundary retains unsent intent: no native run or extra human/agent comment is admitted before or after authentication. |
| Pass | boundary.boundary-complete-conditions | Every required public boundary phase is implemented. |
| Pass | boundary.boundary-declared-agent-dispatch | Actual observed provider admissions match the boundary's declared run bounds; nonexistent chat is never credited. |
permanent infrastructure
Required evidence missing: final-state.png, snapshots/fixtures.json, snapshots/api-state.json
Test details6/6 checks · 34s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent
Worker phase timing: not captured.
Feedback was not captured for this attempt.
chat-features.runner-opencode.local.access.sign-in
- Attempt
- 1
- Duration
- 34s
- Agent runtime
- Unknown
- Runtime
- native
- Provider
- opencode
- Model
- openrouter/deepseek/deepseek-v4.1-flash-1017
No result artifact was uploaded
| Result | Matcher | Expectation | Detail |
|---|---|---|---|
| Pass | json_path |
{"kind":"json_path","path":"boundary.real-invalidated-human-session","expected":true} | A previously usable real human session is revoked by the server; the expired browser cannot read or compose in its conversation. |
| Pass | json_path |
{"kind":"json_path","path":"boundary.configured-safe-sign-in-return","expected":true} | The ordinary configured sign-in form authenticates the same person and returns to the same real company conversation. |
| Pass | json_path |
{"kind":"json_path","path":"boundary.authentication-retains-resource-checks","expected":true} | A different genuinely signed-in nonmember remains unable to access either the company or the original conversation. |
| Pass | json_path |
{"kind":"json_path","path":"boundary.no-expired-query-or-dispatch","expected":true} | The boundary retains unsent intent: no native run or extra human/agent comment is admitted before or after authentication. |
| Pass | json_path |
{"kind":"json_path","path":"boundary.boundary-complete-conditions","expected":true} | Every required public boundary phase is implemented. |
| Pass | json_path |
{"kind":"json_path","path":"boundary.boundary-declared-agent-dispatch","expected":true} | Actual observed provider admissions match the boundary's declared run bounds; nonexistent chat is never credited. |
Usage, billing and timing metadata
{
"billing": {
"llm": {
"runCount": 1,
"runsWithTokenUsage": 0,
"runsWithReportedCost": 0,
"runsWithEstimatedCost": 0,
"runsWithPartialReportedCost": 0,
"inputTokens": 0,
"outputTokens": 0,
"cachedInputTokens": 0,
"totalTokens": 0,
"reportedCostUsd": 0,
"estimatedCostUsd": 0,
"costStatus": "unavailable"
},
"runtime": {
"provider": "local",
"agentRunDurationMs": null,
"leaseDurationMs": null,
"leaseCount": 0,
"costStatus": "not_metered",
"costSource": "local_not_metered"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0,
"observedAndEstimatedCostUsd": 0,
"complete": false
},
"rawUsage": null,
"workerTiming": null
}