Full-stack acceptance campaign

Runner Full-Stack E2E

Results across runner profiles and execution environments. Declared PNG screenshots and normalized results are retained with every published campaign; additional diagnostic evidence remains in the access-controlled workflow artifact.

2026-10-28T13:32:43.456Z33f99c6cSource run ↗Campaign summary ↗

11/80Passed
69Failed
265m 23sSummed attempt time
Campaign notes and coverage
# Actual working human commands and remaining coverage

**80 distinct scenarios measured on production39e: 11 qualified latest PASS, 69 latest FAIL, 164 unmeasured of244. There are87 genuine measurements. Campaign merge-gate progress is11/244 (4.5%); measured-subset performance is not the merge gate.** This is a fixed retained-evidence cutoff; later results do not alter these rows.

Production baseline is `39e811c9c5226979fce42e052a27cfb28301018a`, with exact chat model `openrouter/deepseek/deepseek-v4.1-flash-1017` through OpenCode/OpenRouter. Measurements retain their actual evaluation sources33f99, d1f983,81bba,e232,d282 and8cd, suite/definition identities, host and attempt chronology. The standard header's first source is a metadata anchor; per-row sources remain authoritative. Older50b/local evidence and the instrumented diagnostic are separate. No failed result is regraded.

## Eleven qualified working commands

| Actual human command | Independently verified product outcome | Actual AWS cell |
| --- | --- | --- |
| Have Morgan report to Riley from now on. | Saved manager and organization view,9/9. | [change-manager](https://github.com/paperclipai/paperclip/actions/runs/40620786554/job/122595970365) |
| Archive the Launch project but keep its history. | Archived project with retained readable history,10/10. | [archive-project](https://github.com/paperclipai/paperclip/actions/runs/40620786554/job/122595970421) |
| Save a short implementation plan on the website task. | Actual versioned plan, substantive brief facts and usable link,9/9. | [write-plan](https://github.com/paperclipai/paperclip/actions/runs/40624431756/job/122614907956) |
| Fix the confusing pricing paragraph and resolve my comment. | Real anchored edit/comment resolution with unrelated content preserved,9/9. | [resolve-feedback](https://github.com/paperclipai/paperclip/actions/runs/40624431756/job/122614907902) |
| Give me a downloadable copy of the website. | Registered HTML download independently fetched and matched to source bytes,7/7. | [produce-download](https://github.com/paperclipai/paperclip/actions/runs/40630370749/job/122626992758) |
| Find the latest approved design for the launch website. | Correct approved revision distinguished from draft; history/access preserved,9/9 final2. | [find-design](https://github.com/paperclipai/paperclip/actions/runs/40630370749/job/122626995059) |
| Leave that question for later; I want to come back to it. | Real question/draft survives dismiss/reload and later answer resumes once,10/10. | [defer-and-reopen](https://github.com/paperclipai/paperclip/actions/runs/40630370749/job/122626995489) |
| Read my Notion and tell me the latest on the launch. (Human declines connection.) | Real declined setup stays declined; no unauthorized read/configuration change,9/9. This proves a permission boundary, not a live Notion read. | [notion-declined](https://github.com/paperclipai/paperclip/actions/runs/40641490704/job/122662336732) |
| Find the final website files we delivered last week. | Correct authenticated download bytes/provenance, original historical objects unchanged,9/9 final2. | [find-artifact](https://github.com/paperclipai/paperclip/actions/runs/40641490704/job/122662336675) |
| Enable Agent Chat on this instance. | Supported operator path, saved configuration and actual route availability without granting agent administration rights,9/9 final2. | [instance-settings](https://github.com/paperclipai/paperclip/actions/runs/40649033672/job/122686766586) |
| Restart this test instance and bring my conversation back. | Real authorized service stop/start and persisted conversation return,9/9. | [restart-service](https://github.com/paperclipai/paperclip/actions/runs/40690055539/job/122825535459) |

All qualified passes have authenticated result/definition, exact source/build/native/model, actual per-cell restore, cleanup and privacy proof. A plan/download pass does not establish general task creation, hiring or completed delegation. Full delegated-result return remains unproven; its allowed final is exhausted. Earlier failed initials remain in accounting when a later corrected final passes.

## Measured failures remain failures

The latest69 failures include genuine missing outcomes and incomplete observations, plus demonstrated fixture/prerequisite problems. An empty reply or phase timeout alone is not proof of model refusal or provider outage. Individual rows preserve original error/classification, source and finite attempts.

- Three plugin initials failed before canonical chat because fingerprint metadata referenced unused generated CLI output. Their original source/run/host/privacy/cleanup and error bytes are authenticated, but definition evidence is absent. The failure-only imports retain null definition identities, no model-execution claim and no pass eligibility. Initial attempts remain consumed; no definition is fabricated.
- Busy-worker readiness rejected an already lifecycle-ready/running worker in inspect-run-cli and assignment-conflict. Reviewed future fixture correction accepts that prerequisite only; it never treats running work as completed. Original failures remain.
- source-action, retry-exhausted and explain-stall failed their injected owned-process fault prerequisite before canonical chat. The original classifier says cleanup_failure; actual final cleanup passed. The killed process produced a nonrecoverable transport failure while the fixture required recoverable coordinator attempts. This is not evidence that final cleanup failed or the requested user journey ran.
- read-history and pause-owned stopped at their real routine-history prerequisites. No canonical-query success is inferred. post-stop-message stopped at its exact signed-in human setup-turn guard; controller-restart stopped at agent readiness. Causes beyond retained evidence remain unresolved.
- accept-one-proposal's corrected final remains failed: raw queued run rows and actual started native executions are different facts. Its unchanged task/decision/repeat/run predicates were not waived. Fast-responses' final likewise remains failed at honest-human-settings-guidance after the source settled; its initial save/readback failure remains preserved.
- Browser and developer-tool cases retain failures where output, local bytes, truthful location, guidance or genuine boundary proof was not established. No incidental wording or missing observation is rescued into a pass.
- Case browsing produced correct plaintext results but lacked usable case links; a separate unmerged UI correction is not part of these measurements. Budget resolution presented a genuine bound decision question that the fixture did not answer through its declared human continuation; the final remains exhausted. Recovered intermittent MCP failures coexist with many actual successful MCP parts; no universal transport cause is established.

The original mixed-model prompt-guard PASS remains in attempt history, excluded from uniform1017 credit. Its later model-revalidation final failed, so its latest row is FAIL. No new alternative-model inference is claimed from a failed observation.

## Screenshots, unmeasured work and operating state

The existing gallery binds one authentic root browser capture to each of these80 latest cases. Original PNG bytes and SHA-256, run/case/result attribution are preserved;55 bindings retain prior visual review and25 new/replacement images receive fresh review. These are disposable fixture screenshots. No raw diagnostics, private transcripts, traces, credentials or unreviewed duplicate assets are published. Any genuine per-image omission must be stated explicitly rather than silently dropping visual evidence.

**164 scenarios remain unmeasured on this baseline.** Pending approvals and preexecution refusals are not measurements or consumed case ordinals. `connection-setup.unreachable-mcp` is explicitly reserved with missing framework evidence: the job-level25-minute cancellation annotation is known, but the earlier paid-step cancellation cause, framework start, result and cleanup are unknown. It is neither a fabricated FAIL nor an available fresh initial, and will not be replayed without proper resolution.

The [full244 inventory](https://d1p6rlowie26tp.cloudfront.net/runner-e2e/campaigns/gha-40584967834-1-final34-report/) retains historical outcomes and prerequisite categories. Real public membership setup can unlock non-invitation contexts; actual invitation/live external integration outcomes retain their own requirements. Source-supported preparation is not live success. AgentMail protected-secret transfer remains pending direct human approval; no transfer or paid mail run is represented here.

Global paid parallelism remains4 with independently monitored approval waves. Identity/privacy/cleanup/prerequisite signals remain stop conditions. The instrumented find-artifact initial remains failed and excluded from clean39e counts;15 successful MCP parts in that diagnostic prove only that sample and do not exclude observer effects. Unknown/unpriced usage is not zero cost. Earlier immutable reports and every authentic attempt remain retained.


Visual evidence: one original browser PNG for each of these 80 latest scenarios, individually reviewed. The 55 unchanged previously reviewed bindings are retained; 25 new or replacement captures are reviewed. Raw logs, traces, snapshots and duplicate image copies remain unpublished. Screenshots complement saved-state proof; they do not change any result.
Campaign usage and spend
0 / 0Complaints / suggestions · retained attempts0 distinct items · 87 attempts with incomplete collection · 0 failed submissions · 0 unresolved submissions
87Retained attempts0 missing attempts · 0 out-of-scope artifacts
6,616,978 (partial: 59/112 runs)Input tokens
342,375 (partial: 59/112 runs)Output tokens
33,792,048 (partial: 59/112 runs)Cached tokens
UnavailableLLM reported subtotal
$0.000000Daytona list estimate
657m 4sObserved attempt window87 retained attempts · 0 missing attempts

Attempt durations include setup and cleanup captured inside each attempt. The observed window spans the earliest retained start to the latest retained finish, including gaps and overlap. Carried-forward evidence can span older runs, so this window is not the current workflow's duration. Neither measure is CI queue/setup time or provider-billed runtime.

UnknownAgent execution time
0msDaytona lease time
0/112Runs provider-priced

Campaign costs include retained attempts, including failed retries. Result cards show the selected attempt. Provider-reported amounts and model estimates are separate; unpriced or unavailable runs are excluded, never counted as free. Coverage describes captured usage; unobserved setup, subscriptions, tools, CI and storage require additional accounting. Daytona runtime is a public-list-price estimate from captured lease time and pinned resources, before credits, discounts, storage allowance, or invoice adjustments. Local execution has no external runtime meter.

UnknownWorker setup time
UnknownWorker execution time
UnknownWorker feedback time
UnknownWorker cleanup time
UnknownWorker finalization time

0/87 complete worker receipts; 0 partial; 0 missing attempts. Worker phases cover the test callback through finalization before result publication. Browser/server startup, parent cleanup, CI queue/build time and provider-billed runtime are outside these measurements. An interrupted phase has no inferred end time.

Campaign feedback review

0 distinct feedback items await review. Collection gaps and failed submissions remain separate findings.

Full bodies and review rationale stay in private evidence. Exact duplicate bodies are grouped once; related causes can be linked by a reviewed duplicate disposition.

All results

Feature coverage 0 of 192 capabilities linked · 0 of 80 tests mapped

Associations use the current feature map. Counts describe linked test scenarios; a passing journey does not establish full coverage of a capability.

Getting started and access

FeatureCapabilities linkedLinked test results
Onboarding and first work 0/5 No mapped journey
Login, invitations, and access 0/5 No mapped journey
Companies and portability 0/8 No mapped journey

Tasks and conversations

FeatureCapabilities linkedLinked test results
Task creation and lifecycle 0/6 No mapped journey
Delegation, dependencies, and signoff 0/4 No mapped journey
Inbox, decisions, and search 0/5 No mapped journey
Agent conversations and project handoff 0/4 No mapped journey
Questions and approvals 0/8 No mapped journey
Steering and queued messages 0/7 No mapped journey
Documents, attachments, and work products 0/5 No mapped journey

Agents and reusable capabilities

FeatureCapabilities linkedLinked test results
Hiring, configuration, and organization 0/9 No mapped journey
Runs, harnesses, and model accounts 0/5 No mapped journey
Skills and Skill Studio 0/5 No mapped journey
Team packages and installation 0/4 No mapped journey

Projects and execution

FeatureCapabilities linkedLinked test results
Projects and repositories 0/5 No mapped journey
Goals and work alignment 0/3 No mapped journey
Workspaces, services, and files 0/5 No mapped journey
Execution environments 0/5 No mapped journey
Recovery 0/8 No mapped journey

Apps, channels, and extensions

FeatureCapabilities linkedLinked test results
Connection setup 0/8 No mapped journey
Assistant connections (MCP) 0/5 No mapped journey
App access and action permissions 0/5 No mapped journey
External chat and email 0/6 No mapped journey
Tool gateways and access profiles 0/5 No mapped journey
Secrets and proposals 0/5 No mapped journey
Plugins 0/4 No mapped journey

Automation and structured work

FeatureCapabilities linkedLinked test results
Routines, schedules, and triggers 0/5 No mapped journey
Cases 0/5 No mapped journey
Status cards 0/4 No mapped journey

Oversight and operation

FeatureCapabilities linkedLinked test results
Costs and budgets 0/6 No mapped journey
Dashboards and audit trails 0/6 No mapped journey
Navigation, profile, and announcements 0/6 No mapped journey
Instance operations 0/6 No mapped journey
CLI/API and local worktrees 0/6 No mapped journey

Contributor surfaces

FeatureCapabilities linkedLinked test results
Developer previews and diagnostic labs 0/4 No mapped journey

Test suite

Chat feature journeys

Executable catalog requests through Agent Chat, with independently graded persisted state.

Pass rate13.8%11/80 passed
Tokens40,751,401 (partial: 59/112 runs)6,616,978 (partial: 59/112 runs) input · 342,375 (partial: 59/112 runs) output
Known spendUnavailablereported LLM + model/runtime estimates estimate
Agent timeUnknown0ms lease
Execution80/800 retries · cleanup passed

Delegate an announcement and return its saved result

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
Delegate an announcement and return its saved result failed
Overall failed · No behavioral checks recorded

transient infrastructure

Stopped waiting for chat scenario tasks.delegate-announcement: An observed provider run failed
Test detailsNo checks recorded · 3m 2s
Tokens89,619 (partial: 1/2 runs) in · 4,909 (partial: 1/2 runs) out449,536 (partial: 1/2 runs) cached · 1/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.delegate-announcement
Attempt
1
Duration
3m 2s
Agent runtime
Unknown
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
fac09270-e206-40b9-ac67-4eff854972b2unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
73dfa3e1-8373-453d-b304-eb267212bb51unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 89619,
      "outputTokens": 4909,
      "cachedInputTokens": 449536,
      "totalTokens": 544064,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

agents.change-manager

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
agents.change-manager passed
Test details9/9 checks · 1m 37s
Overall passed · 9/9 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (9)
ResultCheckDetail
Passchat.complete-runtime-observationSaved agent configuration, attribution and actual rendered replies are independently required.
Passchat.saved-requested-managerMorgan reports to the real same-company Riley.
Passchat.reporting-tree-validEvery reporting chain terminates without a cycle or missing company manager.
Passchat.unrelated-config-and-tasks-retainedChanging the manager preserves accounts, permissions and existing tasks.
Passchat.attributed-agent-changeThe saved reporting-line change is independently attributed to the actual agent.
Passchat.catalog-complete-conditionsNo known catalog condition is omitted.
Passchat.catalog-original-human-queryThe persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Passchat.catalog-query-attachment-receiptsOnly declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Passchat.catalog-bounded-native-runsObserved provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Tokens63,862 in · 753 out136,448 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered36s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.agents.change-manager
Attempt
1
Duration
1m 37s
Agent runtime
36s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
4dc17692-b6ec-4206-9efc-72a15f28e97dunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.complete-runtime-observation","expected":true} Saved agent configuration, attribution and actual rendered replies are independently required.
Pass json_path {"kind":"json_path","path":"chat.saved-requested-manager","expected":true} Morgan reports to the real same-company Riley.
Pass json_path {"kind":"json_path","path":"chat.reporting-tree-valid","expected":true} Every reporting chain terminates without a cycle or missing company manager.
Pass json_path {"kind":"json_path","path":"chat.unrelated-config-and-tasks-retained","expected":true} Changing the manager preserves accounts, permissions and existing tasks.
Pass json_path {"kind":"json_path","path":"chat.attributed-agent-change","expected":true} The saved reporting-line change is independently attributed to the actual agent.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} No known catalog condition is omitted.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} The persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Only declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Observed provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 63862,
      "outputTokens": 753,
      "cachedInputTokens": 136448,
      "totalTokens": 201063,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 35779,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

agents.managed-profile

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
agents.managed-profile failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for initial identity response; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 2m 51s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered2m 33s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.agents.managed-profile
Attempt
1
Duration
2m 51s
Agent runtime
2m 33s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
a86d7161-e197-4b1f-9cf2-231ee07c0c2aunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 152635,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

budgets-costs.resolve-budget

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
budgets-costs.resolve-budget failed
Overall failed · No behavioral checks recorded

candidate failure

Stopped waiting for budgets-costs.resolve-budget: Settled scenario failed: honest-incident-guidance
Test detailsNo checks recorded · 2m 45s
Tokens45,865 in · 3,539 out225,792 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 57s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.budgets-costs.resolve-budget
Attempt
1
Duration
2m 45s
Agent runtime
1m 57s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
064aba24-b851-4042-89c7-0b768ed9ba5dunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 45865,
      "outputTokens": 3539,
      "cachedInputTokens": 225792,
      "totalTokens": 275196,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 116907,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

budgets-costs.spend-breakdown

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
budgets-costs.spend-breakdown failed
Overall failed · No behavioral checks recorded

candidate failure

Stopped waiting for budgets-costs.spend-breakdown: Settled scenario failed: actual-agent-breakdown-and-incomplete-total
Test detailsNo checks recorded · 8m 10s
Tokens128,741 in · 10,422 out510,065 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered7m 22s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.budgets-costs.spend-breakdown
Attempt
1
Duration
8m 10s
Agent runtime
7m 22s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
77f094e2-09d7-44ae-a5e0-d0e302e2126aunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
73289377-fa8e-40c3-84e9-d104583765f9unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 128741,
      "outputTokens": 10422,
      "cachedInputTokens": 510065,
      "totalTokens": 649228,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 441924,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

cases.browse-cases

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
cases.browse-cases failed
Overall failed · No behavioral checks recorded

candidate failure

Stopped waiting for cases.browse-cases: Settled scenario failed: exact-filtered-case-results
Test detailsNo checks recorded · 1m 39s
Tokens56,807 in · 1,035 out228,992 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 4s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.cases.browse-cases
Attempt
1
Duration
1m 39s
Agent runtime
1m 4s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
83c76410-68d8-46c5-aa88-c64410530248unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 56807,
      "outputTokens": 1035,
      "cachedInputTokens": 228992,
      "totalTokens": 286834,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 63589,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

cases.cases-disabled

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
cases.cases-disabled failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for cases.cases-disabled; truthful-availability-and-choice, catalog-bounded-native-runs. See the saved state evidence.
Test detailsNo checks recorded · 4m 51s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered4m 32s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.cases.cases-disabled
Attempt
1
Duration
4m 51s
Agent runtime
4m 32s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
144d8422-2c00-4c7d-a809-531989185bbbunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 137013,
      "outputTokens": 4748,
      "cachedInputTokens": 860160,
      "totalTokens": 1001921,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 272355,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

cases.create-case

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
cases.create-case failed
Overall failed · No behavioral checks recorded

candidate failure

Stopped waiting for cases.create-case: Scenario exceeded its declared run bound
Test detailsNo checks recorded · 1m 55s
TokensUnavailable in · Unavailable outUnavailable cached · 0/3 runs covered
LLM spendUnavailable0/3 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.cases.create-case
Attempt
1
Duration
1m 55s
Agent runtime
Unknown
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
7bb43feb-e662-4c14-9aba-dbe91b6514e7unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
978a19ad-d34f-4ec0-8243-b9a83e82561dunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
b5d759b8-5396-4850-9c67-5a4a40ae6ce2unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 41987,
      "outputTokens": 3690,
      "cachedInputTokens": 501888,
      "totalTokens": 547565,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

cli-operations.create-from-cli

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
cli-operations.create-from-cli failed
Overall failed · No behavioral checks recorded

candidate failure

Stopped waiting for cli-operations.create-from-cli: Settled scenario failed: saved-company-project-assignee, real-command-structured-result
Test detailsNo checks recorded · 1m 55s
Tokens126,190 in · 3,357 out343,552 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 9s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.cli-operations.create-from-cli
Attempt
1
Duration
1m 55s
Agent runtime
1m 9s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
40076454-f697-4b5f-b0a7-45b37846fdd3unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 126190,
      "outputTokens": 3357,
      "cachedInputTokens": 343552,
      "totalTokens": 473099,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 69047,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

cli-operations.feedback-bundle

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
cli-operations.feedback-bundle failed
Overall failed · No behavioral checks recorded

candidate failure

Stopped waiting for cli-operations.feedback-bundle: Settled scenario failed: interrupted-work-not-fabricated-failure, owned-local-bytes-and-scope, truthful-native-location-and-contents
Test detailsNo checks recorded · 5m 53s
Tokens209,722 in · 12,238 out1,486,464 cached · 3/3 runs covered
LLM spendUnavailable0/3 runs provider-priced
ExecutionLocal · not metered5m 10s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.cli-operations.feedback-bundle
Attempt
1
Duration
5m 53s
Agent runtime
5m 10s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
ba1a6ca1-8ef9-402c-9b4c-a3bfc360e568unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
165e5995-0f84-4d38-8c50-c3002cc17698unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
8c70b2b7-3cfa-4f19-b89c-20f9e54f7515unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 3,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 209722,
      "outputTokens": 12238,
      "cachedInputTokens": 1486464,
      "totalTokens": 1708424,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 309941,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

cli-operations.inspect-run-cli

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
cli-operations.inspect-run-cli failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for catalog agent readiness 87d52704-1820-4c45-b6a9-b217a7f13584; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 1m 27s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 4s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.cli-operations.inspect-run-cli
Attempt
1
Duration
1m 27s
Agent runtime
1m 4s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
234bf717-677a-4e2c-9044-6899f3b895cfunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 24266,
      "outputTokens": 528,
      "cachedInputTokens": 27648,
      "totalTokens": 52442,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 64330,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

cli-operations.owned-dev-instance

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
cli-operations.owned-dev-instance failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for Canonical privileged guidance settled; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 14m 51s
Tokens62,985 in · 13,309 out1,024,896 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered4m 6s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.cli-operations.owned-dev-instance
Attempt
1
Duration
14m 51s
Agent runtime
4m 6s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
2080d982-4c41-4636-8559-8894d6d131f4unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 62985,
      "outputTokens": 13309,
      "cachedInputTokens": 1024896,
      "totalTokens": 1101190,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 245819,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

companies.agent-observability

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
companies.agent-observability failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for actual native harness trace export; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 3m 14s
Tokens248,835 in · 5,090 out444,928 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered2m 9s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.companies.agent-observability
Attempt
1
Duration
3m 14s
Agent runtime
2m 9s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
28ede845-4260-4131-b9e6-e00ce79a4cb3unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
de0e05b8-c9fe-40df-b87d-3d54d96654d0unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 248835,
      "outputTokens": 5090,
      "cachedInputTokens": 444928,
      "totalTokens": 698853,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 129321,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

companies.archive-company

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
companies.archive-company failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for initial identity response; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 4m 51s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered4m 32s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.companies.archive-company
Attempt
1
Duration
4m 51s
Agent runtime
4m 32s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
f1d4218d-8e19-4aa3-80f3-4fc2d94e60ebunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 144177,
      "outputTokens": 4470,
      "cachedInputTokens": 836480,
      "totalTokens": 985127,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 272192,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

companies.export-company

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
companies.export-company failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for initial identity response; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 2m 49s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered2m 33s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.companies.export-company
Attempt
1
Duration
2m 49s
Agent runtime
2m 33s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
76dd2cc0-117f-4387-ab27-5867517de866unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 292044,
      "outputTokens": 6255,
      "cachedInputTokens": 1323008,
      "totalTokens": 1621307,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 153375,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

companies.fast-responses

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
companies.fast-responses failed
Overall failed · No behavioral checks recorded

candidate failure

Stopped waiting for companies.fast-responses: Settled scenario failed: honest-human-settings-guidance
Test detailsNo checks recorded · 1m 34s
Tokens11,225 in · 3,117 out241,408 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered53s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.companies.fast-responses
Attempt
1
Duration
1m 34s
Agent runtime
53s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
7673af5d-4e08-4472-84d8-c58e796ef93bunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 11225,
      "outputTokens": 3117,
      "cachedInputTokens": 241408,
      "totalTokens": 255750,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 52584,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

companies.import-preview

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
companies.import-preview failed
Overall failed · No behavioral checks recorded

candidate failure

The consequential import conflict was not previewed without mutation and referred to the human
Test detailsNo checks recorded · 1m 39s
Tokens75,002 in · 3,324 out431,104 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 16s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.companies.import-preview
Attempt
1
Duration
1m 39s
Agent runtime
1m 16s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
3459c0a6-c823-4dd6-90cb-e5399590140cunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 75002,
      "outputTokens": 3324,
      "cachedInputTokens": 431104,
      "totalTokens": 509430,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 75574,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

companies.prompt-injection-guard

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
companies.prompt-injection-guard failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for initial identity response; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 2m 51s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered2m 32s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.companies.prompt-injection-guard
Attempt
1
Duration
2m 51s
Agent runtime
2m 32s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
777ca3ff-256c-4142-a674-dd81a47c4433unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 82163,
      "outputTokens": 2459,
      "cachedInputTokens": 70077,
      "totalTokens": 154699,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 152337,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

companies.switch-company

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
companies.switch-company failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for initial identity response; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 4m 52s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered4m 27s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.companies.switch-company
Attempt
1
Duration
4m 52s
Agent runtime
4m 27s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
e4af3087-eeaa-4f5f-ae98-e1866e585071unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 113533,
      "outputTokens": 6833,
      "cachedInputTokens": 383475,
      "totalTokens": 503841,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 266718,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

connection-setup.choose-provider

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
connection-setup.choose-provider failed
Overall failed · No behavioral checks recorded

candidate failure

Actual visible source-run answer does not explain advertised Notion choices and unavailable prerequisite
Test detailsNo checks recorded · 54s
Tokens59,723 in · 540 out60,928 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered35s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.connection-setup.choose-provider
Attempt
1
Duration
54s
Agent runtime
35s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
1059b546-1412-4d60-b472-34305628bce1unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 59723,
      "outputTokens": 540,
      "cachedInputTokens": 60928,
      "totalTokens": 121191,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 35284,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

connection-setup.notion-declined

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
connection-setup.notion-declined passed
Test details9/9 checks · 1m 40s
Overall passed · 9/9 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (9)
ResultCheckDetail
Passchat.complete-declined-connection-evidenceThe actual addressed connection request and persisted decline are required.
Passchat.single-addressed-human-declineThe intended person visibly declines one Notion request; no replacement request is created.
Passchat.no-connected-account-or-provider-readThere is no credential-bearing connection and no provider invocation after a decline.
Passchat.post-decline-response-boundThe incomplete research explanation belongs to the actual decline continuation run.
Passchat.honest-incomplete-researchThe reply explains unavailable research and offers supplied content as an alternative.
Passchat.catalog-complete-conditionsNo known catalog condition is omitted.
Passchat.catalog-original-human-queryThe persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Passchat.catalog-query-attachment-receiptsOnly declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Passchat.catalog-bounded-native-runsObserved provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Tokens111,239 in · 2,037 out115,200 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered1m 11s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.connection-setup.notion-declined
Attempt
1
Duration
1m 40s
Agent runtime
1m 11s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
f13cc89b-635a-4c0e-b257-933a91ea4f42unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
512d5d91-e560-48d2-b800-2bb12823c5abunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.complete-declined-connection-evidence","expected":true} The actual addressed connection request and persisted decline are required.
Pass json_path {"kind":"json_path","path":"chat.single-addressed-human-decline","expected":true} The intended person visibly declines one Notion request; no replacement request is created.
Pass json_path {"kind":"json_path","path":"chat.no-connected-account-or-provider-read","expected":true} There is no credential-bearing connection and no provider invocation after a decline.
Pass json_path {"kind":"json_path","path":"chat.post-decline-response-bound","expected":true} The incomplete research explanation belongs to the actual decline continuation run.
Pass json_path {"kind":"json_path","path":"chat.honest-incomplete-research","expected":true} The reply explains unavailable research and offers supplied content as an alternative.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} No known catalog condition is omitted.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} The persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Only declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Observed provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 111239,
      "outputTokens": 2037,
      "cachedInputTokens": 115200,
      "totalTokens": 228476,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 71241,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

connection-setup.secure-api-key

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
connection-setup.secure-api-key failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for initial identity response; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 2m 55s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered2m 32s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.connection-setup.secure-api-key
Attempt
1
Duration
2m 55s
Agent runtime
2m 32s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
65329f0c-af0f-466b-a6c9-664f5ed116fbunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 144793,
      "outputTokens": 4782,
      "cachedInputTokens": 1230848,
      "totalTokens": 1380423,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 152411,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

developer-labs.component-reference

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
developer-labs.component-reference failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for Canonical privileged guidance settled; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 6m 49s
Tokens28,577 in · 1,653 out256 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered38s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.developer-labs.component-reference
Attempt
1
Duration
6m 49s
Agent runtime
38s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
6957b742-8be4-48ea-9595-0ea2407ff3c8unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 28577,
      "outputTokens": 1653,
      "cachedInputTokens": 256,
      "totalTokens": 30486,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 37683,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

developer-labs.gated-lab

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
developer-labs.gated-lab failed
Overall failed · No behavioral checks recorded

candidate failure

Stopped waiting for developer-labs.gated-lab: Settled scenario failed: clear-development-only-boundary
Test detailsNo checks recorded · 3m 36s
Tokens56,071 in · 8,032 out931,072 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered2m 39s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.developer-labs.gated-lab
Attempt
1
Duration
3m 36s
Agent runtime
2m 39s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
f52c502e-45ec-482c-8a0e-4fe69e3b7397unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 56071,
      "outputTokens": 8032,
      "cachedInputTokens": 931072,
      "totalTokens": 995175,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 158501,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

developer-labs.interaction-fixture

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
developer-labs.interaction-fixture failed
Overall failed · No behavioral checks recorded

candidate failure

Stopped waiting for developer-labs.interaction-fixture: Settled scenario failed: existing-denial-lab-guidance
Test detailsNo checks recorded · 2m 1s
Tokens29,336 in · 2,357 out220,672 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 16s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.developer-labs.interaction-fixture
Attempt
1
Duration
2m 1s
Agent runtime
1m 16s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
0d5606ee-d076-40df-89fb-af9e8cbf360dunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 29336,
      "outputTokens": 2357,
      "cachedInputTokens": 220672,
      "totalTokens": 252365,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 76095,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

documents-artifacts.find-artifact

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
documents-artifacts.find-artifact passed
Test details9/9 checks · 3m 9s
Overall passed · 9/9 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (9)
ResultCheckDetail
Passchat.real-imported-artifact-historyPublic migration receipts, original source dates and actual imported attachment/download evidence are required.
Passchat.original-last-week-delivery-not-import-timeThe final belongs to the requested prior week through preserved completion and attachment-bound source-comment dates; the actual attachment import happened later.
Passchat.exact-accessible-final-and-downloadThe answer selects the actual final from the requested source time, with both exact source and usable verified download links.
Passchat.draft-older-final-and-private-snippets-excludedA newer unapproved draft and an older final are either omitted or clearly qualified rather than substituted, and independently denied private artifacts and previews remain outside results.
Passchat.history-not-rewritten-by-searchSearching preserves the migrated tasks, delivery state and source history.
Passchat.catalog-complete-conditionsNo known catalog condition is omitted.
Passchat.catalog-original-human-queryThe persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Passchat.catalog-query-attachment-receiptsOnly declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Passchat.catalog-bounded-native-runsObserved provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Tokens76,958 in · 5,067 out731,904 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered2m 18s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.documents-artifacts.find-artifact
Attempt
1
Duration
3m 9s
Agent runtime
2m 18s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
c160810b-14a8-4715-86cc-5c93f7eb6520unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.real-imported-artifact-history","expected":true} Public migration receipts, original source dates and actual imported attachment/download evidence are required.
Pass json_path {"kind":"json_path","path":"chat.original-last-week-delivery-not-import-time","expected":true} The final belongs to the requested prior week through preserved completion and attachment-bound source-comment dates; the actual attachment import happened later.
Pass json_path {"kind":"json_path","path":"chat.exact-accessible-final-and-download","expected":true} The answer selects the actual final from the requested source time, with both exact source and usable verified download links.
Pass json_path {"kind":"json_path","path":"chat.draft-older-final-and-private-snippets-excluded","expected":true} A newer unapproved draft and an older final are either omitted or clearly qualified rather than substituted, and independently denied private artifacts and previews remain outside results.
Pass json_path {"kind":"json_path","path":"chat.history-not-rewritten-by-search","expected":true} Searching preserves the migrated tasks, delivery state and source history.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} No known catalog condition is omitted.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} The persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Only declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Observed provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 76958,
      "outputTokens": 5067,
      "cachedInputTokens": 731904,
      "totalTokens": 813929,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 137534,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

documents-artifacts.produce-download

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
documents-artifacts.produce-download passed
Test details7/7 checks · 1m 42s
Overall passed · 7/7 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (7)
ResultCheckDetail
Passchat.independent-registered-deliveryRegistered work products, immutable attachment origin and independently downloaded bytes are required.
Passchat.actual-prior-work-and-source-retainedThe request refers to actual earlier worker-produced website bytes and preserves its source task and execution attribution.
Passchat.new-exact-download-through-product-pathExactly one current-run registered artifact has the independently verified requested bytes and a usable returned product download link.
Passchat.catalog-complete-conditionsNo known catalog condition is omitted.
Passchat.catalog-original-human-queryThe persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Passchat.catalog-query-attachment-receiptsOnly declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Passchat.catalog-bounded-native-runsObserved provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Tokens82,046 in · 2,963 out256,512 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered57s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.documents-artifacts.produce-download
Attempt
1
Duration
1m 42s
Agent runtime
57s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
2fb1a697-5ebb-43d0-a4d3-4b3dddc9d13bunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
a1757969-d088-4770-9a5c-dc47883eb5eaunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.independent-registered-delivery","expected":true} Registered work products, immutable attachment origin and independently downloaded bytes are required.
Pass json_path {"kind":"json_path","path":"chat.actual-prior-work-and-source-retained","expected":true} The request refers to actual earlier worker-produced website bytes and preserves its source task and execution attribution.
Pass json_path {"kind":"json_path","path":"chat.new-exact-download-through-product-path","expected":true} Exactly one current-run registered artifact has the independently verified requested bytes and a usable returned product download link.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} No known catalog condition is omitted.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} The persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Only declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Observed provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 82046,
      "outputTokens": 2963,
      "cachedInputTokens": 256512,
      "totalTokens": 341521,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 56586,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

documents-artifacts.resolve-feedback

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
documents-artifacts.resolve-feedback passed
Test details9/9 checks · 1m 58s
Overall passed · 9/9 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (9)
ResultCheckDetail
Passchat.complete-independent-observationMissing API, document, audit or rendered-link evidence cannot pass.
Passchat.substantive-pricing-fixThe actual current document unambiguously preserves $19 monthly total for the team and unrelated support content.
Passchat.correct-thread-resolvedOnly the anchored pricing annotation is resolved by the CEO, preserving its original document and revision relationship.
Passchat.edit-before-resolutionSaved revision and independent audit events establish the substantive edit before resolution.
Passchat.task-and-document-accessChat links the changed document's task without modifying task execution.
Passchat.catalog-complete-conditionsNo known catalog condition is omitted.
Passchat.catalog-original-human-queryThe persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Passchat.catalog-query-attachment-receiptsOnly declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Passchat.catalog-bounded-native-runsObserved provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Tokens50,202 in · 2,390 out489,600 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 12s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.documents-artifacts.resolve-feedback
Attempt
1
Duration
1m 58s
Agent runtime
1m 12s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
d15686bb-1d18-418b-857c-1165356df758unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.complete-independent-observation","expected":true} Missing API, document, audit or rendered-link evidence cannot pass.
Pass json_path {"kind":"json_path","path":"chat.substantive-pricing-fix","expected":true} The actual current document unambiguously preserves $19 monthly total for the team and unrelated support content.
Pass json_path {"kind":"json_path","path":"chat.correct-thread-resolved","expected":true} Only the anchored pricing annotation is resolved by the CEO, preserving its original document and revision relationship.
Pass json_path {"kind":"json_path","path":"chat.edit-before-resolution","expected":true} Saved revision and independent audit events establish the substantive edit before resolution.
Pass json_path {"kind":"json_path","path":"chat.task-and-document-access","expected":true} Chat links the changed document's task without modifying task execution.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} No known catalog condition is omitted.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} The persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Only declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Observed provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 50202,
      "outputTokens": 2390,
      "cachedInputTokens": 489600,
      "totalTokens": 542192,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 71517,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

documents-artifacts.revise-delivery

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
documents-artifacts.revise-delivery failed
Overall failed · No behavioral checks recorded

candidate failure

Stopped waiting for documents-artifacts.revise-delivery: Settled scenario failed: actual-prior-work-and-source-retained, new-exact-download-through-product-path, original-version-still-retrievable
Test detailsNo checks recorded · 2m 15s
Tokens57,227 in · 3,590 out373,632 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered1m 25s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.documents-artifacts.revise-delivery
Attempt
1
Duration
2m 15s
Agent runtime
1m 25s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
a82943f7-b59a-40c4-94f6-2af08e43c51eunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
7bf3337c-04fc-42fd-8059-671fb01ac71eunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 57227,
      "outputTokens": 3590,
      "cachedInputTokens": 373632,
      "totalTokens": 434449,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 84746,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

documents-artifacts.write-plan

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
documents-artifacts.write-plan passed
Test details9/9 checks · 1m 15s
Overall passed · 9/9 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (9)
ResultCheckDetail
Passchat.complete-independent-observationMissing API, document, audit or rendered-link evidence cannot pass.
Passchat.saved-implementation-planA durable plan reflects the website's actual prerequisite brief and verification, rather than merely chat prose.
Passchat.versioned-authorThe current document revision is attributed to this real agent run.
Passchat.plan-auditThe API audit records the CEO creating the plan after the request.
Passchat.task-context-and-linkSaving a plan preserves the task and makes the saved plan reachable through its task.
Passchat.catalog-complete-conditionsNo known catalog condition is omitted.
Passchat.catalog-original-human-queryThe persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Passchat.catalog-query-attachment-receiptsOnly declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Passchat.catalog-bounded-native-runsObserved provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Tokens72,322 in · 1,617 out165,376 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered43s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.documents-artifacts.write-plan
Attempt
1
Duration
1m 15s
Agent runtime
43s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
33093749-0c33-4b81-b433-8169daf784a7unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.complete-independent-observation","expected":true} Missing API, document, audit or rendered-link evidence cannot pass.
Pass json_path {"kind":"json_path","path":"chat.saved-implementation-plan","expected":true} A durable plan reflects the website's actual prerequisite brief and verification, rather than merely chat prose.
Pass json_path {"kind":"json_path","path":"chat.versioned-author","expected":true} The current document revision is attributed to this real agent run.
Pass json_path {"kind":"json_path","path":"chat.plan-audit","expected":true} The API audit records the CEO creating the plan after the request.
Pass json_path {"kind":"json_path","path":"chat.task-context-and-link","expected":true} Saving a plan preserves the task and makes the saved plan reachable through its task.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} No known catalog condition is omitted.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} The persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Only declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Observed provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 72322,
      "outputTokens": 1617,
      "cachedInputTokens": 165376,
      "totalTokens": 239315,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 43362,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

execution-environments.choose-capable-target

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
execution-environments.choose-capable-target failed
Overall failed · No behavioral checks recorded

candidate failure

POST /api/companies/d913e0b3-3381-489c-9bd7-111772ca0e62/environments returned 422; body withheld
Test detailsNo checks recorded · 18s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.execution-environments.choose-capable-target
Attempt
1
Duration
18s
Agent runtime
Unknown
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

gateways-profiles.connect-client

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
gateways-profiles.connect-client failed
Overall failed · No behavioral checks recorded

candidate failure

Stopped waiting for gateways-profiles.connect-client: Settled scenario failed: actual-active-run-scoped-session, disallowed-write-denied
Test detailsNo checks recorded · 1m 13s
Tokens60,288 in · 1,090 out94,720 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered39s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.gateways-profiles.connect-client
Attempt
1
Duration
1m 13s
Agent runtime
39s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
6ea5b042-77f1-4de1-8d80-480886c8c7f9unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 60288,
      "outputTokens": 1090,
      "cachedInputTokens": 94720,
      "totalTokens": 156098,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 39155,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

gateways-profiles.create-gateway

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
gateways-profiles.create-gateway failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for initial identity response; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 2m 53s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered2m 34s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.gateways-profiles.create-gateway
Attempt
1
Duration
2m 53s
Agent runtime
2m 34s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
79c8800f-e08e-4f97-95f9-6f8259dc387bunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 117133,
      "outputTokens": 2687,
      "cachedInputTokens": 293888,
      "totalTokens": 413708,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 153561,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

gateways-profiles.rotate-token

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
gateways-profiles.rotate-token failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for initial identity response; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 2m 49s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered2m 34s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.gateways-profiles.rotate-token
Attempt
1
Duration
2m 49s
Agent runtime
2m 34s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
a53c2dca-8df9-421b-a84a-a8869f6c33d0unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 141237,
      "outputTokens": 5143,
      "cachedInputTokens": 642048,
      "totalTokens": 788428,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 153643,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

goals.align-existing-work

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
goals.align-existing-work failed
Overall failed · No behavioral checks recorded

candidate failure

Stopped waiting for goals.align-existing-work: Settled scenario failed: phase-bound-strategic-context-explanation; Reporter privacy violation: omitted html-report/data/2f04cd43f58f0d4956f8e5726869df5ed9c33613.zip, omitted blob-report/report.zip, omitted playwright-output/runner-chat-features-runne-7f3c9-the-browser-and-public-APIs/trace.zip
Test detailsNo checks recorded · 6m 44s
Tokens158,697 in · 13,647 out1,092,352 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered6m 2s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.goals.align-existing-work
Attempt
1
Duration
6m 44s
Agent runtime
6m 2s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
61242df1-9aed-4053-af8e-1825680d6467unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
b8eaf216-b887-4108-99bc-9815638ec220unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 158697,
      "outputTokens": 13647,
      "cachedInputTokens": 1092352,
      "totalTokens": 1264696,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 361823,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

goals.create-goal-tree

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
goals.create-goal-tree failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for Initial creation before explicit user retry; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 2m 49s
Tokens78,102 in · 1,529 out230,400 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered45s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.goals.create-goal-tree
Attempt
1
Duration
2m 49s
Agent runtime
45s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
e7895813-92c2-4ef5-b134-26d7c1d3e8b5unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 78102,
      "outputTokens": 1529,
      "cachedInputTokens": 230400,
      "totalTokens": 310031,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 45485,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

goals.explain-purpose

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
goals.explain-purpose failed
Overall failed · No behavioral checks recorded

candidate failure

Initial purpose explanation does not match its saved chain and rationale
Test detailsNo checks recorded · 1m 37s
Tokens35,780 in · 1,731 out192,384 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 14s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.goals.explain-purpose
Attempt
1
Duration
1m 37s
Agent runtime
1m 14s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
ea893654-15c6-4f3f-8782-b0e9e4a4137bunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 35780,
      "outputTokens": 1731,
      "cachedInputTokens": 192384,
      "totalTokens": 229895,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 74462,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

inbox-search.archive-partial-failure

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
inbox-search.archive-partial-failure failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for Real initial partial archive turn settles; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 2m 48s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered2m 33s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.inbox-search.archive-partial-failure
Attempt
1
Duration
2m 48s
Agent runtime
2m 33s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
09514ee4-7cf1-4a13-b451-2d633d48fd0aunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 60015,
      "outputTokens": 4878,
      "cachedInputTokens": 1221376,
      "totalTokens": 1286269,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 152938,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

inbox-search.find-design

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
inbox-search.find-design passed
Test details9/9 checks · 1m 51s
Overall passed · 9/9 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (9)
ResultCheckDetail
Passchat.independent-design-historySaved design revision, human approval and actual acting-agent search evidence are required.
Passchat.real-approved-revision-retainedThe exact historical revision and real human approval comment remain saved rather than inferring approval from latest edit time.
Passchat.approved-design-distinguished-from-newer-draftThe answer links the actual approved design and explains that the later revision is still a draft.
Passchat.read-only-design-searchFinding a design does not approve a draft, rewrite its history or mutate prerequisite work.
Passchat.inaccessible-design-excludedA healthy acting-agent search cannot expose the inaccessible project's design or snippet, including through copied links.
Passchat.catalog-complete-conditionsNo known catalog condition is omitted.
Passchat.catalog-original-human-queryThe persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Passchat.catalog-query-attachment-receiptsOnly declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Passchat.catalog-bounded-native-runsObserved provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Tokens48,493 in · 3,116 out334,336 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 12s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.inbox-search.find-design
Attempt
1
Duration
1m 51s
Agent runtime
1m 12s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
c1e5e698-33a5-433f-834f-9130314124b9unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.independent-design-history","expected":true} Saved design revision, human approval and actual acting-agent search evidence are required.
Pass json_path {"kind":"json_path","path":"chat.real-approved-revision-retained","expected":true} The exact historical revision and real human approval comment remain saved rather than inferring approval from latest edit time.
Pass json_path {"kind":"json_path","path":"chat.approved-design-distinguished-from-newer-draft","expected":true} The answer links the actual approved design and explains that the later revision is still a draft.
Pass json_path {"kind":"json_path","path":"chat.read-only-design-search","expected":true} Finding a design does not approve a draft, rewrite its history or mutate prerequisite work.
Pass json_path {"kind":"json_path","path":"chat.inaccessible-design-excluded","expected":true} A healthy acting-agent search cannot expose the inaccessible project's design or snippet, including through copied links.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} No known catalog condition is omitted.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} The persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Only declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Observed provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 48493,
      "outputTokens": 3116,
      "cachedInputTokens": 334336,
      "totalTokens": 385945,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 71961,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

instance-operations.instance-settings

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
instance-operations.instance-settings passed
Test details9/9 checks · 3m 52s
Overall passed · 9/9 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (9)
ResultCheckDetail
Passchat.actual-setting-evidenceActual denied agent access and independently saved operator changes are required.
Passchat.agent-not-instance-adminThe actual agent bearer cannot read or patch experimental instance administration settings.
Passchat.supported-human-pathThe reply identifies the supported setting and operator path without claiming an unauthorized setting write.
Passchat.saved-gate-and-routeThe human toggles the actual owned setting, observes the disabled route explanation, persists enablement and opens the real chat route.
Passchat.credential-not-disclosedThe bounded private permission-probe credential never enters the model reply or evidence.
Passchat.catalog-complete-conditionsNo known catalog condition is omitted.
Passchat.catalog-original-human-queryThe persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Passchat.catalog-query-attachment-receiptsOnly declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Passchat.catalog-bounded-native-runsObserved provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Tokens59,471 in · 6,569 out823,296 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered3m 11s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.instance-operations.instance-settings
Attempt
1
Duration
3m 52s
Agent runtime
3m 11s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
e9bef348-9fc4-440a-a44c-5270efe09a9funknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.actual-setting-evidence","expected":true} Actual denied agent access and independently saved operator changes are required.
Pass json_path {"kind":"json_path","path":"chat.agent-not-instance-admin","expected":true} The actual agent bearer cannot read or patch experimental instance administration settings.
Pass json_path {"kind":"json_path","path":"chat.supported-human-path","expected":true} The reply identifies the supported setting and operator path without claiming an unauthorized setting write.
Pass json_path {"kind":"json_path","path":"chat.saved-gate-and-route","expected":true} The human toggles the actual owned setting, observes the disabled route explanation, persists enablement and opens the real chat route.
Pass json_path {"kind":"json_path","path":"chat.credential-not-disclosed","expected":true} The bounded private permission-probe credential never enters the model reply or evidence.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} No known catalog condition is omitted.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} The persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Only declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Observed provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 59471,
      "outputTokens": 6569,
      "cachedInputTokens": 823296,
      "totalTokens": 889336,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 191476,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

instance-operations.restart-service

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
instance-operations.restart-service passed
Test details9/9 checks · 4m 5s
Overall passed · 9/9 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (9)
ResultCheckDetail
Passchat.owned-restart-observationThe actual owned service restart and persisted conversation must be independently observed.
Passchat.service-stopped-and-replacedA fresh exact-request supervisor acknowledgement follows verified stop/start/health log boundaries; a listening port alone is insufficient.
Passchat.same-conversation-and-historyThe browser returns to the same persisted conversation and actual message identities/bodies remain unchanged.
Passchat.no-duplicate-admissionThe operator restart does not manufacture a second model response or replay work.
Passchat.honest-operator-guidanceThe pre-restart reply gives the operator path without claiming it already restarted or can remain responsive offline.
Passchat.catalog-complete-conditionsNo known catalog condition is omitted.
Passchat.catalog-original-human-queryThe persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Passchat.catalog-query-attachment-receiptsOnly declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Passchat.catalog-bounded-native-runsObserved provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Tokens47,579 in · 6,385 out1,124,864 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered3m 10s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.instance-operations.restart-service
Attempt
1
Duration
4m 5s
Agent runtime
3m 10s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
86f31993-60d2-4b45-94eb-250a253c06f2unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.owned-restart-observation","expected":true} The actual owned service restart and persisted conversation must be independently observed.
Pass json_path {"kind":"json_path","path":"chat.service-stopped-and-replaced","expected":true} A fresh exact-request supervisor acknowledgement follows verified stop/start/health log boundaries; a listening port alone is insufficient.
Pass json_path {"kind":"json_path","path":"chat.same-conversation-and-history","expected":true} The browser returns to the same persisted conversation and actual message identities/bodies remain unchanged.
Pass json_path {"kind":"json_path","path":"chat.no-duplicate-admission","expected":true} The operator restart does not manufacture a second model response or replay work.
Pass json_path {"kind":"json_path","path":"chat.honest-operator-guidance","expected":true} The pre-restart reply gives the operator path without claiming it already restarted or can remain responsive offline.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} No known catalog condition is omitted.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} The persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Only declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Observed provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 47579,
      "outputTokens": 6385,
      "cachedInputTokens": 1124864,
      "totalTokens": 1178828,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 190315,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

navigation-preferences.find-project-view

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
navigation-preferences.find-project-view failed
Overall failed · No behavioral checks recorded

candidate failure

No actual project reply link
Test detailsNo checks recorded · 59s
Tokens25,205 in · 407 out54,272 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered38s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.navigation-preferences.find-project-view
Attempt
1
Duration
59s
Agent runtime
38s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
79663cea-32b7-426f-888f-626f2db8f9d4unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 25205,
      "outputTokens": 407,
      "cachedInputTokens": 54272,
      "totalTokens": 79884,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 37990,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

onboarding.first-work

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
onboarding.first-work failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for first real completed website and delivered HTML; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 6m 25s
Tokens72,025 in · 14,006 out775,808 cached · 3/3 runs covered
LLM spendUnavailable0/3 runs provider-priced
ExecutionLocal · not metered3m 17s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.onboarding.first-work
Attempt
1
Duration
6m 25s
Agent runtime
3m 17s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
6b7a8f98-7c68-4625-bc8d-42c61b625916unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
2a050eb4-038a-4e7a-b226-19b7615310b2unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ca06f967-a1fc-475e-8697-43aca88e698dunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 3,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 72025,
      "outputTokens": 14006,
      "cachedInputTokens": 775808,
      "totalTokens": 861839,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 196568,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

plugins.configure-plugin

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
plugins.configure-plugin failed
Overall failed · No behavioral checks recorded

candidate failure

Unresolved fingerprint dependency: ./tests/runner-e2e/../../cli/dist/index.js from /home/runner/_work/paperclip/paperclip/entry.ts
Test detailsNo checks recorded · 14s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.plugins.configure-plugin
Attempt
1
Duration
14s
Agent runtime
Unknown
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

plugins.disable-plugin

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
plugins.disable-plugin failed
Overall failed · No behavioral checks recorded

candidate failure

Unresolved fingerprint dependency: ./tests/runner-e2e/../../cli/dist/index.js from /home/runner/_work/paperclip/paperclip/entry.ts
Test detailsNo checks recorded · 15s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.plugins.disable-plugin
Attempt
1
Duration
15s
Agent runtime
Unknown
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

plugins.install-plugin

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
plugins.install-plugin failed
Overall failed · No behavioral checks recorded

candidate failure

Unresolved fingerprint dependency: ./tests/runner-e2e/../../cli/dist/index.js from /home/runner/_work/paperclip/paperclip/entry.ts
Test detailsNo checks recorded · 14s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.plugins.install-plugin
Attempt
1
Duration
14s
Agent runtime
Unknown
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

projects.archive-project

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
projects.archive-project passed
Test details10/10 checks · 1m 28s
Overall passed · 10/10 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (10)
ResultCheckDetail
Passchat.complete-independent-observationMissing API, document, audit or rendered-link evidence cannot pass.
Passchat.archived-not-deletedLaunch remains retrievable in the supported archived state.
Passchat.history-retainedThe original task, document bytes and creation audit survive archiving.
Passchat.attributed-project-updateThe saved lifecycle change belongs to the acting agent.
Passchat.historical-api-reachabilityThe actual archived project and retained task remain independently readable through their public resource APIs.
Passchat.truthful-archive-reportThe response reports saved archiving without falsely claiming resource deletion or task cancellation.
Passchat.catalog-complete-conditionsNo known catalog condition is omitted.
Passchat.catalog-original-human-queryThe persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Passchat.catalog-query-attachment-receiptsOnly declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Passchat.catalog-bounded-native-runsObserved provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Tokens34,080 in · 617 out126,976 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered42s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.projects.archive-project
Attempt
1
Duration
1m 28s
Agent runtime
42s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
352ddb3b-ddb3-4471-88a3-d9a071d52e2bunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.complete-independent-observation","expected":true} Missing API, document, audit or rendered-link evidence cannot pass.
Pass json_path {"kind":"json_path","path":"chat.archived-not-deleted","expected":true} Launch remains retrievable in the supported archived state.
Pass json_path {"kind":"json_path","path":"chat.history-retained","expected":true} The original task, document bytes and creation audit survive archiving.
Pass json_path {"kind":"json_path","path":"chat.attributed-project-update","expected":true} The saved lifecycle change belongs to the acting agent.
Pass json_path {"kind":"json_path","path":"chat.historical-api-reachability","expected":true} The actual archived project and retained task remain independently readable through their public resource APIs.
Pass json_path {"kind":"json_path","path":"chat.truthful-archive-report","expected":true} The response reports saved archiving without falsely claiming resource deletion or task cancellation.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} No known catalog condition is omitted.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} The persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Only declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Observed provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 34080,
      "outputTokens": 617,
      "cachedInputTokens": 126976,
      "totalTokens": 161673,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 42245,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

projects.create-project

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
projects.create-project failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for Initial creation before explicit user retry; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 2m 49s
Tokens28,800 in · 838 out118,272 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered38s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.projects.create-project
Attempt
1
Duration
2m 49s
Agent runtime
38s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
06c67909-f1f3-4320-9ed6-50a65e2a767cunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 28800,
      "outputTokens": 838,
      "cachedInputTokens": 118272,
      "totalTokens": 147910,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 37561,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

projects.project-defaults

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
projects.project-defaults failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for Canonical project-defaults turn settles; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 3m 25s
TokensUnavailable in · Unavailable outUnavailable cached · 0/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered5m 37s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.projects.project-defaults
Attempt
1
Duration
3m 25s
Agent runtime
5m 37s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
a2c94d1d-66bb-45dd-8959-59de4d3c63eaunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
8fd40500-f926-4eef-9da9-0d1bfe78c3feunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 111121,
      "outputTokens": 6994,
      "cachedInputTokens": 1152000,
      "totalTokens": 1270115,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 337224,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

projects.project-work

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
projects.project-work failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for projects.project-work; retained-chat-and-links, launch-leftover-summary, catalog-settled-source-separate-work. See the saved state evidence.
Test detailsNo checks recorded · 4m 56s
Tokens93,938 (partial: 1/2 runs) in · 10,644 (partial: 1/2 runs) out1,090,816 (partial: 1/2 runs) cached · 1/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered6m 7s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.projects.project-work
Attempt
1
Duration
4m 56s
Agent runtime
6m 7s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
7da4fec4-e8fa-4fb8-ba0d-f6db4ad7f7acunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
4b347966-c39e-4d71-9aa9-3a2015e6ef24unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 93938,
      "outputTokens": 10644,
      "cachedInputTokens": 1090816,
      "totalTokens": 1195398,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 367317,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

questions-and-approvals.accept-one-proposal

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
questions-and-approvals.accept-one-proposal failed
Overall failed · No behavioral checks recorded

candidate failure

Stopped waiting for questions-and-approvals.accept-one-proposal: Scenario exceeded its declared run bound
Test detailsNo checks recorded · 2m 12s
Tokens47,011 (partial: 1/3 runs) in · 3,431 (partial: 1/3 runs) out345,344 (partial: 1/3 runs) cached · 1/3 runs covered
LLM spendUnavailable0/3 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.questions-and-approvals.accept-one-proposal
Attempt
1
Duration
2m 12s
Agent runtime
Unknown
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
60f1f22c-c4c7-41db-b774-0a38f8388d62unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ed3e971a-64c8-44bd-8f6d-6f68d3b373dfunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
bd219777-3b02-4417-a1c4-abf8e0ee20e5unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 47011,
      "outputTokens": 3431,
      "cachedInputTokens": 345344,
      "totalTokens": 395786,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

questions-and-approvals.ambiguous-yes

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
questions-and-approvals.ambiguous-yes failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for initial identity response; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 2m 59s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered2m 33s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.questions-and-approvals.ambiguous-yes
Attempt
1
Duration
2m 59s
Agent runtime
2m 33s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
7020798a-53b8-4c6a-9903-b9fa79213bb2unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 102833,
      "outputTokens": 2909,
      "cachedInputTokens": 94720,
      "totalTokens": 200462,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 153034,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

questions-and-approvals.decline-tool

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
questions-and-approvals.decline-tool failed
Overall failed · No behavioral checks recorded

transient infrastructure

Stopped waiting for questions-and-approvals.decline-tool: Observed provider run failed
Test detailsNo checks recorded · 2m 0s
Tokens84,070 (partial: 1/2 runs) in · 197 (partial: 1/2 runs) out4,608 (partial: 1/2 runs) cached · 1/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered1m 22s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.questions-and-approvals.decline-tool
Attempt
1
Duration
2m 0s
Agent runtime
1m 22s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
e03d4c4c-6b8c-4c14-8567-318a50c75908unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
e6e2e7e5-31b1-4a9d-9eca-1cb7e91e0dadunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 84070,
      "outputTokens": 197,
      "cachedInputTokens": 4608,
      "totalTokens": 88875,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 81945,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

questions-and-approvals.defer-and-reopen

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
questions-and-approvals.defer-and-reopen passed
Test details10/10 checks · 3m 42s
Overall passed · 10/10 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (10)
ResultCheckDetail
Passchat.complete-interaction-evidencePublic interactions, persisted answers, run identities and result records are required.
Passchat.same-request-resolved-by-humanThe original version is answered by the real browser user without replacing its payload.
Passchat.exact-free-text-answerThe exact human product name is attached once to the existing question.
Passchat.dismissal-is-not-answerDismiss/reload retains the unanswered request and does not trigger a continuation.
Passchat.draft-and-governance-preservedThe saved local draft reopens on the same question; dismissing it never resolves the separate protected approval.
Passchat.later-answer-resumes-onceOnly the later submitted answer causes one continuation and is used in its actual response.
Passchat.catalog-complete-conditionsNo known catalog condition is omitted.
Passchat.catalog-original-human-queryThe persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Passchat.catalog-query-attachment-receiptsOnly declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Passchat.catalog-bounded-native-runsObserved provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Tokens136,422 in · 5,131 out97,466 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered2m 56s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.questions-and-approvals.defer-and-reopen
Attempt
1
Duration
3m 42s
Agent runtime
2m 56s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
93a005c0-3cd7-455f-a0c2-3be7be1640a9unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
525ac111-676a-425c-b4d1-10ebd9dcdcadunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.complete-interaction-evidence","expected":true} Public interactions, persisted answers, run identities and result records are required.
Pass json_path {"kind":"json_path","path":"chat.same-request-resolved-by-human","expected":true} The original version is answered by the real browser user without replacing its payload.
Pass json_path {"kind":"json_path","path":"chat.exact-free-text-answer","expected":true} The exact human product name is attached once to the existing question.
Pass json_path {"kind":"json_path","path":"chat.dismissal-is-not-answer","expected":true} Dismiss/reload retains the unanswered request and does not trigger a continuation.
Pass json_path {"kind":"json_path","path":"chat.draft-and-governance-preserved","expected":true} The saved local draft reopens on the same question; dismissing it never resolves the separate protected approval.
Pass json_path {"kind":"json_path","path":"chat.later-answer-resumes-once","expected":true} Only the later submitted answer causes one continuation and is used in its actual response.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} No known catalog condition is omitted.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} The persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Only declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Observed provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 136422,
      "outputTokens": 5131,
      "cachedInputTokens": 97466,
      "totalTokens": 239019,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 175587,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

questions-and-approvals.duplicate-answer

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
questions-and-approvals.duplicate-answer failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for One answer-race continuation completed; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 3m 45s
Tokens156,325 (partial: 1/2 runs) in · 4,769 (partial: 1/2 runs) out498,499 (partial: 1/2 runs) cached · 1/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered4m 17s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.questions-and-approvals.duplicate-answer
Attempt
1
Duration
3m 45s
Agent runtime
4m 17s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
3946936c-0ec9-4fae-b7a7-3a42a25676f4unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
5970b2bb-7b8a-46ed-bcb9-35e9212927feunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 156325,
      "outputTokens": 4769,
      "cachedInputTokens": 498499,
      "totalTokens": 659593,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 256732,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

questions-and-approvals.multi-part-question

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
questions-and-approvals.multi-part-question failed
Overall failed · No behavioral checks recorded

candidate failure

Full failure details (1,471 characters)
locator.click: Timeout 30000ms exceeded. Call log:  - waiting for getByTestId('task-chat-composer-takeover').getByRole('button', { name: 'Next', exact: true })  - locator resolved to <button disabled type="button" data-size="sm" data-slot="button" data-variant="default" class="inline-flex items-center justify-center whitespace-nowrap text-sm font-medium transition-(--tp-color-background-color-border-color-box-shadow-opacity) disabled:pointer-events-none disabled:opacity-50 [&_svg]:pointer-events-none [&_svg:not([class*='size-'])]:size-4 shrink-0 [&_svg]:shrink-0 outline-none focus-visible:border-ring focus-visible:ring-ring/50 focus-visible:ring-(length:--rad-3) aria-invalid:ring-…>Next</button>  - attempting click action  2 × waiting for element to be visible, enabled and stable  - element is not stable  - retrying click action  - waiting 20ms  - waiting for element to be visible, enabled and stable  - element is not stable  2 × retrying click action  - waiting 100ms  - waiting for element to be visible, enabled and stable  - element is not enabled  57 × retrying click action  - waiting 500ms  - waiting for element to be visible, enabled and stable  - element is not enabled  - retrying click action  - waiting 500ms
Test detailsNo checks recorded · 1m 57s
Tokens91,809 in · 2,548 out129,024 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 3s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.questions-and-approvals.multi-part-question
Attempt
1
Duration
1m 57s
Agent runtime
1m 3s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
2ae8402e-f808-40f9-9316-aa1c65841635unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 91809,
      "outputTokens": 2548,
      "cachedInputTokens": 129024,
      "totalTokens": 223381,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 62934,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

questions-and-approvals.necessary-question

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
questions-and-approvals.necessary-question failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for agent-created product-name question; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 2m 50s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered2m 34s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.questions-and-approvals.necessary-question
Attempt
1
Duration
2m 50s
Agent runtime
2m 34s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
c4c56f81-d6c4-4e23-b9a3-632c98b7b6caunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 113879,
      "outputTokens": 7056,
      "cachedInputTokens": 333461,
      "totalTokens": 454396,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 154160,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

questions-and-approvals.reject-and-revise

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
questions-and-approvals.reject-and-revise failed
Overall failed · No behavioral checks recorded

candidate failure

expect(locator).toContainText(expected) failed Locator: locator('#interaction-577d4e0c-1ada-4da9-832a-0424f568e821') Expected pattern: /Declined|Superseded/i Timeout: 30000ms Error: element(s) not found Call log:  - Expect "toContainText" with timeout 30000ms  - waiting for locator('#interaction-577d4e0c-1ada-4da9-832a-0424f568e821')
Test detailsNo checks recorded · 2m 2s
Tokens62,200 in · 4,872 out262,016 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 8s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.questions-and-approvals.reject-and-revise
Attempt
1
Duration
2m 2s
Agent runtime
1m 8s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
c61b8cca-7128-4e33-bebb-5e7341a5e8adunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 62200,
      "outputTokens": 4872,
      "cachedInputTokens": 262016,
      "totalTokens": 329088,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 67954,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

questions-and-approvals.review-plan

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
questions-and-approvals.review-plan failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for Plan decision source settled; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 3m 25s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered3m 3s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.questions-and-approvals.review-plan
Attempt
1
Duration
3m 25s
Agent runtime
3m 3s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
6f01d559-61ea-449e-9276-979e026c5431unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 100401,
      "outputTokens": 4086,
      "cachedInputTokens": 133248,
      "totalTokens": 237735,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 182928,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

recovery.controller-restart

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
recovery.controller-restart failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for catalog agent readiness 94b41c88-62c8-4122-ab2c-0cdf4ad94fef; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 2m 5s
Tokens38,142 in · 1,712 out172,544 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered39s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.recovery.controller-restart
Attempt
1
Duration
2m 5s
Agent runtime
39s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
c871e44a-d2a4-4143-998c-87535436aa7cunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 38142,
      "outputTokens": 1712,
      "cachedInputTokens": 172544,
      "totalTokens": 212398,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 39471,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

recovery.explain-stall

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
recovery.explain-stall failed
Overall failed · No behavioral checks recorded

cleanup failure

The owned process fault did not retain a source-qualified infrastructure/cleanup failure; actual classification is not relabelled
Test detailsNo checks recorded · 59s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered33s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.recovery.explain-stall
Attempt
1
Duration
59s
Agent runtime
33s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
91169e42-8a4b-4c5f-bc19-25ee86ae763funknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 33058,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

recovery.post-stop-message

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
recovery.post-stop-message failed
Overall failed · No behavioral checks recorded

candidate failure

The initial Website request is not the exact genuine signed-in human setup turn
Test detailsNo checks recorded · 47s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered24s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.recovery.post-stop-message
Attempt
1
Duration
47s
Agent runtime
24s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
666340f2-db6b-4037-97d4-9dbe38b91cbfunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 55744,
      "outputTokens": 546,
      "cachedInputTokens": 3072,
      "totalTokens": 59362,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 23902,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

recovery.retry-exhausted

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
recovery.retry-exhausted failed
Overall failed · No behavioral checks recorded

cleanup failure

The owned process fault did not retain a source-qualified infrastructure/cleanup failure; actual classification is not relabelled
Test detailsNo checks recorded · 57s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered31s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.recovery.retry-exhausted
Attempt
1
Duration
57s
Agent runtime
31s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
58962371-15ea-4a35-9e67-ebb62c32cf08unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 30737,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

recovery.source-action

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
recovery.source-action failed
Overall failed · No behavioral checks recorded

cleanup failure

The owned process fault did not retain a source-qualified infrastructure/cleanup failure; actual classification is not relabelled
Test detailsNo checks recorded · 53s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered29s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.recovery.source-action
Attempt
1
Duration
53s
Agent runtime
29s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
64d59065-73a9-41ca-beee-1da1c211b5e3unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 28581,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

routines.create-daily-brief

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
routines.create-daily-brief failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for routines.create-daily-brief; one-owned-launch-definition, weekday-nine-person-timezone, saved-agent-revision, schedule-and-work-location-explained, catalog-bounded-native-runs. See the saved state evidence.; Reporter privacy violation: omitted html-report/data/a88dd4094358a19f362e52db9676649ae8d8b870.zip, omitted playwright-output/runner-chat-features-runne-2e80d-the-browser-and-public-APIs/trace.zip
Test detailsNo checks recorded · 4m 53s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered4m 33s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.routines.create-daily-brief
Attempt
1
Duration
4m 53s
Agent runtime
4m 33s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
f8433976-d7da-4e05-b6af-677862ed5c7cunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 107461,
      "outputTokens": 3205,
      "cachedInputTokens": 118710,
      "totalTokens": 229376,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 272627,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

routines.manage-other-owner

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
routines.manage-other-owner failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for routines.manage-other-owner; ownership-boundary-explained, catalog-bounded-native-runs. See the saved state evidence.; Reporter privacy violation: omitted html-report/data/c4320bc6b2e770c9d559d718aad85b844531cb70.zip, omitted playwright-output/runner-chat-features-runne-7917a-the-browser-and-public-APIs/trace.zip
Test detailsNo checks recorded · 4m 47s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered4m 27s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.routines.manage-other-owner
Attempt
1
Duration
4m 47s
Agent runtime
4m 27s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
ffd5787e-2f28-4da6-8ab1-44b18856d433unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 31337,
      "outputTokens": 4008,
      "cachedInputTokens": 60416,
      "totalTokens": 95761,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 267136,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

routines.pause-owned

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
routines.pause-owned failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for real completed routine history before pause; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 3m 22s
Tokens27,468 in · 1,211 out144,512 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered43s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.routines.pause-owned
Attempt
1
Duration
3m 22s
Agent runtime
43s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
d7288747-1a2b-43d8-8e3c-020aa7cee6a4unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 27468,
      "outputTokens": 1211,
      "cachedInputTokens": 144512,
      "totalTokens": 173191,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 43269,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

routines.read-history

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
routines.read-history failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for genuine failed routine prerequisite final accounting before separate success invocation; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 1m 42s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered18s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.routines.read-history
Attempt
1
Duration
1m 42s
Agent runtime
18s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
1e763e72-f2fa-41f2-9a23-5a0ca461a38cunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 18382,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

skills.author-skill

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
skills.author-skill failed
Overall failed · No behavioral checks recorded

candidate failure

Stopped waiting for skills.author-skill: Settled scenario failed: inspectable-skill-link
Test detailsNo checks recorded · 1m 26s
Tokens32,037 in · 2,349 out126,592 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered40s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.skills.author-skill
Attempt
1
Duration
1m 26s
Agent runtime
40s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
fb2285bd-1bfe-480d-9a24-6dd3439d4ac7unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 32037,
      "outputTokens": 2349,
      "cachedInputTokens": 126592,
      "totalTokens": 160978,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 40410,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

skills.explicit-restriction

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
skills.explicit-restriction failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for skills.explicit-restriction; policy-denial-explained, catalog-bounded-native-runs. See the saved state evidence.
Test detailsNo checks recorded · 4m 53s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered4m 34s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.skills.explicit-restriction
Attempt
1
Duration
4m 53s
Agent runtime
4m 34s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
42c97ec4-93dd-4ad5-a194-cc769e4c0655unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 61640,
      "outputTokens": 4952,
      "cachedInputTokens": 95232,
      "totalTokens": 161824,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 273550,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

skills.find-and-install

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
skills.find-and-install failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for skills.find-and-install; permitted-source-prerequisite, one-intended-source-installation, agent-imported-approved-source, truthful-installation-and-usage, catalog-bounded-native-runs. See the saved state evidence.
Test detailsNo checks recorded · 4m 49s
Tokens46,828 in · 8,818 out399,820 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered4m 25s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.skills.find-and-install
Attempt
1
Duration
4m 49s
Agent runtime
4m 25s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
2d56407b-f046-468e-bf0f-d4b35e62723bunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 46828,
      "outputTokens": 8818,
      "cachedInputTokens": 399820,
      "totalTokens": 455466,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 265316,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

skills.studio-test

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
skills.studio-test failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for actual bounded skill Studio output; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 4m 31s
TokensUnavailable in · Unavailable outUnavailable cached · 0/3 runs covered
LLM spendUnavailable0/3 runs provider-priced
ExecutionLocal · not metered4m 5s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.skills.studio-test
Attempt
1
Duration
4m 31s
Agent runtime
4m 5s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
51d7e76d-1892-4065-9fce-9d6762fd9351unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
7bbbe445-d998-4452-81df-b2d4ebc10493unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
0ab0c644-f835-4dcf-8db8-6e296abe4591unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 3,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 88294,
      "outputTokens": 6923,
      "cachedInputTokens": 238020,
      "totalTokens": 333237,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 245299,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

task-coordination.block-on-design

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
task-coordination.block-on-design failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for Saved dependency and canonical reply before human approval; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 3m 3s
TokensUnavailable in · Unavailable outUnavailable cached · 0/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered3m 31s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.task-coordination.block-on-design
Attempt
1
Duration
3m 3s
Agent runtime
3m 31s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
7c1252e3-daed-4974-9870-b9b627cf81b9unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
03006f89-9f80-484a-aa00-6d18cb914586unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 68489,
      "outputTokens": 2237,
      "cachedInputTokens": 171264,
      "totalTokens": 241990,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 210768,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

task-coordination.reject-dependency-cycle

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
task-coordination.reject-dependency-cycle failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for task-coordination.reject-dependency-cycle; explains-actual-conflict-and-next-decision, catalog-bounded-native-runs. See the saved state evidence.
Test detailsNo checks recorded · 4m 55s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered4m 33s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.task-coordination.reject-dependency-cycle
Attempt
1
Duration
4m 55s
Agent runtime
4m 33s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
e04aca3f-1011-498b-966f-cbc02d9fea50unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 56422,
      "outputTokens": 6918,
      "cachedInputTokens": 521472,
      "totalTokens": 584812,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 273164,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

tasks.assignment-conflict

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
tasks.assignment-conflict failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for catalog agent readiness 0f461635-98e8-4760-b377-8166c0376887; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 2m 47s
Tokens125,265 (partial: 1/2 runs) in · 2,513 (partial: 1/2 runs) out363,776 (partial: 1/2 runs) cached · 1/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered2m 19s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.tasks.assignment-conflict
Attempt
1
Duration
2m 47s
Agent runtime
2m 19s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
321e4498-db14-4654-9c1b-bed0787d6e29unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
0efbc71c-674b-43af-a0e9-71cb952d961bunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 125265,
      "outputTokens": 2513,
      "cachedInputTokens": 363776,
      "totalTokens": 491554,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 139322,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

tasks.attachment-brief

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
tasks.attachment-brief failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for tasks.attachment-brief; one-contextual-ordinary-work-task, durable-brief-in-work-context, morgan-can-read-the-real-brief, separate-real-worker-admission, catalog-bounded-native-runs, catalog-settled-source-separate-work. See the saved state evidence.
Test detailsNo checks recorded · 4m 52s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered4m 26s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.tasks.attachment-brief
Attempt
1
Duration
4m 52s
Agent runtime
4m 26s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
31f58398-b905-47d2-8146-c46de067702funknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 36219,
      "outputTokens": 5201,
      "cachedInputTokens": 93184,
      "totalTokens": 134604,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 266238,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

tasks.website-task

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
tasks.website-task failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for tasks.website-task; one-ordinary-company-task, requested-work-captured, one-launch-and-attribution, retained-chat-and-links, separate-admitted-worker, catalog-bounded-native-runs, catalog-settled-source-separate-work. See the saved state evidence.
Test detailsNo checks recorded · 4m 51s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered4m 27s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.tasks.website-task
Attempt
1
Duration
4m 51s
Agent runtime
4m 27s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
06a51b48-c4bf-403a-b3f4-5bad2cf2fed2unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 31567,
      "outputTokens": 3987,
      "cachedInputTokens": 60928,
      "totalTokens": 96482,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 266521,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

tasks.website-without-project

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
tasks.website-without-project failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for Committed project and task before lost-ack replay; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 3m 0s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered2m 35s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.tasks.website-without-project
Attempt
1
Duration
3m 0s
Agent runtime
2m 35s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
9c7f6144-65fa-42ab-9c5f-3016cff9f83cunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 32126,
      "outputTokens": 2559,
      "cachedInputTokens": 118784,
      "totalTokens": 153469,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 155025,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

teams.find-team

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
teams.find-team failed
Overall failed · No behavioral checks recorded

candidate failure

Stopped waiting for teams.find-team: Settled scenario failed: existing-package-grounding, package-requirements-described
Test detailsNo checks recorded · 3m 21s
Tokens34,019 in · 5,104 out152,064 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered2m 50s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.teams.find-team
Attempt
1
Duration
3m 21s
Agent runtime
2m 50s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
508d2310-f854-4810-abea-22b60b86d229unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 34019,
      "outputTokens": 5104,
      "cachedInputTokens": 152064,
      "totalTokens": 191187,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 169988,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}

teams.preview-install

Inspect case ↗
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
teams.preview-install failed
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for teams.preview-install; existing-package-grounding, package-requirements-described, preview-resources-described, catalog-bounded-native-runs. See the saved state evidence.
Test detailsNo checks recorded · 4m 52s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered4m 32s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.teams.preview-install
Attempt
1
Duration
4m 52s
Agent runtime
4m 32s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
da93fcb4-6249-418e-b8bb-aba11329fa5cunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 81072,
      "outputTokens": 6350,
      "cachedInputTokens": 638464,
      "totalTokens": 725886,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 272488,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}
Screenshot evidence
Environment:
Duration Tokens Tests
Open original image ↗