Full-stack acceptance campaign

Runner Full-Stack E2E

Results across runner profiles and execution environments. Declared PNG screenshots and normalized results are retained with every published campaign; additional diagnostic evidence remains in the access-controlled workflow artifact.

2026-10-28T04:02:19.929Zd1f983e3Source run ↗Campaign summary ↗

2/12Passed
10Failed
46m 37sSummed attempt time
Campaign notes and coverage
# Current production: twelve completed human-chat journeys

This is a completed twelve-case selection, **partial coverage of the 244-scenario catalog**, on production **39e811c9c5226979fce42e052a27cfb28301018a**, including the merged OpenRouter credential-custody repair. Evaluation source is **d1f983e395bf2b3b5e895a77742264dd62ce3edb**; agent configuration is **OpenCode / OpenRouter / deepseek/deepseek-v4.1-flash-1017**. The requests were actually sent in human chat. No fixture supplied the agent's answer or performed its requested action.

This selection finished with **2 qualified passes and 10 failures**. Across this production baseline, **17 distinct scenarios have been measured: 4 passed, 13 failed, and 227 are not yet measured**, reconciling to **244**. The twelve here are unchanged initial measurements. The preceding five include two explicit baseline-comparison controls; old chronological results remain preserved. Prior-baseline passes do not silently qualify this production version.

## What passed end to end on this production baseline

| Actual human request | Verified product outcome |
|---|---|
| Have Morgan report to Riley from now on. | The actual manager change was saved and reflected in the organization view, with the relevant invariants preserved. Passed 9/9 in the preceding pilot. |
| Archive the Launch project but keep its history. | The project was actually archived and its history remained readable. Passed 10/10 in the preceding pilot. |
| Save a short implementation plan on the website task. | A versioned plan reflecting the brief was persisted on the intended task, linked in chat and independently read back. Passed 9/9 here. |
| Fix the confusing pricing paragraph and resolve my comment. | The actual anchored pricing feedback was addressed, then the correct annotation resolved, with unrelated feedback preserved. Passed 9/9 here. |

The two new passes each used one genuine native run and were qualified against authenticated source, definition, model, AWS host, build/native bytes and per-cell restoration evidence. These are observed successes, not predictions about the remaining catalog.

## Every result in this twelve-case selection

| Human journey | Original result | Evidence-supported interpretation |
|---|---|---|
| Save a short implementation plan on the website task. | **Passed, 9/9** | Actual versioned task document, substantive content, chat link and readback. |
| Fix the confusing pricing paragraph and resolve my comment. | **Passed, 9/9** | Actual edit-before-resolution of the intended anchored annotation; unrelated feedback retained. |
| Switch to Birch and show me what its team is doing. | **Failed** | The query was sent. Native execution completed 32 tools and continued discovery near the phase deadline, but no settled reply or completed turn arrived. No provider outage or missing-permission cause was established. |
| Set a company goal of reaching a thousand signups, with a team goal for launching the website. | **Failed** | Retained evidence lacks the required usable hierarchy link. The first phase never satisfied its condition, so the explicit duplicate-safe retry was not sent. |
| Tie the Launch project and website task to our growth goal. | **Failed** | The settled reply failed the strategic-context explanation check. Activity also proves Launch changed from backlog to planned alongside goal associations. Exact request bodies are redacted, so whether the model explicitly supplied status is unknown; the current goal-only update validator did not inject status in a pure check. |
| Find the latest approved design for the launch website. | **Failed; demonstrated oracle defect** | The actual answer correctly distinguished the approved first revision from the unapproved second revision. A narrow recency-wording check rejected it. The original failure remains; a reviewed target/revision-aware correction is selected for one future final measurement, not a retrospective pass. |
| Every weekday at nine in the morning, summarize Launch for me. | **Failed** | The saved routine/schedule/revision/explanation/run conditions did not settle within the declared wait. No deeper cause is inferred from that wrapper. |
| Change Morgan's routine to run every hour. | **Failed** | The existing owner, schedule and revision remained unchanged, with no forbidden CEO mutation, but no required owner-boundary explanation arrived. Native-facing basic-tool timeout reports were observed. |
| Have Morgan turn the attached brief into a website. | **Failed** | The human's actual upload remained available, but no ordinary delegated work task, durable brief handoff, authorized Morgan read or separate worker admission was saved. Native-facing basic-tool timeout reports were observed. The intended success is a real authorized attachment handoff, not a claim that a website is already finished. |
| Make Website wait for Design too. | **Failed** | The original dependency graph and ordinary task properties remained valid, but no settled conflict/order explanation arrived. A call_api timeout report was observed; unchanged graph state alone is not proof of a completed cycle-rejection action. |
| Create a task for Morgan to build a simple website for our new product in the Launch project. | **Failed** | The canonical query was sent and native execution remained running at the deadline, with no ordinary task or settled reply saved. No provider error is inferred. |
| Do we have a ready-made team for building a website? | **Failed** | The settled result failed the existing-package grounding and package-requirements explanation checks. No deeper cause or automatic correction is asserted. |

The generic “initial identity response” wait label in several rows occurs **after the canonical human query**, not before chat. Three recent cases show native-facing MCP request-timeout symptoms on basic tools. A bounded source/evidence review also found short successful native handler spans and structured results, but retained bridge/provider IDs and timestamps do not yet prove where response delivery failed. There is no established shared provider outage, database bottleneck, permanent deadlock or causal core fix. No timer was extended and no unchanged retry was authorized by this investigation.

## Cleanup, privacy and accounting

All twelve actual paid cells completed, with zero active cells at the recorded handoff. **All twelve cleanup checks passed**, and evidence manifests report **no leaks and no missing mandatory files**. Goal alignment, daily brief and other-owner routine additionally retain original reporter warnings: respectively three, two and two diagnostic ZIPs exceeded the existing **256 MiB expanded-byte inspection bound**, so they were omitted. Filename-only audits confirmed the refused archives are absent from the authenticated uploads. The closed warnings are size refusals, not credential-match findings. Original failure classes and reporter suffixes remain unchanged; scanner limits were not raised and no regrade occurred.

This report includes only the standard closed projection. No omitted archive, raw transcript, log, screenshot, database, credential or private sidecar payload is published. Missing/unpriced usage and readiness-probe billing outside heartbeat accounting are **unknown, not zero cost**. The production-default native timeout is zero; finite outer, phase, run-count, human-message, spend and retry limits remain intact.

## What remains future work

The **227 not-yet-measured scenarios on this production baseline remain in the denominator**. This includes explicit external inputs, unmerged core prerequisites, incomplete or blocked journeys, and further implemented journeys awaiting actual execution. The preserved prerequisite inventory still distinguishes 20 unrun invitation-core dependencies, 42 external-prerequisite journeys and six incomplete or blocked journeys; none is a pass merely because it has a callback. Other newly identified provider/oracle gaps are documented rather than converted to unsupported-response successes.

A separately source-bound next selection contains **40 pending measurements: 32 unused initials and eight explicitly reviewed final corrections**. It retains full completed-worker output and automatic original-chat delivery for delegated announcements. The original design-search failure above is one of those finals. Task creation alone does not satisfy full delegation. A first-four-cell operating checkpoint precedes further paid approvals; dispatch or queue state is not a case result. All counts on this page describe only retained completed evidence at this cutoff.

The [preceding five-case current-production report](https://d1p6rlowie26tp.cloudfront.net/runner-e2e/campaigns/gha-40620786554-1-five-report/) preserves the other two passes and three failures: CLI task creation, project creation and project work. Project-work exhibited a completion-client timeout/settling symptom without a final reply within its budget; no permanent core defect or Markdown-only link defect was established.

[Older OpenCode baseline coverage](https://d1p6rlowie26tp.cloudfront.net/runner-e2e/campaigns/gha-40584967834-1-final34-report/) and [17 one-time historical local Codex passes](https://d1p6rlowie26tp.cloudfront.net/runner-e2e/campaigns/historical-local-codex-chat-catalog-20261027-158measured-86unrun/) remain explicitly separate history. They do not add to current-production passes or reset any original failure allowance.
Campaign usage and spend
0 / 0Complaints / suggestions · retained attempts0 distinct items · 12 attempts with incomplete collection · 0 failed submissions · 0 unresolved submissions
12Retained attempts0 missing attempts · 0 out-of-scope artifacts
904,976 (partial: 7/13 runs)Input tokens
56,625 (partial: 7/13 runs)Output tokens
4,379,830 (partial: 7/13 runs)Cached tokens
UnavailableLLM reported subtotal
$0.000000Daytona list estimate
27m 14sObserved attempt window12 retained attempts · 0 missing attempts

Attempt durations include setup and cleanup captured inside each attempt. The observed window spans the earliest retained start to the latest retained finish, including gaps and overlap. Carried-forward evidence can span older runs, so this window is not the current workflow's duration. Neither measure is CI queue/setup time or provider-billed runtime.

39m 11sAgent execution time
0msDaytona lease time
0/13Runs provider-priced

Campaign costs include retained attempts, including failed retries. Result cards show the selected attempt. Provider-reported amounts and model estimates are separate; unpriced or unavailable runs are excluded, never counted as free. Coverage describes captured usage; unobserved setup, subscriptions, tools, CI and storage require additional accounting. Daytona runtime is a public-list-price estimate from captured lease time and pinned resources, before credits, discounts, storage allowance, or invoice adjustments. Local execution has no external runtime meter.

UnknownWorker setup time
UnknownWorker execution time
UnknownWorker feedback time
UnknownWorker cleanup time
UnknownWorker finalization time

0/12 complete worker receipts; 0 partial; 0 missing attempts. Worker phases cover the test callback through finalization before result publication. Browser/server startup, parent cleanup, CI queue/build time and provider-billed runtime are outside these measurements. An interrupted phase has no inferred end time.

Campaign feedback review

0 distinct feedback items await review. Collection gaps and failed submissions remain separate findings.

Full bodies and review rationale stay in private evidence. Exact duplicate bodies are grouped once; related causes can be linked by a reviewed duplicate disposition.

All results

Feature coverage 0 of 192 capabilities linked · 0 of 12 tests mapped

Associations use the current feature map. Counts describe linked test scenarios; a passing journey does not establish full coverage of a capability.

Getting started and access

FeatureCapabilities linkedLinked test results
Onboarding and first work 0/5 No mapped journey
Login, invitations, and access 0/5 No mapped journey
Companies and portability 0/8 No mapped journey

Tasks and conversations

FeatureCapabilities linkedLinked test results
Task creation and lifecycle 0/6 No mapped journey
Delegation, dependencies, and signoff 0/4 No mapped journey
Inbox, decisions, and search 0/5 No mapped journey
Agent conversations and project handoff 0/4 No mapped journey
Questions and approvals 0/8 No mapped journey
Steering and queued messages 0/7 No mapped journey
Documents, attachments, and work products 0/5 No mapped journey

Agents and reusable capabilities

FeatureCapabilities linkedLinked test results
Hiring, configuration, and organization 0/9 No mapped journey
Runs, harnesses, and model accounts 0/5 No mapped journey
Skills and Skill Studio 0/5 No mapped journey
Team packages and installation 0/4 No mapped journey

Projects and execution

FeatureCapabilities linkedLinked test results
Projects and repositories 0/5 No mapped journey
Goals and work alignment 0/3 No mapped journey
Workspaces, services, and files 0/5 No mapped journey
Execution environments 0/5 No mapped journey
Recovery 0/8 No mapped journey

Apps, channels, and extensions

FeatureCapabilities linkedLinked test results
Connection setup 0/8 No mapped journey
Assistant connections (MCP) 0/5 No mapped journey
App access and action permissions 0/5 No mapped journey
External chat and email 0/6 No mapped journey
Tool gateways and access profiles 0/5 No mapped journey
Secrets and proposals 0/5 No mapped journey
Plugins 0/4 No mapped journey

Automation and structured work

FeatureCapabilities linkedLinked test results
Routines, schedules, and triggers 0/5 No mapped journey
Cases 0/5 No mapped journey
Status cards 0/4 No mapped journey

Oversight and operation

FeatureCapabilities linkedLinked test results
Costs and budgets 0/6 No mapped journey
Dashboards and audit trails 0/6 No mapped journey
Navigation, profile, and announcements 0/6 No mapped journey
Instance operations 0/6 No mapped journey
CLI/API and local worktrees 0/6 No mapped journey

Contributor surfaces

FeatureCapabilities linkedLinked test results
Developer previews and diagnostic labs 0/4 No mapped journey

Test suite

Chat feature journeys

Executable catalog requests through Agent Chat, with independently graded persisted state.

Pass rate16.7%2/12 passed
Tokens5,341,431 (partial: 7/13 runs)904,976 (partial: 7/13 runs) input · 56,625 (partial: 7/13 runs) output
Known spendUnavailablereported LLM + model/runtime estimates estimate
Agent time39m 11s0ms lease
Execution12/120 retries · cleanup passed
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for initial identity response; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 2m 56s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered2m 34s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.companies.switch-company
Attempt
1
Duration
2m 56s
Agent runtime
2m 34s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
92cdf422-a9f5-4238-8096-cdcbe8df9b72unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 179616,
      "outputTokens": 4441,
      "cachedInputTokens": 899584,
      "totalTokens": 1083641,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 153881,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
Test details9/9 checks · 1m 58s
Overall passed · 9/9 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (9)
ResultCheckDetail
Passchat.complete-independent-observationMissing API, document, audit or rendered-link evidence cannot pass.
Passchat.substantive-pricing-fixThe actual current document unambiguously preserves $19 monthly total for the team and unrelated support content.
Passchat.correct-thread-resolvedOnly the anchored pricing annotation is resolved by the CEO, preserving its original document and revision relationship.
Passchat.edit-before-resolutionSaved revision and independent audit events establish the substantive edit before resolution.
Passchat.task-and-document-accessChat links the changed document's task without modifying task execution.
Passchat.catalog-complete-conditionsNo known catalog condition is omitted.
Passchat.catalog-original-human-queryThe persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Passchat.catalog-query-attachment-receiptsOnly declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Passchat.catalog-bounded-native-runsObserved provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Tokens50,202 in · 2,390 out489,600 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered1m 12s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.documents-artifacts.resolve-feedback
Attempt
1
Duration
1m 58s
Agent runtime
1m 12s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
d15686bb-1d18-418b-857c-1165356df758unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.complete-independent-observation","expected":true} Missing API, document, audit or rendered-link evidence cannot pass.
Pass json_path {"kind":"json_path","path":"chat.substantive-pricing-fix","expected":true} The actual current document unambiguously preserves $19 monthly total for the team and unrelated support content.
Pass json_path {"kind":"json_path","path":"chat.correct-thread-resolved","expected":true} Only the anchored pricing annotation is resolved by the CEO, preserving its original document and revision relationship.
Pass json_path {"kind":"json_path","path":"chat.edit-before-resolution","expected":true} Saved revision and independent audit events establish the substantive edit before resolution.
Pass json_path {"kind":"json_path","path":"chat.task-and-document-access","expected":true} Chat links the changed document's task without modifying task execution.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} No known catalog condition is omitted.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} The persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Only declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Observed provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 50202,
      "outputTokens": 2390,
      "cachedInputTokens": 489600,
      "totalTokens": 542192,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 71517,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
Test details9/9 checks · 1m 15s
Overall passed · 9/9 behavioral checks passed

No behavioral matcher failed.

See all behavioral checks (9)
ResultCheckDetail
Passchat.complete-independent-observationMissing API, document, audit or rendered-link evidence cannot pass.
Passchat.saved-implementation-planA durable plan reflects the website's actual prerequisite brief and verification, rather than merely chat prose.
Passchat.versioned-authorThe current document revision is attributed to this real agent run.
Passchat.plan-auditThe API audit records the CEO creating the plan after the request.
Passchat.task-context-and-linkSaving a plan preserves the task and makes the saved plan reachable through its task.
Passchat.catalog-complete-conditionsNo known catalog condition is omitted.
Passchat.catalog-original-human-queryThe persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Passchat.catalog-query-attachment-receiptsOnly declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Passchat.catalog-bounded-native-runsObserved provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Tokens72,322 in · 1,617 out165,376 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered43s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.documents-artifacts.write-plan
Attempt
1
Duration
1m 15s
Agent runtime
43s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

All invariants passed

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
33093749-0c33-4b81-b433-8169daf784a7unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
ResultMatcherExpectationDetail
Pass json_path {"kind":"json_path","path":"chat.complete-independent-observation","expected":true} Missing API, document, audit or rendered-link evidence cannot pass.
Pass json_path {"kind":"json_path","path":"chat.saved-implementation-plan","expected":true} A durable plan reflects the website's actual prerequisite brief and verification, rather than merely chat prose.
Pass json_path {"kind":"json_path","path":"chat.versioned-author","expected":true} The current document revision is attributed to this real agent run.
Pass json_path {"kind":"json_path","path":"chat.plan-audit","expected":true} The API audit records the CEO creating the plan after the request.
Pass json_path {"kind":"json_path","path":"chat.task-context-and-link","expected":true} Saving a plan preserves the task and makes the saved plan reachable through its task.
Pass json_path {"kind":"json_path","path":"chat.catalog-complete-conditions","expected":true} No known catalog condition is omitted.
Pass json_path {"kind":"json_path","path":"chat.catalog-original-human-query","expected":true} The persisted request preserves the catalog query with only audited public-fixture identity bindings; all human turns were declared.
Pass json_path {"kind":"json_path","path":"chat.catalog-query-attachment-receipts","expected":true} Only declared production attachment suffixes are allowed, backed by same-source human receipts and independently retrieved matching bytes.
Pass json_path {"kind":"json_path","path":"chat.catalog-bounded-native-runs","expected":true} Observed provider runs satisfy declared count, company, native runtime and allowed outcome bounds.
Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 72322,
      "outputTokens": 1617,
      "cachedInputTokens": 165376,
      "totalTokens": 239315,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 43362,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
Overall failed · No behavioral checks recorded

candidate failure

Stopped waiting for goals.align-existing-work: Settled scenario failed: phase-bound-strategic-context-explanation; Reporter privacy violation: omitted html-report/data/2f04cd43f58f0d4956f8e5726869df5ed9c33613.zip, omitted blob-report/report.zip, omitted playwright-output/runner-chat-features-runne-7f3c9-the-browser-and-public-APIs/trace.zip
Test detailsNo checks recorded · 6m 44s
Tokens158,697 in · 13,647 out1,092,352 cached · 2/2 runs covered
LLM spendUnavailable0/2 runs provider-priced
ExecutionLocal · not metered6m 2s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.goals.align-existing-work
Attempt
1
Duration
6m 44s
Agent runtime
6m 2s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
61242df1-9aed-4053-af8e-1825680d6467unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown
b8eaf216-b887-4108-99bc-9815638ec220unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 2,
      "runsWithTokenUsage": 2,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 158697,
      "outputTokens": 13647,
      "cachedInputTokens": 1092352,
      "totalTokens": 1264696,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 361823,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for Initial creation before explicit user retry; the observed state did not satisfy the condition. See the saved state evidence.
Test detailsNo checks recorded · 2m 49s
Tokens78,102 in · 1,529 out230,400 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered45s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.goals.create-goal-tree
Attempt
1
Duration
2m 49s
Agent runtime
45s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
e7895813-92c2-4ef5-b134-26d7c1d3e8b5unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 78102,
      "outputTokens": 1529,
      "cachedInputTokens": 230400,
      "totalTokens": 310031,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 45485,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
Overall failed · No behavioral checks recorded

candidate failure

Stopped waiting for inbox-search.find-design: Settled scenario failed: approved-design-distinguished-from-newer-draft
Test detailsNo checks recorded · 3m 18s
Tokens69,012 in · 4,578 out495,744 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered2m 39s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.inbox-search.find-design
Attempt
1
Duration
3m 18s
Agent runtime
2m 39s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
17872258-cc3d-4ef7-a830-3b91d52f33a1unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 69012,
      "outputTokens": 4578,
      "cachedInputTokens": 495744,
      "totalTokens": 569334,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 159178,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for routines.create-daily-brief; one-owned-launch-definition, weekday-nine-person-timezone, saved-agent-revision, schedule-and-work-location-explained, catalog-bounded-native-runs. See the saved state evidence.; Reporter privacy violation: omitted html-report/data/a88dd4094358a19f362e52db9676649ae8d8b870.zip, omitted playwright-output/runner-chat-features-runne-2e80d-the-browser-and-public-APIs/trace.zip
Test detailsNo checks recorded · 4m 53s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered4m 33s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.routines.create-daily-brief
Attempt
1
Duration
4m 53s
Agent runtime
4m 33s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
f8433976-d7da-4e05-b6af-677862ed5c7cunknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 107461,
      "outputTokens": 3205,
      "cachedInputTokens": 118710,
      "totalTokens": 229376,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 272627,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for routines.manage-other-owner; ownership-boundary-explained, catalog-bounded-native-runs. See the saved state evidence.; Reporter privacy violation: omitted html-report/data/c4320bc6b2e770c9d559d718aad85b844531cb70.zip, omitted playwright-output/runner-chat-features-runne-7917a-the-browser-and-public-APIs/trace.zip
Test detailsNo checks recorded · 4m 47s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered4m 27s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.routines.manage-other-owner
Attempt
1
Duration
4m 47s
Agent runtime
4m 27s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
ffd5787e-2f28-4da6-8ab1-44b18856d433unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 31337,
      "outputTokens": 4008,
      "cachedInputTokens": 60416,
      "totalTokens": 95761,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 267136,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for task-coordination.reject-dependency-cycle; explains-actual-conflict-and-next-decision, catalog-bounded-native-runs. See the saved state evidence.
Test detailsNo checks recorded · 4m 55s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered4m 33s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.task-coordination.reject-dependency-cycle
Attempt
1
Duration
4m 55s
Agent runtime
4m 33s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
e04aca3f-1011-498b-966f-cbc02d9fea50unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 56422,
      "outputTokens": 6918,
      "cachedInputTokens": 521472,
      "totalTokens": 584812,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 273164,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for tasks.attachment-brief; one-contextual-ordinary-work-task, durable-brief-in-work-context, morgan-can-read-the-real-brief, separate-real-worker-admission, catalog-bounded-native-runs, catalog-settled-source-separate-work. See the saved state evidence.
Test detailsNo checks recorded · 4m 52s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered4m 26s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.tasks.attachment-brief
Attempt
1
Duration
4m 52s
Agent runtime
4m 26s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
31f58398-b905-47d2-8146-c46de067702funknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 36219,
      "outputTokens": 5201,
      "cachedInputTokens": 93184,
      "totalTokens": 134604,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 266238,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
Overall failed · No behavioral checks recorded

candidate failure

Timed out waiting for tasks.website-task; one-ordinary-company-task, requested-work-captured, one-launch-and-attribution, retained-chat-and-links, separate-admitted-worker, catalog-bounded-native-runs, catalog-settled-source-separate-work. See the saved state evidence.
Test detailsNo checks recorded · 4m 51s
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered4m 27s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.tasks.website-task
Attempt
1
Duration
4m 51s
Agent runtime
4m 27s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
06a51b48-c4bf-403a-b3f4-5bad2cf2fed2unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 31567,
      "outputTokens": 3987,
      "cachedInputTokens": 60928,
      "totalTokens": 96482,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 266521,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
Overall failed · No behavioral checks recorded

candidate failure

Stopped waiting for teams.find-team: Settled scenario failed: existing-package-grounding, package-requirements-described
Test detailsNo checks recorded · 3m 21s
Tokens34,019 in · 5,104 out152,064 cached · 1/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered2m 50s agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-features.runner-opencode.local.teams.find-team
Attempt
1
Duration
3m 21s
Agent runtime
2m 50s
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

No result artifact was uploaded

Startup reuse evidence
RunWarmthEnvironment/leaseWorkspaceRunnerProvider processProvider sessionProvider launches
508d2310-f854-4810-abea-22b60b86d229unknown unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing)unknown (evidence_missing) unknown

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 1,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 34019,
      "outputTokens": 5104,
      "cachedInputTokens": 152064,
      "totalTokens": 191187,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unpriced"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": 169988,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}