# Current production chat evaluation: first four final corrections

This is a partial snapshot of run [40630370749](https://github.com/paperclipai/paperclip/actions/runs/40630370749), source `81bba1dd0d4f77448bf4c5e360f3c78760e34ce2`, production baseline `39e811c9c5226979fce42e052a27cfb28301018a`. Exact configured model: `openrouter/deepseek/deepseek-v4.1-flash-1017` through OpenCode/OpenRouter.

## What actually works on the current production baseline

| Actual human request | Observed end-to-end state proof | Existing evidence page |
| --- | --- | --- |
| Have Morgan report to Riley from now on. | Saved manager change and organization view; relevant assignment and company invariants retained, 9/9 checks. | [Pilot](https://d1p6rlowie26tp.cloudfront.net/runner-e2e/campaigns/gha-40620786554-1-five-report/) |
| Archive the Launch project but keep its history. | Actual archived project with readable retained history, 10/10 checks. | [Pilot](https://d1p6rlowie26tp.cloudfront.net/runner-e2e/campaigns/gha-40620786554-1-five-report/) |
| Save a short implementation plan on the website task. | Versioned plan saved on the intended task, actual document link and substantive brief facts retained, 9/9 checks. | [Twelve-case report](https://d1p6rlowie26tp.cloudfront.net/runner-e2e/campaigns/gha-40624431756-1-full12-report/) |
| Fix the confusing pricing paragraph and resolve my comment. | Actual anchored document edit and correct annotation resolution, unrelated feedback preserved, 9/9 checks. | [Twelve-case report](https://d1p6rlowie26tp.cloudfront.net/runner-e2e/campaigns/gha-40624431756-1-full12-report/) |

These four are measured passes on production39e. [The full 244-scenario coverage inventory and prerequisite lists](https://d1p6rlowie26tp.cloudfront.net/runner-e2e/campaigns/gha-40584967834-1-final34-report/) remain inspectable in the preceding historical report. Its old outcomes are historical, not extra current-baseline passes. Current measured outcomes and counts are below.

## First four final-correction outcomes

The first four selected final corrections all failed. Their original outcomes and prior attempts remain unchanged; these four final allowances are exhausted. All four completed cleanup and have evidence manifests with no leaks or missing files. The remaining 36 selected cells are held and unmeasured; queued jobs consume no scenario attempt. This snapshot does not establish a shared provider outage or transport cause.

| Scenario | Actual outcome and stage | Evidence-supported cause or limitation | Remaining correction |
| --- | --- | --- | --- |
| cases.browse-cases | FAIL; actual native succeeded | Correct C1/C2 plaintext results and excluded done C3, but the rendered reply had no usable case links. A separate UI propagation defect is being addressed; this result remains failed. | 0 |
| agents.managed-profile | FAIL; canonical query sent, native still running at phase deadline | Empty reply; no terminal error observed. No provider cause established. | 0 |
| budgets-costs.spend-breakdown | FAIL; main native succeeded | Reply reported repeated basic MCP request timeouts and did not supply the actual agent breakdown/incomplete-total outcome. Retained handler results exist; the delivery boundary/cause is unresolved. Warmup did not show the same markers. | 0 |
| budgets-costs.resolve-budget | FAIL; canonical query sent, native succeeded | Required honest incident guidance was absent; reply empty. No request-timeout marker in the retained normal log, and no provider cause established. | 0 |

## Current baseline coverage

Across the five-case pilot, twelve initial journeys, and these four final corrections: **21 distinct scenarios measured: 4 passed, 17 failed, 223 not measured on this production baseline**, totaling 244. There are 21 actual measurements on this refreshed baseline. Historical measurements and passes from earlier production/model lanes remain separate.

Current passing scenarios are `agents.change-manager`, `projects.archive-project`, `documents-artifacts.write-plan`, and `documents-artifacts.resolve-feedback`. A pass represents its actual tested end-to-end outcome, not coverage for other unrun scenarios. The previous official [twelve-case report](https://d1p6rlowie26tp.cloudfront.net/runner-e2e/campaigns/gha-40624431756-1-full12-report/) retains the complete preceding measured outcomes.

Unmeasured includes the 36 held cells of this manifest plus other unrun journeys, explicit invitation/core dependencies, external prerequisites, and incomplete or blocked public paths. None is counted as a pass or manufactured failure. No original measurement or timeout is regraded by this summary.