## Current remote coverage: completed 21-cell snapshot

OpenCode/OpenRouter model `deepseek/deepseek-v4.1-flash-1017`; historical Codex results are separate. This is a partial snapshot from [run 40584967834](https://github.com/paperclipai/paperclip/actions/runs/40584967834), not a completed 244-case campaign.

**44 measured scenarios: 4 passed / 40 failed / 200 unrun. 49 attempts: 4 passed / 45 failed.** Initial outcomes remain immutable; latest allowed outcomes determine these exclusive categories.

| Current status | Scenarios |
|---|---:|
| Live passes | 4 |
| Live failures pending reviewed disposition or final correction | 36 |
| Permanently failed after the one correction | 4 |
| Implemented but not yet run | 132 |
| Future: unmerged invitation core prerequisite | 20 |
| Future: explicit external prerequisite missing | 42 |
| Future: incomplete journey or missing public product path | 6 |
| **Total** | **244** |

The 21 completed cells in this run contain one genuine final pass and 20 overall failures; all cleanup results passed. The remaining 133 selected cells were unadmitted at the 21:39:01 UTC privacy-hold snapshot and consumed no ordinal. Subsequent continuation was authorized only for that unchanged set after a bounded source-containment review. Pending jobs are never measurements.

### Privacy failures remain failures

`assistant-connections.decline-consent` and `assistant-connections.revoke-personal-grant` each failed the persisted-state privacy scan with an exact registered-secret match in the disposable home database. The matched values’ identities remain **unknown**; no model/provider disclosure cause is established. Semantic checks do not override these failures. The matched database files are absent from retained report artifacts. Only sanitized summaries and existing allowlisted projections may be published; no raw database, credential, or private diagnostic bytes are included. Full scan protections remain unchanged.

### Actual result boundaries

Reopen-conversation passed its sole final correction 9/9 with same-run build/native proof; its original overall failure remains retained. Four scenarios exhausted their correction allowance and remain failed: create-backlog, sign-in, chat-disabled, and hire-denied. Sign-in and chat-disabled each passed 6/6 browser observations but failed overall because three mandatory evidence files were missing; neither is a pass. Comment-reference’s final correction remains unmeasured in this snapshot. No unchanged timeout retry is authorized.

The latest three results (resolve-budget, set-budget, and explain-hard-stop) failed their initial identity response after one observed run each; no feature outcome or universal provider/model cause is inferred. Repair-cost-recording stopped at an accounting prerequisite, whose fixture-versus-supported-path diagnosis remains open. Setup/hello usage is unknown when unexposed, never assumed zero.

Source `d4e8906dc36af80bff50cf5585954f0780b3ed27`, production `50b932a142216331b8d476042b454bc123739c40`, actual AWS lifecycle and embedded database are retained per measurement. Earlier remote production8373 history is preserved separately. The [historical local Codex campaign](https://d1p6rlowie26tp.cloudfront.net/runner-e2e/campaigns/historical-local-codex-chat-catalog-20261027-158measured-86unrun/) has 17 historical passes / 141 failed / 86 unrun and contributes no current remote pass credit. Six incomplete or blocked journeys remain in the denominator; implementation is not equivalent to verified passage.

### Live passes (4)

- `activity.audit-change`
- `agent-chat.reopen-conversation`
- `agents.change-manager`
- `companies.rename-company`

### Live failures pending reviewed disposition or final correction (36)

- `access.cli-authorization`
- `access.other-company`
- `access.private-resource`
- `activity.agent-feedback`
- `activity.company-overview`
- `activity.find-runs`
- `activity.work-timeline`
- `agent-chat.conference-room`
- `agent-chat.multiple-handoffs`
- `agent-chat.remember-and-follow-up`
- `agent-chat.track-delegated-work`
- `agents.agent-api-key`
- `agents.choose-primary`
- `agents.configure-required-agent`
- `agents.edit-instructions`
- `agents.hire-needs-approval`
- `agents.managed-profile`
- `agents.pause-agent`
- `agents.resume-agent`
- `agents.retire-agent`
- `app-permissions.ask-before-action`
- `app-permissions.new-quarantined-action`
- `app-permissions.read-allowed-write-off`
- `app-permissions.test-as-agent`
- `assistant-connections.decline-consent`
- `assistant-connections.device-login`
- `assistant-connections.revoke-personal-grant`
- `budgets-costs.explain-hard-stop`
- `budgets-costs.repair-cost-recording`
- `budgets-costs.resolve-budget`
- `budgets-costs.set-budget`
- `inbox-search.archive-without-grant`
- `inbox-search.show-my-work`
- `tasks.ambiguous-task`
- `tasks.comment-with-reference`
- `tasks.delegate-announcement`

### Permanently failed after the one correction (4)

- `access.sign-in`
- `agent-chat.chat-disabled`
- `agents.hire-denied`
- `tasks.create-backlog`

### Implemented but not yet run (132)

- `budgets-costs.spend-breakdown`
- `cases.browse-cases`
- `cases.case-history`
- `cases.cases-disabled`
- `cases.close-case`
- `cases.create-case`
- `cases.handoff-same-task`
- `cases.related-work`
- `cases.update-case-facts`
- `chat-channels.provider-disabled`
- `cli-operations.choose-cli-context`
- `cli-operations.create-from-cli`
- `cli-operations.export-document-cli`
- `cli-operations.feedback-bundle`
- `cli-operations.inspect-run-cli`
- `cli-operations.owned-dev-instance`
- `companies.agent-observability`
- `companies.archive-company`
- `companies.configure-decision-model`
- `companies.export-company`
- `companies.fast-responses`
- `companies.import-preview`
- `companies.prompt-injection-guard`
- `companies.switch-company`
- `connection-setup.choose-provider`
- `connection-setup.notion-declined`
- `connection-setup.secure-api-key`
- `connection-setup.unreachable-mcp`
- `developer-labs.component-reference`
- `developer-labs.gated-lab`
- `developer-labs.interaction-fixture`
- `developer-labs.long-thread-performance`
- `documents-artifacts.find-artifact`
- `documents-artifacts.produce-download`
- `documents-artifacts.resolve-feedback`
- `documents-artifacts.revise-delivery`
- `documents-artifacts.write-plan`
- `execution-environments.choose-capable-target`
- `gateways-profiles.connect-client`
- `gateways-profiles.create-gateway`
- `gateways-profiles.inspect-gateway-error`
- `gateways-profiles.rotate-token`
- `goals.align-existing-work`
- `goals.create-goal-tree`
- `goals.explain-purpose`
- `inbox-search.archive-partial-failure`
- `inbox-search.find-design`
- `instance-operations.backup-and-restore`
- `instance-operations.diagnose-health`
- `instance-operations.instance-settings`
- `instance-operations.provision-runtime`
- `instance-operations.restart-service`
- `instance-operations.update-instance`
- `navigation-preferences.find-project-view`
- `onboarding.first-work`
- `plugins.configure-plugin`
- `plugins.disable-plugin`
- `plugins.install-plugin`
- `plugins.use-plugin-tool`
- `projects.archive-project`
- `projects.create-project`
- `projects.project-defaults`
- `projects.project-work`
- `questions-and-approvals.accept-one-proposal`
- `questions-and-approvals.ambiguous-yes`
- `questions-and-approvals.approve-tool-once`
- `questions-and-approvals.decline-tool`
- `questions-and-approvals.defer-and-reopen`
- `questions-and-approvals.duplicate-answer`
- `questions-and-approvals.formal-hire-revision`
- `questions-and-approvals.multi-part-question`
- `questions-and-approvals.necessary-question`
- `questions-and-approvals.reject-and-revise`
- `questions-and-approvals.review-plan`
- `recovery.browser-reconnect`
- `recovery.controller-restart`
- `recovery.explain-stall`
- `recovery.post-stop-message`
- `recovery.retry-exhausted`
- `recovery.source-action`
- `routines.create-daily-brief`
- `routines.manage-other-owner`
- `routines.pause-owned`
- `routines.plugin-managed-routine`
- `routines.read-history`
- `routines.run-now`
- `routines.webhook-trigger`
- `runs-adapters.inspect-failed-run`
- `runs-adapters.list-model-options`
- `runs-adapters.reset-session`
- `secrets.ask-for-plaintext`
- `secrets.configure-company-secret`
- `secrets.least-scope-delivery`
- `secrets.secret-proposal`
- `skills.author-skill`
- `skills.explicit-restriction`
- `skills.find-and-install`
- `skills.fork-read-only`
- `skills.review-update`
- `skills.studio-test`
- `status-cards.archive-card`
- `status-cards.create-card`
- `status-cards.explain-card`
- `status-cards.other-authors-card`
- `status-cards.refresh-card`
- `steering.approval-delivery`
- `steering.discard-queued-message`
- `steering.edit-queued-message`
- `steering.interrupt-with-direction`
- `steering.preserve-draft`
- `steering.queue-follow-up`
- `steering.steer-active`
- `steering.stop-versus-pause`
- `task-coordination.block-on-design`
- `task-coordination.delegate-with-context`
- `task-coordination.independent-review`
- `task-coordination.pause-tree`
- `task-coordination.reject-dependency-cycle`
- `tasks.assignment-conflict`
- `tasks.attachment-brief`
- `tasks.edit-properties`
- `tasks.organize-open-work`
- `tasks.website-task`
- `tasks.website-without-project`
- `teams.configure-team`
- `teams.find-team`
- `teams.install-team`
- `teams.preview-install`
- `workspaces.close-and-reopen`
- `workspaces.inspect-git`
- `workspaces.locate-files`
- `workspaces.preview-service`

### Future: unmerged invitation core prerequisite (20)

- `assistant-connections.consent-read-only`
- `connection-setup.wrong-person-resolves`
- `documents-artifacts.private-download`
- `documents-artifacts.restore-document`
- `inbox-search.archive-done`
- `inbox-search.notification-audience`
- `inbox-search.restore-archive`
- `inbox-search.show-decisions`
- `navigation-preferences.broken-link`
- `navigation-preferences.dismiss-announcement`
- `navigation-preferences.edit-profile`
- `navigation-preferences.quick-search`
- `navigation-preferences.sidebar-order`
- `projects.private-project`
- `projects.share-project`
- `questions-and-approvals.wrong-reviewer`
- `secrets.personal-secret`
- `tasks.completion-with-gate`
- `tasks.private-task`
- `tasks.share-private-task`

### Future: explicit external prerequisite missing (42)

- `agents.ambiguous-cloud-code`
- `agents.existing-grok-bot`
- `agents.hire-claude-code`
- `agents.hire-needs-account`
- `app-permissions.grant-one-agent`
- `app-permissions.revoke-account`
- `assistant-connections.connect-external-assistant`
- `assistant-connections.use-scoped-client`
- `chat-channels.channel-file`
- `chat-channels.connect-slack`
- `chat-channels.link-sender`
- `chat-channels.outbound-email`
- `chat-channels.repair-endpoint`
- `chat-channels.reply-in-thread`
- `chat-channels.reply-to-email`
- `connection-setup.channel-prerequisites`
- `connection-setup.notion-agent-unassigned`
- `connection-setup.notion-connected`
- `connection-setup.notion-expired`
- `connection-setup.notion-missing`
- `connection-setup.notion-wrong-account`
- `connection-setup.return-from-login`
- `connection-setup.save-and-resume`
- `execution-environments.add-computer`
- `execution-environments.assign-computer`
- `execution-environments.prepare-image`
- `execution-environments.test-computer`
- `gateways-profiles.define-profile`
- `onboarding.choose-first-runtime`
- `onboarding.new-company`
- `onboarding.new-instance`
- `onboarding.resume-wizard`
- `projects.add-repository`
- `projects.replace-repository`
- `recovery.unknown-email-outcome`
- `recovery.workspace-repair`
- `runs-adapters.upgrade-runner`
- `runs-adapters.validate-hire`
- `secrets.vault-reference`
- `workspaces.prepare-repository`
- `workspaces.private-repository-no-access`
- `workspaces.recover-lost-sandbox`

### Future: incomplete journey or missing public product path (6)

- `access.invite-teammate`
- `access.manage-membership`
- `activity.routine-audit`
- `agents.restore-instructions`
- `budgets-costs.subscription-fees`
- `skills.enable-for-agent`


## Historical local Codex:17 original initial passes

These are original local one-time measurements of provider `codex`, model `gpt-5.6-sol`, production baseline8373 with original per-attempt source/definition identities. They are **not current OpenCode or updated-production qualification**. Across158 attempted IDs:17 initial passes,141 initial failures,159 retained measurements including one historical correction, and86 unrun. [Immutable historical report](https://d1p6rlowie26tp.cloudfront.net/runner-e2e/campaigns/historical-local-codex-chat-catalog-20261027-158measured-86unrun/) and [original summary](https://d1p6rlowie26tp.cloudfront.net/runner-e2e/campaigns/historical-local-codex-chat-catalog-20261027-158measured-86unrun/summary.md). Unpriced cost is unknown, not zero.

- access.private-resource
- agents.agent-api-key
- assistant-connections.decline-consent
- chat-channels.provider-disabled
- companies.archive-company
- companies.rename-company
- inbox-search.archive-partial-failure
- instance-operations.instance-settings
- projects.project-work
- questions-and-approvals.accept-one-proposal
- questions-and-approvals.ambiguous-yes
- runs-adapters.list-model-options
- steering.preserve-draft
- task-coordination.reject-dependency-cycle
- tasks.create-backlog
- tasks.delegate-announcement
- tasks.website-task

## Campaign feedback review

0 distinct feedback items await review. Collection gaps and failed submissions remain separate findings.
