Full-stack acceptance campaign

Runner Full-Stack E2E

Results across runner profiles and execution environments. Declared PNG screenshots and normalized results are retained with every published campaign; additional diagnostic evidence remains in the access-controlled workflow artifact.

2026-10-27T19:08:10.392Z2f68f4ffSource run ↗Campaign summary ↗

0/1Passed
1Failed
312msSummed attempt time
Campaign notes and coverage
# Current remote qualification and historical results

## Current OpenCode catalog: 0 passes, 1 failed initial, 243 unrun

The denominator remains **244 scenarios / 35 areas / 191 frozen capabilities**. No current remote feature has completed canonical chat or feature grading. The only consumed initial is `tasks.create-backlog`, which failed agent-readiness setup before canonical input in [run40530790741](https://github.com/paperclipai/paperclip/actions/runs/40530790741). Its original source0dd8 and result remain unchanged. [Original result report](https://d1p6rlowie26tp.cloudfront.net/runner-e2e/campaigns/gha-40530790741-1/). All other243 IDs below are future, unrun measurements; authored callbacks are not evidence that their behavior works.

## Latest credential diagnostic — outside the244

[Run40561571573 attempt1](https://github.com/paperclipai/paperclip/actions/runs/40561571573) used source `2f68f4ff3c4be3ff608823e556cc000eb6948a06`, exact production baseline50b932, OpenCode/OpenRouter `openrouter/deepseek/deepseek-v4.1-flash-1017`, and actual AWS Spot/x86_64 with ordinary embedded PostgreSQL. The single fixed read-only OpenRouter current-key request returned **HTTP401**, code `auth-rejected`, `recognized: false`; expiry and budget were unknown. The source guard stopped before agent fixtures or any hello/model call. Cleanup passed. This diagnostic is outside244 and changes no scenario ordinal, pass rate or backlog correction.

The authenticated original result and its retained classification `transient_infrastructure` are unchanged. We infer no credential cause beyond the observed rejection. No credential value, response body, account identity or monetary amount is retained in this public projection. Artifact12763471080 SHA256 `8140e959b00db666f21767196134d9b678c8935f97028371a7625ddca6c80f23`.

The prior [embedded health report](https://d1p6rlowie26tp.cloudfront.net/runner-e2e/campaigns/gha-40553618239-1-report-r2/) preserves source78de/run40553618239 and the original sanitized hello error “User not found.” That was a different diagnostic, not another catalog case. The139d first health and e68d Docker host refusal also remain distinct. This report preserves attempt1 before any separately authorized credential repair or same-run rescheduling; it does not claim a repair succeeded.

## Historical local Codex:17 original initial passes

These are original local one-time measurements of provider `codex`, model `gpt-5.6-sol`, production baseline8373 with original per-attempt source/definition identities. They are **not current OpenCode or updated-production qualification**. Across158 attempted IDs:17 initial passes,141 initial failures,159 retained measurements including one historical correction, and86 unrun. [Immutable historical report](https://d1p6rlowie26tp.cloudfront.net/runner-e2e/campaigns/historical-local-codex-chat-catalog-20261027-158measured-86unrun/) and [original summary](https://d1p6rlowie26tp.cloudfront.net/runner-e2e/campaigns/historical-local-codex-chat-catalog-20261027-158measured-86unrun/summary.md). Unpriced cost is unknown, not zero.

- access.private-resource
- agents.agent-api-key
- assistant-connections.decline-consent
- chat-channels.provider-disabled
- companies.archive-company
- companies.rename-company
- inbox-search.archive-partial-failure
- instance-operations.instance-settings
- projects.project-work
- questions-and-approvals.accept-one-proposal
- questions-and-approvals.ambiguous-yes
- runs-adapters.list-model-options
- steering.preserve-draft
- task-coordination.reject-dependency-cycle
- tasks.create-backlog
- tasks.delegate-announcement
- tasks.website-task

## Six incomplete or blocked journeys

These remain incomplete/blocked despite registration and prerequisite probes; no passing E2E coverage is claimed.

- access.invite-teammate
- access.manage-membership
- activity.routine-audit
- agents.restore-instructions
- budgets-costs.subscription-fees
- skills.enable-for-agent

## All244 current remote statuses

### Failed initial before canonical query (1)

- tasks.create-backlog

### Passed current remote scenarios (0)

None.

### Unrun current remote scenarios (243), grouped by area

#### access (6)

- access.cli-authorization
- access.invite-teammate
- access.manage-membership
- access.other-company
- access.private-resource
- access.sign-in

#### activity (6)

- activity.agent-feedback
- activity.audit-change
- activity.company-overview
- activity.find-runs
- activity.routine-audit
- activity.work-timeline

#### agent-chat (6)

- agent-chat.chat-disabled
- agent-chat.conference-room
- agent-chat.multiple-handoffs
- agent-chat.remember-and-follow-up
- agent-chat.reopen-conversation
- agent-chat.track-delegated-work

#### agents (16)

- agents.agent-api-key
- agents.ambiguous-cloud-code
- agents.change-manager
- agents.choose-primary
- agents.configure-required-agent
- agents.edit-instructions
- agents.existing-grok-bot
- agents.hire-claude-code
- agents.hire-denied
- agents.hire-needs-account
- agents.hire-needs-approval
- agents.managed-profile
- agents.pause-agent
- agents.restore-instructions
- agents.resume-agent
- agents.retire-agent

#### app-permissions (6)

- app-permissions.ask-before-action
- app-permissions.grant-one-agent
- app-permissions.new-quarantined-action
- app-permissions.read-allowed-write-off
- app-permissions.revoke-account
- app-permissions.test-as-agent

#### assistant-connections (6)

- assistant-connections.connect-external-assistant
- assistant-connections.consent-read-only
- assistant-connections.decline-consent
- assistant-connections.device-login
- assistant-connections.revoke-personal-grant
- assistant-connections.use-scoped-client

#### budgets-costs (6)

- budgets-costs.explain-hard-stop
- budgets-costs.repair-cost-recording
- budgets-costs.resolve-budget
- budgets-costs.set-budget
- budgets-costs.spend-breakdown
- budgets-costs.subscription-fees

#### cases (8)

- cases.browse-cases
- cases.case-history
- cases.cases-disabled
- cases.close-case
- cases.create-case
- cases.handoff-same-task
- cases.related-work
- cases.update-case-facts

#### chat-channels (8)

- chat-channels.channel-file
- chat-channels.connect-slack
- chat-channels.link-sender
- chat-channels.outbound-email
- chat-channels.provider-disabled
- chat-channels.repair-endpoint
- chat-channels.reply-in-thread
- chat-channels.reply-to-email

#### cli-operations (6)

- cli-operations.choose-cli-context
- cli-operations.create-from-cli
- cli-operations.export-document-cli
- cli-operations.feedback-bundle
- cli-operations.inspect-run-cli
- cli-operations.owned-dev-instance

#### companies (9)

- companies.agent-observability
- companies.archive-company
- companies.configure-decision-model
- companies.export-company
- companies.fast-responses
- companies.import-preview
- companies.prompt-injection-guard
- companies.rename-company
- companies.switch-company

#### connection-setup (13)

- connection-setup.channel-prerequisites
- connection-setup.choose-provider
- connection-setup.notion-agent-unassigned
- connection-setup.notion-connected
- connection-setup.notion-declined
- connection-setup.notion-expired
- connection-setup.notion-missing
- connection-setup.notion-wrong-account
- connection-setup.return-from-login
- connection-setup.save-and-resume
- connection-setup.secure-api-key
- connection-setup.unreachable-mcp
- connection-setup.wrong-person-resolves

#### developer-labs (4)

- developer-labs.component-reference
- developer-labs.gated-lab
- developer-labs.interaction-fixture
- developer-labs.long-thread-performance

#### documents-artifacts (7)

- documents-artifacts.find-artifact
- documents-artifacts.private-download
- documents-artifacts.produce-download
- documents-artifacts.resolve-feedback
- documents-artifacts.restore-document
- documents-artifacts.revise-delivery
- documents-artifacts.write-plan

#### execution-environments (5)

- execution-environments.add-computer
- execution-environments.assign-computer
- execution-environments.choose-capable-target
- execution-environments.prepare-image
- execution-environments.test-computer

#### gateways-profiles (5)

- gateways-profiles.connect-client
- gateways-profiles.create-gateway
- gateways-profiles.define-profile
- gateways-profiles.inspect-gateway-error
- gateways-profiles.rotate-token

#### goals (3)

- goals.align-existing-work
- goals.create-goal-tree
- goals.explain-purpose

#### inbox-search (8)

- inbox-search.archive-done
- inbox-search.archive-partial-failure
- inbox-search.archive-without-grant
- inbox-search.find-design
- inbox-search.notification-audience
- inbox-search.restore-archive
- inbox-search.show-decisions
- inbox-search.show-my-work

#### instance-operations (6)

- instance-operations.backup-and-restore
- instance-operations.diagnose-health
- instance-operations.instance-settings
- instance-operations.provision-runtime
- instance-operations.restart-service
- instance-operations.update-instance

#### navigation-preferences (6)

- navigation-preferences.broken-link
- navigation-preferences.dismiss-announcement
- navigation-preferences.edit-profile
- navigation-preferences.find-project-view
- navigation-preferences.quick-search
- navigation-preferences.sidebar-order

#### onboarding (5)

- onboarding.choose-first-runtime
- onboarding.first-work
- onboarding.new-company
- onboarding.new-instance
- onboarding.resume-wizard

#### plugins (4)

- plugins.configure-plugin
- plugins.disable-plugin
- plugins.install-plugin
- plugins.use-plugin-tool

#### projects (8)

- projects.add-repository
- projects.archive-project
- projects.create-project
- projects.private-project
- projects.project-defaults
- projects.project-work
- projects.replace-repository
- projects.share-project

#### questions-and-approvals (12)

- questions-and-approvals.accept-one-proposal
- questions-and-approvals.ambiguous-yes
- questions-and-approvals.approve-tool-once
- questions-and-approvals.decline-tool
- questions-and-approvals.defer-and-reopen
- questions-and-approvals.duplicate-answer
- questions-and-approvals.formal-hire-revision
- questions-and-approvals.multi-part-question
- questions-and-approvals.necessary-question
- questions-and-approvals.reject-and-revise
- questions-and-approvals.review-plan
- questions-and-approvals.wrong-reviewer

#### recovery (8)

- recovery.browser-reconnect
- recovery.controller-restart
- recovery.explain-stall
- recovery.post-stop-message
- recovery.retry-exhausted
- recovery.source-action
- recovery.unknown-email-outcome
- recovery.workspace-repair

#### routines (7)

- routines.create-daily-brief
- routines.manage-other-owner
- routines.pause-owned
- routines.plugin-managed-routine
- routines.read-history
- routines.run-now
- routines.webhook-trigger

#### runs-adapters (5)

- runs-adapters.inspect-failed-run
- runs-adapters.list-model-options
- runs-adapters.reset-session
- runs-adapters.upgrade-runner
- runs-adapters.validate-hire

#### secrets (6)

- secrets.ask-for-plaintext
- secrets.configure-company-secret
- secrets.least-scope-delivery
- secrets.personal-secret
- secrets.secret-proposal
- secrets.vault-reference

#### skills (7)

- skills.author-skill
- skills.enable-for-agent
- skills.explicit-restriction
- skills.find-and-install
- skills.fork-read-only
- skills.review-update
- skills.studio-test

#### status-cards (5)

- status-cards.archive-card
- status-cards.create-card
- status-cards.explain-card
- status-cards.other-authors-card
- status-cards.refresh-card

#### steering (8)

- steering.approval-delivery
- steering.discard-queued-message
- steering.edit-queued-message
- steering.interrupt-with-direction
- steering.preserve-draft
- steering.queue-follow-up
- steering.steer-active
- steering.stop-versus-pause

#### task-coordination (5)

- task-coordination.block-on-design
- task-coordination.delegate-with-context
- task-coordination.independent-review
- task-coordination.pause-tree
- task-coordination.reject-dependency-cycle

#### tasks (12)

- tasks.ambiguous-task
- tasks.assignment-conflict
- tasks.attachment-brief
- tasks.comment-with-reference
- tasks.completion-with-gate
- tasks.delegate-announcement
- tasks.edit-properties
- tasks.organize-open-work
- tasks.private-task
- tasks.share-private-task
- tasks.website-task
- tasks.website-without-project

#### teams (4)

- teams.configure-team
- teams.find-team
- teams.install-team
- teams.preview-install

#### workspaces (7)

- workspaces.close-and-reopen
- workspaces.inspect-git
- workspaces.locate-files
- workspaces.prepare-repository
- workspaces.preview-service
- workspaces.private-repository-no-access
- workspaces.recover-lost-sandbox

This report is regenerated only from retained bytes; publication caused zero model/provider calls. Historical immutable prefixes are unchanged. No unmerged core PR contributes a passing result.
Campaign usage and spend
0 / 0Complaints / suggestions · retained attempts0 distinct items · 1 attempts with incomplete collection · 0 failed submissions · 0 unresolved submissions
1Retained attempts0 missing attempts · 0 out-of-scope artifacts
UnavailableInput tokens
UnavailableOutput tokens
UnavailableCached tokens
UnavailableLLM reported subtotal
$0.000000Daytona list estimate
312msObserved attempt window1 retained attempts · 0 missing attempts

Attempt durations include setup and cleanup captured inside each attempt. The observed window spans the earliest retained start to the latest retained finish, including gaps and overlap. Carried-forward evidence can span older runs, so this window is not the current workflow's duration. Neither measure is CI queue/setup time or provider-billed runtime.

UnknownAgent execution time
0msDaytona lease time
0/1Runs provider-priced

Campaign costs include retained attempts, including failed retries. Result cards show the selected attempt. Provider-reported amounts and model estimates are separate; unpriced or unavailable runs are excluded, never counted as free. Coverage describes captured usage; unobserved setup, subscriptions, tools, CI and storage require additional accounting. Daytona runtime is a public-list-price estimate from captured lease time and pinned resources, before credits, discounts, storage allowance, or invoice adjustments. Local execution has no external runtime meter.

UnknownWorker setup time
UnknownWorker execution time
UnknownWorker feedback time
UnknownWorker cleanup time
UnknownWorker finalization time

0/1 complete worker receipts; 0 partial; 0 missing attempts. Worker phases cover the test callback through finalization before result publication. Browser/server startup, parent cleanup, CI queue/build time and provider-billed runtime are outside these measurements. An interrupted phase has no inferred end time.

Campaign feedback review

0 distinct feedback items await review. Collection gaps and failed submissions remain separate findings.

Full bodies and review rationale stay in private evidence. Exact duplicate bodies are grouped once; related causes can be linked by a reviewed duplicate disposition.

All results

Feature coverage 0 of 192 capabilities linked · 0 of 1 tests mapped

Associations use the current feature map. Counts describe linked test scenarios; a passing journey does not establish full coverage of a capability.

Getting started and access

FeatureCapabilities linkedLinked test results
Onboarding and first work 0/5 No mapped journey
Login, invitations, and access 0/5 No mapped journey
Companies and portability 0/8 No mapped journey

Tasks and conversations

FeatureCapabilities linkedLinked test results
Task creation and lifecycle 0/6 No mapped journey
Delegation, dependencies, and signoff 0/4 No mapped journey
Inbox, decisions, and search 0/5 No mapped journey
Agent conversations and project handoff 0/4 No mapped journey
Questions and approvals 0/8 No mapped journey
Steering and queued messages 0/7 No mapped journey
Documents, attachments, and work products 0/5 No mapped journey

Agents and reusable capabilities

FeatureCapabilities linkedLinked test results
Hiring, configuration, and organization 0/9 No mapped journey
Runs, harnesses, and model accounts 0/5 No mapped journey
Skills and Skill Studio 0/5 No mapped journey
Team packages and installation 0/4 No mapped journey

Projects and execution

FeatureCapabilities linkedLinked test results
Projects and repositories 0/5 No mapped journey
Goals and work alignment 0/3 No mapped journey
Workspaces, services, and files 0/5 No mapped journey
Execution environments 0/5 No mapped journey
Recovery 0/8 No mapped journey

Apps, channels, and extensions

FeatureCapabilities linkedLinked test results
Connection setup 0/8 No mapped journey
Assistant connections (MCP) 0/5 No mapped journey
App access and action permissions 0/5 No mapped journey
External chat and email 0/6 No mapped journey
Tool gateways and access profiles 0/5 No mapped journey
Secrets and proposals 0/5 No mapped journey
Plugins 0/4 No mapped journey

Automation and structured work

FeatureCapabilities linkedLinked test results
Routines, schedules, and triggers 0/5 No mapped journey
Cases 0/5 No mapped journey
Status cards 0/4 No mapped journey

Oversight and operation

FeatureCapabilities linkedLinked test results
Costs and budgets 0/6 No mapped journey
Dashboards and audit trails 0/6 No mapped journey
Navigation, profile, and announcements 0/6 No mapped journey
Instance operations 0/6 No mapped journey
CLI/API and local worktrees 0/6 No mapped journey

Contributor surfaces

FeatureCapabilities linkedLinked test results
Developer previews and diagnostic labs 0/4 No mapped journey

Test suite

Chat provider setup health

Diagnostic only: one normal lifecycle hello, zero chat/task work; excluded from the 244 catalog scenarios.

Pass rate0.0%0/1 passed
TokensUnavailableUnavailable input · Unavailable output
Known spendUnavailablereported LLM + model/runtime estimates estimate
Agent timeUnknown0ms lease
Execution1/10 retries · cleanup passed
Native OpenCode OpenRouter DeepSeek V4.1 Flash 1017Isolated localopencode · openrouter/deepseek/deepseek-v4.1-flash-1017
Overall failed · No behavioral checks recorded

transient infrastructure

AUTH DIAGNOSTIC OUTSIDE THE 244 SCENARIOS: the single current-key GET returned HTTP401 auth-rejected, recognized false. The source guard stopped before agent setup or any hello/model call. Cleanup passed. No scenario initial or backlog correction was consumed; no credential cause beyond observed rejection is inferred.
Diagnostic outside244: current-key HTTP401; source guard stopped before hello/canonical input.
Test detailsNo checks recorded · 312ms
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not meteredUnknown agent

Worker phase timing: not captured.

Feedback was not captured for this attempt.

chat-setup-health.runner-opencode.local.setup-only
Attempt
1
Duration
312ms
Agent runtime
Unknown
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4.1-flash-1017

Diagnostic outside244: current-key HTTP401; source guard stopped before hello/canonical input.

No matcher result was recorded.

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null
}