E2E campaign

E2E tests

App and agent journeys across deployment targets, profiles, and execution environments. Declared PNG screenshots and normalized results are retained with every published campaign; additional diagnostic evidence remains in the access-controlled workflow artifact.

2026-11-04T21:18:45.544Zbe20d4adSource run ↗

0/20Passed
20Failed
UnknownSummed attempt time
Campaign usage and spend
0 / 0Complaints / suggestions · retained attempts0 distinct items · 0 attempts with incomplete collection · 0 failed submissions · 0 unresolved submissions
0Retained attempts20 missing attempts · 0 out-of-scope artifacts
UnavailableInput tokens
UnavailableOutput tokens
UnavailableCached tokens
UnavailableLLM reported subtotal
$0.000000Daytona list estimate
UnknownObserved attempt window0 retained attempts · 20 missing attempts

Attempt durations include setup and cleanup captured inside each attempt. The observed window spans the earliest retained start to the latest retained finish, including gaps and overlap. Carried-forward evidence can span older runs, so this window is not the current workflow's duration. Neither measure is CI queue/setup time or provider-billed runtime.

UnknownAgent execution time
0msDaytona lease time
0/20Runs provider-priced

Campaign costs include retained attempts, including failed retries. Result cards show the selected attempt. Provider-reported amounts and model estimates are separate; unpriced or unavailable runs are excluded, never counted as free. Coverage describes captured usage; unobserved setup, subscriptions, tools, CI and storage require additional accounting. Daytona runtime is a public-list-price estimate from captured lease time and pinned resources, before credits, discounts, storage allowance, or invoice adjustments. Local execution has no external runtime meter.

UnknownWorker setup time
UnknownWorker execution time
UnknownWorker feedback time
UnknownWorker cleanup time
UnknownWorker finalization time

0/0 complete worker receipts; 0 partial; 20 missing attempts. Worker phases cover the test callback through finalization before result publication. Browser/server startup, parent cleanup, CI queue/build time and provider-billed runtime are outside these measurements. An interrupted phase has no inferred end time.

Campaign feedback review

0 distinct feedback items await review. Collection gaps and failed submissions remain separate findings.

Full bodies and review rationale stay in private evidence. Exact duplicate bodies are grouped once; related causes can be linked by a reviewed duplicate disposition.

All results

Feature coverage 16 of 192 capabilities linked · 19 of 20 tests mapped

Associations use the current feature map. Counts describe linked test scenarios; a passing journey does not establish full coverage of a capability.

Getting started and access

FeatureCapabilities linkedLinked test results
First task 1/5 0/4 passed · 4 failed or incomplete
Login, invitations, and access 0/5 No mapped journey
Companies and portability 0/8 No mapped journey

Tasks and conversations

FeatureCapabilities linkedLinked test results
Create · Properties 2/6 0/2 passed · 2 failed or incomplete
Delegation, dependencies, and signoff 0/4 No mapped journey
Inbox, decisions, and search 0/5 No mapped journey
History · Handoff 2/4 0/3 passed · 3 failed or incomplete
Questions · Confirmations · Plan review · Continuation 4/8 0/6 passed · 6 failed or incomplete
Stop and pause 1/7 0/1 passed · 1 failed or incomplete
Documents, attachments, and work products 0/5 No mapped journey

Agents and reusable capabilities

FeatureCapabilities linkedLinked test results
Hiring, configuration, and organization 0/9 No mapped journey
Runs · Session 2/5 0/4 passed · 4 failed or incomplete
Skills and Skill Studio 0/5 No mapped journey
Team packages and installation 0/4 No mapped journey

Projects and execution

FeatureCapabilities linkedLinked test results
Task context · Repositories 2/5 0/3 passed · 3 failed or incomplete
Goals and work alignment 0/3 No mapped journey
Binding · Provisioning 2/5 0/1 passed · 1 failed or incomplete
Execution environments 0/5 No mapped journey
Recovery 0/8 No mapped journey

Apps, channels, and extensions

FeatureCapabilities linkedLinked test results
Connection setup 0/8 No mapped journey
Assistant connections (MCP) 0/5 No mapped journey
App access and action permissions 0/5 No mapped journey
External chat and email 0/6 No mapped journey
Tool gateways and access profiles 0/5 No mapped journey
Secrets and proposals 0/5 No mapped journey
Plugins 0/4 No mapped journey

Automation and structured work

FeatureCapabilities linkedLinked test results
Routines, schedules, and triggers 0/5 No mapped journey
Cases 0/5 No mapped journey
Status cards 0/4 No mapped journey

Oversight and operation

FeatureCapabilities linkedLinked test results
Costs and budgets 0/6 No mapped journey
Dashboards and audit trails 0/6 No mapped journey
Navigation, profile, and announcements 0/6 No mapped journey
Instance operations 0/6 No mapped journey
CLI/API and local worktrees 0/6 No mapped journey

Contributor surfaces

FeatureCapabilities linkedLinked test results
Developer previews and diagnostic labs 0/4 No mapped journey

Test suite

Task workspaces without projects

Three browser-driven admissions prove deferred repository preparation, stable projectless task files and nested Git persistence across a controller restart.

Pass rate0.0%0/1 passed
TokensUnavailableUnavailable input · Unavailable output
Known spendUnavailablereported LLM + model/runtime estimates estimate
Agent timeUnknown0ms lease
Execution0/10 retries · cleanup failed
Runner OpenCodeIsolated localopencode · openrouter/deepseek/deepseek-v4-flash-0731
Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded
Test detailsNo checks recorded · 0ms
Tested URL
Not recorded
Environment
Isolated local
Model
openrouter/deepseek/deepseek-v4-flash-0731
Runtime
native · opencode
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered
Diagnostics

Worker phase timing: not captured.

Feedback was not captured for this attempt.

task-workspaces.runner-opencode.local.task-directory-repository-resume
  • Workspaces, services, and files · Binding
  • Workspaces, services, and files · Provisioning
  • Projects and repositories · Repositories
Attempt
0
Duration
0ms
Agent runtime
Unknown
Runtime
native
Provider
opencode
Model
openrouter/deepseek/deepseek-v4-flash-0731

No result artifact was uploaded

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null,
  "startupReuse": []
}

Test suite

Configured repository with verified delivery

Production instructions, retained configuration, and a downloaded result checked against an independent Git and file baseline.

Pass rate0.0%0/1 passed
TokensUnavailableUnavailable input · Unavailable output
Known spendUnavailablereported LLM + model/runtime estimates estimate
Agent timeUnknown0ms lease
Execution0/10 retries · cleanup failed
Codie staging-model diagnosticIsolated localcodex · gpt-6.1-sol
Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded
Test detailsNo checks recorded · 0ms
Tested URL
Not recorded
Environment
Isolated local
Model
gpt-6.1-sol
Runtime
native · codex
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered
Diagnostics

Worker phase timing: not captured.

Feedback was not captured for this attempt.

configured-repository.runner-codex.local.repository-output
Attempt
0
Duration
0ms
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-6.1-sol

No result artifact was uploaded

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null,
  "startupReuse": []
}

Test suite

Task continuation

Human direction, approval boundaries, untrusted evidence, and completed actions across turns.

Pass rate0.0%0/3 passed
TokensUnavailableUnavailable input · Unavailable output
Known spendUnavailablereported LLM + model/runtime estimates estimate
Agent timeUnknown0ms lease
Execution0/30 retries · cleanup failed
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded
Test detailsNo checks recorded · 0ms
Tested URL
Not recorded
Environment
Isolated local
Model
gpt-5.6-sol
Runtime
native · codex
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered
Diagnostics

Worker phase timing: not captured.

Feedback was not captured for this attempt.

continuation.runner-codex.local.clarification-not-approval
  • Questions and approvals · Questions
  • Questions and approvals · Confirmations
Attempt
0
Duration
0ms
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

No result artifact was uploaded

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null,
  "startupReuse": []
}
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded
Test detailsNo checks recorded · 0ms
Tested URL
Not recorded
Environment
Isolated local
Model
gpt-5.6-sol
Runtime
native · codex
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered
Diagnostics

Worker phase timing: not captured.

Feedback was not captured for this attempt.

continuation.runner-codex.local.revision-preserves-approval
  • Questions and approvals · Plan review
Attempt
0
Duration
0ms
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

No result artifact was uploaded

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null,
  "startupReuse": []
}
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded
Test detailsNo checks recorded · 0ms
Tested URL
Not recorded
Environment
Isolated local
Model
gpt-5.6-sol
Runtime
native · codex
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered
Diagnostics

Worker phase timing: not captured.

Feedback was not captured for this attempt.

continuation.runner-codex.local.completed-action-resume
  • Questions and approvals · Continuation
Attempt
0
Duration
0ms
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

No result artifact was uploaded

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null,
  "startupReuse": []
}

Test suite

First-task onboarding

Production onboarding, first replies, approval, and durable task execution.

Pass rate0.0%0/4 passed
TokensUnavailableUnavailable input · Unavailable output
Known spendUnavailablereported LLM + model/runtime estimates estimate
Agent timeUnknown0ms lease
Execution0/40 retries · cleanup failed
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded
Test detailsNo checks recorded · 0ms
Tested URL
Not recorded
Environment
Isolated local
Model
gpt-5.6-sol
Runtime
native · codex
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered
Diagnostics

Worker phase timing: not captured.

Feedback was not captured for this attempt.

first-task.runner-codex.local.task-card-accept
  • Onboarding and first work · First task
Attempt
0
Duration
0ms
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

No result artifact was uploaded

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null,
  "startupReuse": []
}
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded
Test detailsNo checks recorded · 0ms
Tested URL
Not recorded
Environment
Isolated local
Model
gpt-5.6-sol
Runtime
native · codex
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered
Diagnostics

Worker phase timing: not captured.

Feedback was not captured for this attempt.

first-task.runner-codex.local.clarify-propose-accept
  • Onboarding and first work · First task
Attempt
0
Duration
0ms
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

No result artifact was uploaded

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null,
  "startupReuse": []
}
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded
Test detailsNo checks recorded · 0ms
Tested URL
Not recorded
Environment
Isolated local
Model
gpt-5.6-sol
Runtime
native · codex
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered
Diagnostics

Worker phase timing: not captured.

Feedback was not captured for this attempt.

first-task.runner-codex.local.revise-accept
  • Onboarding and first work · First task
Attempt
0
Duration
0ms
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

No result artifact was uploaded

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null,
  "startupReuse": []
}
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded
Test detailsNo checks recorded · 0ms
Tested URL
Not recorded
Environment
Isolated local
Model
gpt-5.6-sol
Runtime
native · codex
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered
Diagnostics

Worker phase timing: not captured.

Feedback was not captured for this attempt.

first-task.runner-codex.local.reject-no-execution
  • Onboarding and first work · First task
Attempt
0
Duration
0ms
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

No result artifact was uploaded

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null,
  "startupReuse": []
}

Test suite

Persistent Agent Chat

Task-backed conversations, session resets, and project plan handoff.

Pass rate0.0%0/8 passed
TokensUnavailableUnavailable input · Unavailable output
Known spendUnavailablereported LLM + model/runtime estimates estimate
Agent timeUnknown0ms lease
Execution0/80 retries · cleanup failed
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded
Test detailsNo checks recorded · 0ms
Tested URL
Not recorded
Environment
Isolated local
Model
gpt-5.6-sol
Runtime
native · codex
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered
Diagnostics

Worker phase timing: not captured.

Feedback was not captured for this attempt.

agent-chat.runner-codex.local.create-backlog
  • Task creation and lifecycle · Create
Attempt
0
Duration
0ms
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

No result artifact was uploaded

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null,
  "startupReuse": []
}
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded
Test detailsNo checks recorded · 0ms
Tested URL
Not recorded
Environment
Isolated local
Model
gpt-5.6-sol
Runtime
native · codex
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered
Diagnostics

Worker phase timing: not captured.

Feedback was not captured for this attempt.

agent-chat.runner-codex.local.reassign-task
  • Task creation and lifecycle · Properties
Attempt
0
Duration
0ms
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

No result artifact was uploaded

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null,
  "startupReuse": []
}
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded
Test detailsNo checks recorded · 0ms
Tested URL
Not recorded
Environment
Isolated local
Model
gpt-5.6-sol
Runtime
native · codex
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered
Diagnostics

Worker phase timing: not captured.

Feedback was not captured for this attempt.

agent-chat.runner-codex.local.continuity-restart
  • Agent conversations and project handoff · History
  • Runs, harnesses, and model accounts · Session
Attempt
0
Duration
0ms
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

No result artifact was uploaded

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null,
  "startupReuse": []
}
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded
Test detailsNo checks recorded · 0ms
Tested URL
Not recorded
Environment
Isolated local
Model
gpt-5.6-sol
Runtime
native · codex
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered
Diagnostics

Worker phase timing: not captured.

Feedback was not captured for this attempt.

agent-chat.runner-codex.local.new-session
  • Agent conversations and project handoff · History
  • Runs, harnesses, and model accounts · Session
Attempt
0
Duration
0ms
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

No result artifact was uploaded

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null,
  "startupReuse": []
}
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded
Test detailsNo checks recorded · 0ms
Tested URL
Not recorded
Environment
Isolated local
Model
gpt-5.6-sol
Runtime
native · codex
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered
Diagnostics

Worker phase timing: not captured.

Feedback was not captured for this attempt.

agent-chat.runner-codex.local.stop-new-resume
  • Steering and queued messages · Stop and pause
  • Runs, harnesses, and model accounts · Session
Attempt
0
Duration
0ms
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

No result artifact was uploaded

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null,
  "startupReuse": []
}
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded
Test detailsNo checks recorded · 0ms
Tested URL
Not recorded
Environment
Isolated local
Model
gpt-5.6-sol
Runtime
native · codex
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered
Diagnostics

Worker phase timing: not captured.

Feedback was not captured for this attempt.

agent-chat.runner-codex.local.plan-handoff
  • Agent conversations and project handoff · Handoff
  • Questions and approvals · Plan review
Attempt
0
Duration
0ms
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

No result artifact was uploaded

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null,
  "startupReuse": []
}
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded
Test detailsNo checks recorded · 0ms
Tested URL
Not recorded
Environment
Isolated local
Model
gpt-5.6-sol
Runtime
native · codex
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered
Diagnostics

Worker phase timing: not captured.

Feedback was not captured for this attempt.

agent-chat.runner-codex.local.clarify-reuse
  • Projects and repositories · Task context
Attempt
0
Duration
0ms
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

No result artifact was uploaded

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null,
  "startupReuse": []
}
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded
Test detailsNo checks recorded · 0ms
Tested URL
Not recorded
Environment
Isolated local
Model
gpt-5.6-sol
Runtime
native · codex
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered
Diagnostics

Worker phase timing: not captured.

Feedback was not captured for this attempt.

agent-chat.runner-codex.local.multi-repository
  • Projects and repositories · Repositories
Attempt
0
Duration
0ms
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

No result artifact was uploaded

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null,
  "startupReuse": []
}

Test suite

Core Runner Compatibility

Major provider, runtime generation, and execution-environment compatibility.

Pass rate0.0%0/3 passed
TokensUnavailableUnavailable input · Unavailable output
Known spendUnavailablereported LLM + model/runtime estimates estimate
Agent timeUnknown0ms lease
Execution0/30 retries · cleanup failed
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded
Test detailsNo checks recorded · 0ms
Tested URL
Not recorded
Environment
Isolated local
Model
gpt-5.6-sol
Runtime
native · codex
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered
Diagnostics

Worker phase timing: not captured.

Feedback was not captured for this attempt.

core-compatibility.runner-codex.local.message-marker
  • Runs, harnesses, and model accounts · Runs
Attempt
0
Duration
0ms
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

No result artifact was uploaded

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null,
  "startupReuse": []
}
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded
Test detailsNo checks recorded · 0ms
Tested URL
Not recorded
Environment
Isolated local
Model
gpt-5.6-sol
Runtime
native · codex
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered
Diagnostics

Worker phase timing: not captured.

Feedback was not captured for this attempt.

core-compatibility.runner-codex.local.plan-revise-accept
  • Questions and approvals · Plan review
Attempt
0
Duration
0ms
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

No result artifact was uploaded

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null,
  "startupReuse": []
}
Runner CodexIsolated localcodex · gpt-5.6-sol
Overall failed · No behavioral checks recorded

permanent infrastructure

No result artifact was uploaded
Test detailsNo checks recorded · 0ms
Tested URL
Not recorded
Environment
Isolated local
Model
gpt-5.6-sol
Runtime
native · codex
TokensUnavailable in · Unavailable outUnavailable cached · 0/1 runs covered
LLM spendUnavailable0/1 runs provider-priced
ExecutionLocal · not metered
Diagnostics

Worker phase timing: not captured.

Feedback was not captured for this attempt.

core-compatibility.runner-codex.local.ask-question
  • Questions and approvals · Questions
Attempt
0
Duration
0ms
Agent runtime
Unknown
Runtime
native
Provider
codex
Model
gpt-5.6-sol

No result artifact was uploaded

Usage, billing and timing metadata
{
  "billing": {
    "llm": {
      "runCount": 1,
      "runsWithTokenUsage": 0,
      "runsWithReportedCost": 0,
      "runsWithEstimatedCost": 0,
      "runsWithPartialReportedCost": 0,
      "inputTokens": 0,
      "outputTokens": 0,
      "cachedInputTokens": 0,
      "totalTokens": 0,
      "reportedCostUsd": 0,
      "estimatedCostUsd": 0,
      "costStatus": "unavailable"
    },
    "runtime": {
      "provider": "local",
      "agentRunDurationMs": null,
      "leaseDurationMs": null,
      "leaseCount": 0,
      "costStatus": "not_metered",
      "costSource": "local_not_metered"
    },
    "reportedCostUsd": 0,
    "estimatedRuntimeCostUsd": 0,
    "observedAndEstimatedCostUsd": 0,
    "complete": false
  },
  "rawUsage": null,
  "workerTiming": null,
  "startupReuse": []
}