Basic response
not selected
core-compatibility.legacy-codex.local.message-marker
Matchers and test context
Not selected
No matcher result was recorded.
Full-stack acceptance campaign
Runner Full-Stack E2E
A browser-verified matrix of runner profiles, execution environments, and deterministic task contracts. Visual evidence is retained in the access-controlled workflow artifact; public history contains inert structured evidence only.
0/4Passed
4Failed
6m 11sTest time
31,155Input tokens
1,650Output tokens
17,155Cached tokens
$0.001236LLM reported subtotal
$0.0156Daytona list estimate
4m 32sAgent execution time
3m 30sDaytona lease time
2/12Runs provider-priced
Model spend is the provider-reported subtotal; unpriced or unavailable runs are excluded, never counted as free. Daytona runtime is a public-list-price estimate from captured lease time and pinned resources, before credits, discounts, storage allowance, or invoice adjustments. Local execution has no external runtime meter.
Test suite
Core Runner Compatibility
Major provider, runtime generation, and execution-environment compatibility.
Pass rate0.0%0/4 passed
Tokens49,96031,155 input · 1,650 output
Cost$0.0168reported LLM + runtime estimate
Agent time4m 32s3m 30s lease
Execution4/40 retries · cleanup passed
Configuration matrix7 profiles · 2 environments · 4 selected
| Agent profile | Isolated locallocal · local | Daytona sandboxdaytona · remote |
|---|---|---|
Legacy Codexlegacycodex · gpt-5.6-sol
|
Isolated locallocal · local
Plan, revise, accept, implement
not selected
core-compatibility.legacy-codex.local.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.legacy-codex.local.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Daytona sandboxdaytona · remote
Basic response
not selected
core-compatibility.legacy-codex.daytona.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.legacy-codex.daytona.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.legacy-codex.daytona.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Legacy Claudelegacyclaude · claude-sonnet-4-6
|
Isolated locallocal · local
Basic response
not selected
core-compatibility.legacy-claude.local.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.legacy-claude.local.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.legacy-claude.local.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Daytona sandboxdaytona · remote
Basic response
not selected
core-compatibility.legacy-claude.daytona.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.legacy-claude.daytona.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.legacy-claude.daytona.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Legacy OpenCodelegacyopencode · openrouter/deepseek/deepseek-v4-flash-0731
|
Isolated locallocal · local
Basic response
not selected
core-compatibility.legacy-opencode.local.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.legacy-opencode.local.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.legacy-opencode.local.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Daytona sandboxdaytona · remote
Basic response
not selected
core-compatibility.legacy-opencode.daytona.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.legacy-opencode.daytona.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.legacy-opencode.daytona.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Runner Codexnativecodex · gpt-5.6-sol
|
Isolated locallocal · local
Basic response
not selected
core-compatibility.runner-codex.local.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.runner-codex.local.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.runner-codex.local.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Daytona sandboxdaytona · remote
Basic response
not selected
core-compatibility.runner-codex.daytona.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
failed
Tokens15,714 in · 520 out15,363 cached · 1/3 runs covered
LLM spend$0.0000001/3 runs provider-priced
Execution$0.002738 est.51s agent · 37s lease
core-compatibility.runner-codex.daytona.plan-revise-accept
Matchers and test context
Secret leak in persisted Paperclip home state at paperclip-home/instances/runner-e2e-ac3cd8da1b039665/runtime/paperclip-runner/durable-sessions/quarantine/1a2a39c4c0af0c008665b7d81ddc7c549ed69ac16f49c53e7b409375c99fc187.identity_indeterminate.1788548929453.1752.a4b67b0c-49e9-4d53-8f31-00c901f11477/codex-home/auth.json: exact secret value No matcher result was recorded. Usage and billing metadata{
"billing": {
"llm": {
"runCount": 3,
"runsWithTokenUsage": 1,
"runsWithReportedCost": 1,
"inputTokens": 15714,
"outputTokens": 520,
"cachedInputTokens": 15363,
"totalTokens": 31597,
"reportedCostUsd": 0,
"costStatus": "partial"
},
"runtime": {
"provider": "daytona",
"agentRunDurationMs": 50937,
"leaseDurationMs": 36848,
"leaseCount": 2,
"cpuCores": 4,
"memoryGiB": 4,
"diskGiB": 10,
"estimatedListCostUsd": 0.0027378064,
"costStatus": "estimated",
"costSource": "daytona_public_list_price",
"pricingAsOf": "2026-08-27",
"pricingUrl": "https://www.daytona.io/pricing"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0.0027378064,
"observedAndEstimatedCostUsd": 0.0027378064,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "f7acdae5-db32-4f42-83cc-94d72ff32b0a",
"usage": null
},
{
"runId": "6f2cfc38-034f-43a9-b40b-a3156bf8af76",
"usage": null
},
{
"runId": "5d16c9a2-8a96-4993-8a0b-a9558ab61749",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 15714,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 520,
"sessionReused": false,
"rawInputTokens": 15714,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:b5c94378dfae8d9ea9ef9e8c3b6df4198daee43636d98d51e8b1558fab5ecdef",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:df2d1195cefb4a0a627d00745457f7510d030388e8286a47af8c483426af192b",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 520,
"cachedInputTokens": 15363,
"taskSessionReused": false,
"persistedSessionId": "01a06dd2-6fec-7802-9507-e7e4aea7e26b",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 15363,
"sessionRotationReason": null
}
}
]
}
}
Ask mode question
not selected
core-compatibility.runner-codex.daytona.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Runner OpenCodenativeopencode · openrouter/deepseek/deepseek-v4-flash-0731
|
Isolated locallocal · local
Basic response
not selected
core-compatibility.runner-opencode.local.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.runner-opencode.local.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.runner-opencode.local.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Daytona sandboxdaytona · remote
Basic response
not selected
core-compatibility.runner-opencode.daytona.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
failed
Tokens15,441 in · 1,130 out1,792 cached · 1/3 runs covered
LLM spend$0.0012361/3 runs provider-priced
Execution$0.003772 est.1m 10s agent · 51s lease
core-compatibility.runner-opencode.daytona.plan-revise-accept
Matchers and test context
Stopped waiting for revised plan confirmation for issue e5200e60-66fc-49f9-b2b9-e6bc8ffd1ff5: heartbeat run 0095bfa4-4b17-4cab-8a88-a0d5bb9ebba7 ended failed (adapter_failed): runner_state_identity_mismatch No matcher result was recorded. Usage and billing metadata{
"billing": {
"llm": {
"runCount": 3,
"runsWithTokenUsage": 1,
"runsWithReportedCost": 1,
"inputTokens": 15441,
"outputTokens": 1130,
"cachedInputTokens": 1792,
"totalTokens": 18363,
"reportedCostUsd": 0.001235737,
"costStatus": "partial"
},
"runtime": {
"provider": "daytona",
"agentRunDurationMs": 69811,
"leaseDurationMs": 50768,
"leaseCount": 2,
"cpuCores": 4,
"memoryGiB": 4,
"diskGiB": 10,
"estimatedListCostUsd": 0.0037720624,
"costStatus": "estimated",
"costSource": "daytona_public_list_price",
"pricingAsOf": "2026-08-27",
"pricingUrl": "https://www.daytona.io/pricing"
},
"reportedCostUsd": 0.001235737,
"estimatedRuntimeCostUsd": 0.0037720624,
"observedAndEstimatedCostUsd": 0.0050077994,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "20085451-ae59-4735-9042-34688888fcc3",
"usage": null
},
{
"runId": "0095bfa4-4b17-4cab-8a88-a0d5bb9ebba7",
"usage": null
},
{
"runId": "35c4ece5-740f-41f0-b5a9-a6e6d66a5876",
"usage": {
"model": "openrouter/deepseek/deepseek-v4-flash-0731",
"biller": "openai",
"costUsd": 0.001235737,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 15441,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 1130,
"sessionReused": false,
"rawInputTokens": 15441,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:bf9454977d578fb24df7a31ba14064da518528729c6adff2f5ccf704de46ae83",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:2f4c271a69ca07e1c95bbc4d5e94cebc4f69b1f51e0f645b1e7881c655b4a7b3",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 1130,
"cachedInputTokens": 1792,
"taskSessionReused": false,
"persistedSessionId": "ses_f922d8344ffe2gb06KBswkHNQd",
"cacheAdjustedCostUsd": 0.001235737,
"rawCachedInputTokens": 1792,
"sessionRotationReason": null
}
}
]
}
}
Ask mode question
not selected
core-compatibility.runner-opencode.daytona.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Claudenativeacpx · claude-sonnet-5
|
Isolated locallocal · local
Basic response
not selected
core-compatibility.runner-acpx-claude.local.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.runner-acpx-claude.local.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.runner-acpx-claude.local.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Daytona sandboxdaytona · remote
Basic response
not selected
core-compatibility.runner-acpx-claude.daytona.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
failed
Tokens0 in · 0 out0 cached · 0/3 runs covered
LLM spendunavailable0/3 runs provider-priced
Execution$0.004943 est.1m 29s agent · 1m 7s lease
core-compatibility.runner-acpx-claude.daytona.plan-revise-accept
Matchers and test context
Stopped waiting for revised plan confirmation for issue 88a89630-a3ca-4375-b641-da1011d050d5: heartbeat run ce9c6015-9f94-4953-93ab-e0bcf45d32e0 ended failed (adapter_failed): runner_state_identity_mismatch No matcher result was recorded. Usage and billing metadata{
"billing": {
"llm": {
"runCount": 3,
"runsWithTokenUsage": 0,
"runsWithReportedCost": 0,
"inputTokens": 0,
"outputTokens": 0,
"cachedInputTokens": 0,
"totalTokens": 0,
"reportedCostUsd": 0,
"costStatus": "unavailable"
},
"runtime": {
"provider": "daytona",
"agentRunDurationMs": 88567,
"leaseDurationMs": 66522,
"leaseCount": 3,
"cpuCores": 4,
"memoryGiB": 4,
"diskGiB": 10,
"estimatedListCostUsd": 0.0049425846,
"costStatus": "estimated",
"costSource": "daytona_public_list_price",
"pricingAsOf": "2026-08-27",
"pricingUrl": "https://www.daytona.io/pricing"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0.0049425846,
"observedAndEstimatedCostUsd": 0.0049425846,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "de28d15c-33f1-4748-808f-92be109f4eb6",
"usage": null
},
{
"runId": "ce9c6015-9f94-4953-93ab-e0bcf45d32e0",
"usage": null
},
{
"runId": "d609ee07-0e78-4ec4-b886-da73dc358a60",
"usage": {
"model": "claude-sonnet-5",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 0,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 0,
"sessionReused": false,
"rawInputTokens": 0,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:a618d0162975e7cffe4986cdd2bcd72ab1599f2a5ce136f2bdc446e96a6e50c3",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:732b0aad2ca73121276ffb1906187bc6a9088867b9e45f75cd07b0452d66ee15",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 0,
"cachedInputTokens": 0,
"taskSessionReused": false,
"persistedSessionId": "28be2eb0-af74-424d-a4e2-e0d5492d0658",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 0,
"sessionRotationReason": null
}
}
]
}
}
Ask mode question
not selected
core-compatibility.runner-acpx-claude.daytona.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Codexnativeacpx · gpt-5.6-sol
|
Isolated locallocal · local
Basic response
not selected
core-compatibility.runner-acpx-codex.local.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
not selected
core-compatibility.runner-acpx-codex.local.plan-revise-accept
Matchers and test contextNot selected No matcher result was recorded.
Ask mode question
not selected
core-compatibility.runner-acpx-codex.local.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Daytona sandboxdaytona · remote
Basic response
not selected
core-compatibility.runner-acpx-codex.daytona.message-marker
Matchers and test contextNot selected No matcher result was recorded.
Plan, revise, accept, implement
failed
Tokens0 in · 0 out0 cached · 0/3 runs covered
LLM spendunavailable0/3 runs provider-priced
Execution$0.004149 est.1m 3s agent · 56s lease
core-compatibility.runner-acpx-codex.daytona.plan-revise-accept
Matchers and test context
Stopped waiting for revised plan confirmation for issue c0ddc592-1fa1-478f-a68f-c2f505040d6f: heartbeat run e752a19b-88d0-4299-9289-2b052103ac54 ended failed (adapter_failed): runner_state_identity_mismatch No matcher result was recorded. Usage and billing metadata{
"billing": {
"llm": {
"runCount": 3,
"runsWithTokenUsage": 0,
"runsWithReportedCost": 0,
"inputTokens": 0,
"outputTokens": 0,
"cachedInputTokens": 0,
"totalTokens": 0,
"reportedCostUsd": 0,
"costStatus": "unavailable"
},
"runtime": {
"provider": "daytona",
"agentRunDurationMs": 63123,
"leaseDurationMs": 55837,
"leaseCount": 3,
"cpuCores": 4,
"memoryGiB": 4,
"diskGiB": 10,
"estimatedListCostUsd": 0.0041486891,
"costStatus": "estimated",
"costSource": "daytona_public_list_price",
"pricingAsOf": "2026-08-27",
"pricingUrl": "https://www.daytona.io/pricing"
},
"reportedCostUsd": 0,
"estimatedRuntimeCostUsd": 0.0041486891,
"observedAndEstimatedCostUsd": 0.0041486891,
"complete": false
},
"rawUsage": {
"runs": [
{
"runId": "fd0055e9-5734-4550-971b-9d97560e5798",
"usage": null
},
{
"runId": "e752a19b-88d0-4299-9289-2b052103ac54",
"usage": null
},
{
"runId": "a2c82f36-5e6a-4a70-b2d4-b9cb0a2e9d63",
"usage": {
"model": "gpt-5.6-sol",
"biller": "openai",
"costUsd": 0,
"provider": "openai",
"costStatus": "reported",
"billingType": "unknown",
"inputTokens": 0,
"usageSource": "per_run",
"freshSession": true,
"outputTokens": 0,
"sessionReused": false,
"rawInputTokens": 0,
"sessionRotated": false,
"configFreshness": {
"session": {
"reset": true,
"categories": [
"adapter",
"adapterConfig",
"agentRuntimeConfig",
"instructions",
"issueOverrides",
"workspaceConfig",
"environment",
"envBindings",
"secrets",
"runtimeSkills"
],
"resetReasons": [],
"nextFingerprint": "v1:sha256:47a408e8aa0eea015411daa29a8eed0fd5b84303005b91dff445c5624c3b37ea",
"changedCategories": [],
"taskSessionReused": false,
"fingerprintVersion": 1,
"taskSessionAvailable": false,
"storedFingerprintPresent": false
},
"version": 1,
"workspace": {
"action": "create",
"reasons": [],
"categories": [
"mode",
"projectWorkspace",
"strategy",
"repo",
"lifecycleCommands",
"runtimeServices",
"environment",
"realization"
],
"reuseRequested": false,
"nextFingerprint": "v1:sha256:0b2abb8b67392b540e12ad514327aed5e4e81a65ca39704d4713dc2fb34c2b58",
"workspaceReused": false,
"activeWorkspaceId": null,
"changedCategories": [],
"storedFingerprint": null,
"fingerprintVersion": 1,
"inferredFingerprint": null,
"previousWorkspaceId": null,
"configSnapshotRefreshed": false,
"storedFingerprintPresent": false
}
},
"rawOutputTokens": 0,
"cachedInputTokens": 0,
"taskSessionReused": false,
"persistedSessionId": "01a06dd2-820b-7522-a8d1-578ef6aeb5be",
"cacheAdjustedCostUsd": 0,
"rawCachedInputTokens": 0,
"sessionRotationReason": null
}
}
]
}
}
Ask mode question
not selected
core-compatibility.runner-acpx-codex.daytona.ask-question
Matchers and test contextNot selected No matcher result was recorded. |
Test suite
Local Session Integrity
Structured interaction and continuation qualification for every supported local profile.
Configuration matrix7 profiles · 1 environments · 0 selected
| Agent profile | Isolated locallocal · local |
|---|---|
Legacy Codexlegacycodex · gpt-5.6-sol
|
Isolated locallocal · local
Structured question, answer, resume
not selected
local-session-integrity.legacy-codex.local.structured-question-resume
Matchers and test contextNot selected No matcher result was recorded.
Structured question, server restart, answer, resume
not selected
local-session-integrity.legacy-codex.local.structured-question-restart-resume
Matchers and test contextNot selected No matcher result was recorded. |
Legacy Claudelegacyclaude · claude-sonnet-4-6
|
Isolated locallocal · local
Structured question, answer, resume
not selected
local-session-integrity.legacy-claude.local.structured-question-resume
Matchers and test contextNot selected No matcher result was recorded.
Structured question, server restart, answer, resume
not selected
local-session-integrity.legacy-claude.local.structured-question-restart-resume
Matchers and test contextNot selected No matcher result was recorded. |
Legacy OpenCodelegacyopencode · openrouter/deepseek/deepseek-v4-flash-0731
|
Isolated locallocal · local
Structured question, answer, resume
not selected
local-session-integrity.legacy-opencode.local.structured-question-resume
Matchers and test contextNot selected No matcher result was recorded.
Structured question, server restart, answer, resume
not selected
local-session-integrity.legacy-opencode.local.structured-question-restart-resume
Matchers and test contextNot selected No matcher result was recorded. |
Runner Codexnativecodex · gpt-5.6-sol
|
Isolated locallocal · local
Structured question, answer, resume
not selected
local-session-integrity.runner-codex.local.structured-question-resume
Matchers and test contextNot selected No matcher result was recorded.
Structured question, server restart, answer, resume
not selected
local-session-integrity.runner-codex.local.structured-question-restart-resume
Matchers and test contextNot selected No matcher result was recorded. |
Runner OpenCodenativeopencode · openrouter/deepseek/deepseek-v4-flash-0731
|
Isolated locallocal · local
Structured question, answer, resume
not selected
local-session-integrity.runner-opencode.local.structured-question-resume
Matchers and test contextNot selected No matcher result was recorded.
Structured question, server restart, answer, resume
not selected
local-session-integrity.runner-opencode.local.structured-question-restart-resume
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Claudenativeacpx · claude-sonnet-5
|
Isolated locallocal · local
Structured question, answer, resume
not selected
local-session-integrity.runner-acpx-claude.local.structured-question-resume
Matchers and test contextNot selected No matcher result was recorded.
Structured question, server restart, answer, resume
not selected
local-session-integrity.runner-acpx-claude.local.structured-question-restart-resume
Matchers and test contextNot selected No matcher result was recorded. |
Runner ACPX Codexnativeacpx · gpt-5.6-sol
|
Isolated locallocal · local
Structured question, answer, resume
not selected
local-session-integrity.runner-acpx-codex.local.structured-question-resume
Matchers and test contextNot selected No matcher result was recorded.
Structured question, server restart, answer, resume
not selected
local-session-integrity.runner-acpx-codex.local.structured-question-restart-resume
Matchers and test contextNot selected No matcher result was recorded. |
Test suite
OpenRouter Model Breadth
Weekly-ranked tool-capable OpenRouter models through native OpenCode on isolated local workspaces.
Configuration matrix4 profiles · 1 environments · 0 selected
| Agent profile | Isolated locallocal · local |
|---|---|
#1 DeepSeek V4 Flash 0731nativeopencode · openrouter/deepseek/deepseek-v4-flash-0731
|
Isolated locallocal · local
Hello and complete
not selected
openrouter-model-breadth.openrouter-deepseek-deepseek-v4-flash-0731.local.hello-complete
Matchers and test contextNot selected No matcher result was recorded.
Ask, answer, resume
not selected
openrouter-model-breadth.openrouter-deepseek-deepseek-v4-flash-0731.local.question-resume-complete
Matchers and test contextNot selected No matcher result was recorded. |
#3 Tencent HY 3nativeopencode · openrouter/tencent/hy3
|
Isolated locallocal · local
Hello and complete
not selected
openrouter-model-breadth.openrouter-tencent-hy3.local.hello-complete
Matchers and test contextNot selected No matcher result was recorded.
Ask, answer, resume
not selected
openrouter-model-breadth.openrouter-tencent-hy3.local.question-resume-complete
Matchers and test contextNot selected No matcher result was recorded. |
#4 Nemotron 3 Ultra 550B A55B (free)nativeopencode · openrouter/nvidia/nemotron-3-ultra-550b-a55b:free
|
Isolated locallocal · local
Hello and complete
not selected
openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.hello-complete
Matchers and test contextNot selected No matcher result was recorded.
Ask, answer, resume
not selected
openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.question-resume-complete
Matchers and test contextNot selected No matcher result was recorded.
Plan, approve, complete
not selected
openrouter-model-breadth.openrouter-nvidia-nemotron-3-ultra-550b-a55b-free.local.plan-approve-complete
Matchers and test contextNot selected No matcher result was recorded. |
#5 GPT-5.6 Lunanativeopencode · openrouter/openai/gpt-5.6-luna
|
Isolated locallocal · local
Hello and complete
not selected
openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.hello-complete
Matchers and test contextNot selected No matcher result was recorded.
Ask, answer, resume
not selected
openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.question-resume-complete
Matchers and test contextNot selected No matcher result was recorded.
Plan, approve, complete
not selected
openrouter-model-breadth.openrouter-openai-gpt-5-6-luna.local.plan-approve-complete
Matchers and test contextNot selected No matcher result was recorded. |
History
Campaign trends
No historical campaigns have been published yet.