paperclip-runner evalsRecorded evaluation

block-task-narrative-baseline

block-task-narrative-baseline

Prompt

Fixture

unknown

Authority

{}

Current results

Model	Configuration	Result	Estimated cost	Run time
gpt-5.4-mini	live-codex-pinned	FAIL	$0.001555 estimated	2026-09-22T00:45:23.192Z

Assertions

block

semantic_operation

{
  "id": "block",
  "kind": "semantic_operation"
}

task-blocked

state_record_field

{
  "id": "task-blocked",
  "kind": "state_record_field"
}

terminal-completed

terminal

{
  "id": "terminal-completed",
  "kind": "terminal"
}

transcript-complete

transcript_complete

{
  "id": "transcript-complete",
  "kind": "transcript_complete"
}

mock-only

network

{
  "id": "mock-only",
  "kind": "network"
}

no-unrelated-wake

semantic_operation

{
  "id": "no-unrelated-wake",
  "kind": "semantic_operation"
}

no-opposite-disposition

semantic_operation

{
  "id": "no-opposite-disposition",
  "kind": "semantic_operation"
}

narrative-reached-operation

evidence_match

{
  "id": "narrative-reached-operation",
  "kind": "evidence_match"
}

Full authored test definition

{
  "checks": [
    {
      "id": "block",
      "kind": "semantic_operation"
    },
    {
      "id": "task-blocked",
      "kind": "state_record_field"
    },
    {
      "id": "terminal-completed",
      "kind": "terminal"
    },
    {
      "id": "transcript-complete",
      "kind": "transcript_complete"
    },
    {
      "id": "mock-only",
      "kind": "network"
    },
    {
      "id": "no-unrelated-wake",
      "kind": "semantic_operation"
    },
    {
      "id": "no-opposite-disposition",
      "kind": "semantic_operation"
    },
    {
      "id": "narrative-reached-operation",
      "kind": "evidence_match"
    }
  ],
  "id": "block-task-narrative-baseline"
}