paperclip-runner evalsRecorded evaluation

finish-task-narrative-baseline

finish-task-narrative-baseline

Prompt

Fixture

unknown

Authority

{}

Current results

Model	Configuration	Result	Estimated cost	Run time
gpt-5.4-mini	live-codex-pinned	FAIL	$0.001534 estimated	2026-09-22T00:45:23.340Z

Assertions

finish

semantic_operation

{
  "id": "finish",
  "kind": "semantic_operation"
}

task-done

state_record_field

{
  "id": "task-done",
  "kind": "state_record_field"
}

terminal-completed

terminal

{
  "id": "terminal-completed",
  "kind": "terminal"
}

transcript-complete

transcript_complete

{
  "id": "transcript-complete",
  "kind": "transcript_complete"
}

mock-only

network

{
  "id": "mock-only",
  "kind": "network"
}

no-unrelated-wake

semantic_operation

{
  "id": "no-unrelated-wake",
  "kind": "semantic_operation"
}

no-opposite-disposition

semantic_operation

{
  "id": "no-opposite-disposition",
  "kind": "semantic_operation"
}

narrative-reached-operation

evidence_match

{
  "id": "narrative-reached-operation",
  "kind": "evidence_match"
}

Full authored test definition

{
  "checks": [
    {
      "id": "finish",
      "kind": "semantic_operation"
    },
    {
      "id": "task-done",
      "kind": "state_record_field"
    },
    {
      "id": "terminal-completed",
      "kind": "terminal"
    },
    {
      "id": "transcript-complete",
      "kind": "transcript_complete"
    },
    {
      "id": "mock-only",
      "kind": "network"
    },
    {
      "id": "no-unrelated-wake",
      "kind": "semantic_operation"
    },
    {
      "id": "no-opposite-disposition",
      "kind": "semantic_operation"
    },
    {
      "id": "narrative-reached-operation",
      "kind": "evidence_match"
    }
  ],
  "id": "finish-task-narrative-baseline"
}