paperclip-runner evalsRecorded evaluation

answer-status-question

answer-status-question

Prompt

Fixture

unknown

Authority

{}

Current results

Model	Configuration	Result	Estimated cost	Run time
grok-4.7	live-acpx-0.13.1-grok-build-1.0.13-grok-4.7	PASS	unknown	2026-09-24T19:30:00.478Z

Assertions

answer

semantic_operation

{
  "id": "answer",
  "kind": "semantic_operation"
}

one-answer

state_effect

{
  "id": "one-answer",
  "kind": "state_effect"
}

remains-active

state_match

{
  "id": "remains-active",
  "kind": "state_match"
}

no-finish

evidence_match

{
  "id": "no-finish",
  "kind": "evidence_match"
}

no-block

evidence_match

{
  "id": "no-block",
  "kind": "evidence_match"
}

no-review

evidence_match

{
  "id": "no-review",
  "kind": "evidence_match"
}

terminal-completed

terminal

{
  "id": "terminal-completed",
  "kind": "terminal"
}

mock-only

network

{
  "id": "mock-only",
  "kind": "network"
}

Full authored test definition

{
  "checks": [
    {
      "id": "answer",
      "kind": "semantic_operation"
    },
    {
      "id": "one-answer",
      "kind": "state_effect"
    },
    {
      "id": "remains-active",
      "kind": "state_match"
    },
    {
      "id": "no-finish",
      "kind": "evidence_match"
    },
    {
      "id": "no-block",
      "kind": "evidence_match"
    },
    {
      "id": "no-review",
      "kind": "evidence_match"
    },
    {
      "id": "terminal-completed",
      "kind": "terminal"
    },
    {
      "id": "mock-only",
      "kind": "network"
    }
  ],
  "id": "answer-status-question"
}