paperclip-runner evalsRecorded evaluation

context-before-action

context-before-action

Prompt

Fixture

unknown

Authority

{}

Current results

Model	Configuration	Result	Estimated cost	Run time
grok-4.7	live-acpx-0.13.1-grok-build-1.0.13-grok-4.7	PASS	unknown	2026-09-24T19:28:42.244Z

Assertions

context-call

semantic_operation

{
  "id": "context-call",
  "kind": "semantic_operation"
}

progress-call

semantic_operation

{
  "id": "progress-call",
  "kind": "semantic_operation"
}

context-before-progress

operation_order

{
  "id": "context-before-progress",
  "kind": "operation_order"
}

one-progress-comment

state_effect

{
  "id": "one-progress-comment",
  "kind": "state_effect"
}

terminal-completed

terminal

{
  "id": "terminal-completed",
  "kind": "terminal"
}

transcript-complete

transcript_complete

{
  "id": "transcript-complete",
  "kind": "transcript_complete"
}

mock-only

network

{
  "id": "mock-only",
  "kind": "network"
}

Full authored test definition

{
  "checks": [
    {
      "id": "context-call",
      "kind": "semantic_operation"
    },
    {
      "id": "progress-call",
      "kind": "semantic_operation"
    },
    {
      "id": "context-before-progress",
      "kind": "operation_order"
    },
    {
      "id": "one-progress-comment",
      "kind": "state_effect"
    },
    {
      "id": "terminal-completed",
      "kind": "terminal"
    },
    {
      "id": "transcript-complete",
      "kind": "transcript_complete"
    },
    {
      "id": "mock-only",
      "kind": "network"
    }
  ],
  "id": "context-before-action"
}