paperclip-runner evalsRecorded evaluation

workflow-context-document-progress

workflow-context-document-progress

Prompt

Fixture

unknown

Authority

{}

Current results

Model	Configuration	Result	Estimated cost	Run time
grok-4.7	live-acpx-0.13.1-grok-build-1.0.13-grok-4.7	PASS	unknown	2026-09-24T19:54:32.061Z

Assertions

context

semantic_operation

{
  "id": "context",
  "kind": "semantic_operation"
}

read

semantic_operation

{
  "id": "read",
  "kind": "semantic_operation"
}

write

semantic_operation

{
  "id": "write",
  "kind": "semantic_operation"
}

progress

semantic_operation

{
  "id": "progress",
  "kind": "semantic_operation"
}

read-before-write

operation_order

{
  "id": "read-before-write",
  "kind": "operation_order"
}

write-before-progress

operation_order

{
  "id": "write-before-progress",
  "kind": "operation_order"
}

progress-comment

state_effect

{
  "id": "progress-comment",
  "kind": "state_effect"
}

terminal-completed

terminal

{
  "id": "terminal-completed",
  "kind": "terminal"
}

mock-only

network

{
  "id": "mock-only",
  "kind": "network"
}

Full authored test definition

{
  "checks": [
    {
      "id": "context",
      "kind": "semantic_operation"
    },
    {
      "id": "read",
      "kind": "semantic_operation"
    },
    {
      "id": "write",
      "kind": "semantic_operation"
    },
    {
      "id": "progress",
      "kind": "semantic_operation"
    },
    {
      "id": "read-before-write",
      "kind": "operation_order"
    },
    {
      "id": "write-before-progress",
      "kind": "operation_order"
    },
    {
      "id": "progress-comment",
      "kind": "state_effect"
    },
    {
      "id": "terminal-completed",
      "kind": "terminal"
    },
    {
      "id": "mock-only",
      "kind": "network"
    }
  ],
  "id": "workflow-context-document-progress"
}