paperclip-runner evalsRecorded evaluation

paperclip-runner eval suite

Provider-reported list cost (all attempts)Unavailable
Estimated model cost (all attempts)Unavailable

Current result for each included test and model/configuration combination. Each cell uses only the most recent attempt for that combination.

Test
grok-4.7
live-acpx-0.13.1-grok-build-1.0.13-grok-4.7 · acpx_runtime · 0.13.1
answer-status-questionPASS
avoid-generic-api-requestPASS
block-taskPASS
comment-on-approvalPASS
context-before-actionPASS
control-workspace-servicePASS
create-child-taskPASS
create-skillPASS
create-task-documentPASS
decide-approvalPASS
finish-taskPASS
get-approvalPASS
get-approval-contextPASS
get-company-agentPASS
get-task-contextPASS
get-workspace-runtimePASS
lazy-core-no-searchPASS
lazy-discover-agentsPASS
lazy-unauthorized-undisclosedPASS
list-approvalsPASS
list-company-agentsPASS
read-document-revisionsPASS
read-task-documentPASS
read-task-historyPASS
reassign-blocked-taskPASS
reassign-existing-taskPASS
reassign-without-permissionPASS
register-deliverablePASS
request-approvalPASS
request-human-confirmationPASS
request-task-reviewPASS
schedule-task-wakePASS
search-company-tasksPASS
set-task-dependenciesPASS
update-task-documentPASS
workflow-context-document-progressPASS
workflow-governed-waitPASS
workflow-orient-delegatePASS
workflow-workspace-recoveryPASS