Archived
feat(verify): batch 17 verified (26-16)
Writer agent from the dossiers, checker CLEAN on all ten. 24 has no robbery or demand and fits no label; 21 is a stealth burglary; 18's Armed Robbery label unsupported; detention proposed 0->1 on 19, 20, 25; 16 weapons rests on the police response only (swatting policy call). Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GZZENdTLzNGsbNy4DyF1yt
This commit is contained in:
co-authored by
Claude Fable 5.1
parent
65de34c4bd
commit
bf17bff8a8
@@ -1,6 +1,12 @@
|
||||
import json, sys
|
||||
need={"id","summary","sequence","attempted","gaps","v1_label_supported","rationale","flags","contradictions","off_case_links","record_only","facts","notes_for_sofia"}
|
||||
b=json.load(open(sys.argv[1],encoding='utf-8')); bad=0
|
||||
import re, os
|
||||
nn=re.search(r'batch-(\d+)',sys.argv[1]).group(1)
|
||||
lists=json.load(open(os.path.join(os.path.dirname(sys.argv[1]),'batch-lists.json')))
|
||||
expected=lists.get(nn)
|
||||
if expected is not None and sorted(c['id'] for c in b)!=sorted(expected):
|
||||
print("ID MISMATCH: expected",sorted(expected),"got",sorted(c['id'] for c in b)); bad+=1
|
||||
print("cases:",len(b),"ids:",[c['id'] for c in b])
|
||||
for c in b:
|
||||
miss=need-set(c); cats=c['summary'].count('**')//2
|
||||
|
||||
Reference in New Issue
Block a user