Sofia/DB-cleanup
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Activity
Files
fetch-sheet-only-sources
DB-cleanup/merge-output/staging-progress.json
T
StellarCrowandClaude Fable 5.1 1387037367 feat(cases): pull 25 new cases (463-487) from stats.gart.io; dossiers, sources, trim 
- pull_live_cases.py: merges https://stats.gart.io/api/attacks into the export.
  The feed lacks notes/reports/original_date/has_processed_date, so existing
  records keep their fields; changed values are taken from live (record 188:
  victim, violence_torture, weapons, summary) and new records are appended
  with those four fields null. Previous export kept as
  attacks-export-Gart-website-2026-09-09-before.json; raw feed saved as
  attacks-live-api-2026-09-09.json. Export now has 389 records.
- 25 new dossiers built; 93 linked URL slots fetched (77 fetched, 8 blocked,
  4 thin, 4 video/social); 76 blocks auto-trimmed. Wayback retry for the 12
  failed slots hit archive.org rate limits (429) and is left for a later run.
- Sheet row 252 (the Phuket robbery listed in cases-missing-from-database.json)
  approved as the source for new case 476, which is that event.
- Stale dossier for renamed case 188 removed.
- Detention flag check on the new cases: 479 proposed 0->1 (forced entry plus
  assault), 468 null->0 proposed, 483 and 486 confirmed 0; review file and
  corrections JSON updated. Worklist and README carry the procedure.

verify_all.py PASSES (2776 checks, 389 case files).

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GZZENdTLzNGsbNy4DyF1yt
2026-09-09 18:17:12 +02:00

854 lines
9.2 KiB
JSON
Raw Permalink Blame History

{
"386": {
"FETCHED": 2
},
"362": {
"FETCHED": 1
},
"355": {
"THIN": 1
},
"354": {
"THIN": 1
},
"353": {
"FETCHED": 1
},
"350": {
"FETCHED": 1
},
"349": {
"BLOCKED": 1
},
"340": {
"FETCHED": 1
},
"334": {
"FETCHED": 1
},
"323": {
"BLOCKED": 1
},
"322": {
"BLOCKED": 1
},
"321": {
"FETCHED": 1
},
"318": {
"BLOCKED": 1,
"FETCHED": 2
},
"317": {
"FETCHED": 1
},
"312": {
"FETCHED": 1
},
"309": {
"FETCHED": 1
},
"308": {
"FETCHED": 1
},
"307": {
"THIN": 1
},
"304": {
"FETCHED": 1
},
"303": {
"FETCHED": 1
},
"301": {
"FETCHED": 1
},
"299": {
"FETCHED": 1
},
"298": {
"FETCHED": 1
},
"297": {
"FETCHED": 1
},
"296": {
"FETCHED": 1
},
"293": {
"BLOCKED": 1
},
"292": {
"FETCHED": 1
},
"290": {
"BLOCKED": 1
},
"288": {
"ERROR": 1
},
"285": {
"BLOCKED": 1
},
"279": {
"FETCHED": 1
},
"273": {
"FETCHED": 1
},
"272": {
"FETCHED": 1
},
"271": {
"THIN": 1
},
"270": {
"FETCHED": 1
},
"266": {
"FETCHED": 1
},
"263": {
"BLOCKED": 1
},
"257": {
"FETCHED": 2
},
"256": {
"BLOCKED": 1
},
"255": {
"FETCHED": 1,
"DEAD": 2
},
"254": {
"FETCHED": 1
},
"253": {
"BLOCKED": 1
},
"252": {
"FETCHED": 1
},
"249": {
"FETCHED": 1
},
"248": {
"BLOCKED": 1
},
"247": {
"BLOCKED": 1
},
"246": {
"FETCHED": 1
},
"245": {
"FETCHED": 1
},
"244": {
"FETCHED": 1
},
"243": {
"FETCHED": 1
},
"242": {
"FETCHED": 1
},
"241": {
"FETCHED": 1
},
"240": {
"FETCHED": 1
},
"238": {
"FETCHED": 1
},
"237": {
"THIN": 1
},
"236": {
"FETCHED": 1
},
"235": {
"NOT AN ARTICLE": 1
},
"234": {
"FETCHED": 1
},
"233": {
"FETCHED": 1
},
"232": {
"FETCHED": 1
},
"231": {
"FETCHED": 1
},
"230": {
"FETCHED": 1,
"NOT AN ARTICLE": 1
},
"229": {
"THIN": 1
},
"228": {
"FETCHED": 1,
"BLOCKED": 1
},
"224": {
"FETCHED": 1
},
"223": {
"BLOCKED": 1,
"FETCHED": 2
},
"222": {
"BLOCKED": 1
},
"221": {
"FETCHED": 1
},
"219": {
"BLOCKED": 1
},
"218": {
"THIN": 1
},
"217": {
"FETCHED": 1
},
"216": {
"FETCHED": 1
},
"215": {
"FETCHED": 1
},
"214": {
"BLOCKED": 1
},
"213": {
"THIN": 1
},
"212": {
"BLOCKED": 1
},
"211": {
"FETCHED": 1
},
"210": {
"BLOCKED": 1
},
"209": {
"FETCHED": 4,
"BLOCKED": 1
},
"208": {
"FETCHED": 1
},
"207": {
"BLOCKED": 1
},
"206": {
"FETCHED": 1
},
"205": {
"FETCHED": 1
},
"204": {
"FETCHED": 1
},
"203": {
"FETCHED": 2
},
"202": {
"FETCHED": 2
},
"201": {
"FETCHED": 1
},
"200": {
"FETCHED": 1
},
"199": {
"BLOCKED": 1
},
"198": {
"FETCHED": 1
},
"197": {
"THIN": 1
},
"196": {
"FETCHED": 1
},
"195": {
"BLOCKED": 1
},
"194": {
"BLOCKED": 1
},
"193": {
"FETCHED": 1
},
"190": {
"FETCHED": 1
},
"189": {
"FETCHED": 1
},
"188": {
"FETCHED": 1,
"THIN": 2
},
"187": {
"FETCHED": 1
},
"186": {
"FETCHED": 1
},
"185": {
"FETCHED": 1
},
"184": {
"FETCHED": 1
},
"183": {
"BLOCKED": 1
},
"182": {
"FETCHED": 1
},
"181": {
"FETCHED": 1
},
"180": {
"FETCHED": 1
},
"179": {
"BLOCKED": 1
},
"178": {
"FETCHED": 1
},
"177": {
"FETCHED": 1
},
"176": {
"DEAD": 1
},
"175": {
"FETCHED": 1
},
"174": {
"FETCHED": 1
},
"173": {
"FETCHED": 1
},
"172": {
"FETCHED": 1
},
"171": {
"FETCHED": 1
},
"170": {
"NOT AN ARTICLE": 1
},
"169": {
"FETCHED": 1
},
"168": {
"BLOCKED": 1
},
"167": {
"FETCHED": 1
},
"166": {
"FETCHED": 1
},
"164": {
"BLOCKED": 1
},
"162": {
"BLOCKED": 1
},
"161": {
"FETCHED": 1
},
"160": {
"BLOCKED": 1
},
"158": {
"FETCHED": 1
},
"157": {
"THIN": 1
},
"156": {
"FETCHED": 1
},
"154": {
"FETCHED": 1
},
"153": {
"FETCHED": 1
},
"152": {
"BLOCKED": 1
},
"151": {
"BLOCKED": 1
},
"150": {
"FETCHED": 1
},
"147": {
"FETCHED": 1
},
"145": {
"THIN": 1
},
"144": {
"FETCHED": 1
},
"143": {
"FETCHED": 1
},
"142": {
"FETCHED": 1
},
"141": {
"BLOCKED": 1
},
"139": {
"FETCHED": 1
},
"138": {
"BLOCKED": 1
},
"137": {
"FETCHED": 1
},
"136": {
"FETCHED": 1
},
"134": {
"FETCHED": 1
},
"133": {
"FETCHED": 1
},
"130": {
"FETCHED": 1
},
"128": {
"FETCHED": 1
},
"126": {
"FETCHED": 1
},
"124": {
"FETCHED": 1
},
"123": {
"FETCHED": 1
},
"122": {
"FETCHED": 1
},
"121": {
"FETCHED": 1
},
"118": {
"FETCHED": 1
},
"117": {
"FETCHED": 1
},
"116": {
"BLOCKED": 1
},
"114": {
"FETCHED": 1
},
"113": {
"BLOCKED": 1
},
"112": {
"FETCHED": 1
},
"111": {
"BLOCKED": 1
},
"110": {
"DEAD": 1
},
"109": {
"FETCHED": 1,
"NOT AN ARTICLE": 1
},
"108": {
"FETCHED": 1
},
"106": {
"FETCHED": 1
},
"105": {
"BLOCKED": 1
},
"104": {
"FETCHED": 1
},
"103": {
"FETCHED": 1
},
"102": {
"FETCHED": 1
},
"101": {
"ERROR": 1
},
"99": {
"FETCHED": 1
},
"97": {
"FETCHED": 1
},
"96": {
"FETCHED": 1
},
"94": {
"FETCHED": 1
},
"93": {
"FETCHED": 1
},
"92": {
"FETCHED": 1
},
"91": {
"DEAD": 1
},
"90": {
"FETCHED": 1
},
"89": {
"FETCHED": 1
},
"88": {
"FETCHED": 1
},
"86": {
"FETCHED": 1
},
"85": {
"FETCHED": 1
},
"84": {
"FETCHED": 1
},
"83": {
"FETCHED": 1
},
"82": {
"FETCHED": 1
},
"81": {
"FETCHED": 1
},
"80": {
"BLOCKED": 1
},
"79": {
"THIN": 1
},
"78": {
"FETCHED": 1
},
"77": {
"FETCHED": 1
},
"76": {
"FETCHED": 1
},
"74": {
"FETCHED": 1
},
"73": {
"FETCHED": 1
},
"72": {
"FETCHED": 1
},
"71": {
"DEAD": 1
},
"70": {
"FETCHED": 1
},
"69": {
"THIN": 1
},
"67": {
"BLOCKED": 1
},
"64": {
"FETCHED": 1
},
"63": {
"FETCHED": 1
},
"62": {
"DEAD": 1
},
"61": {
"FETCHED": 1
},
"60": {
"THIN": 1
},
"59": {
"FETCHED": 1
},
"58": {
"FETCHED": 1
},
"57": {
"BLOCKED": 1
},
"56": {
"BLOCKED": 1
},
"55": {
"FETCHED": 1
},
"54": {
"DEAD": 1
},
"53": {
"FETCHED": 1
},
"52": {
"FETCHED": 1
},
"51": {
"FETCHED": 1
},
"50": {
"FETCHED": 1
},
"49": {
"FETCHED": 1
},
"48": {
"FETCHED": 1
},
"46": {
"FETCHED": 1
},
"44": {
"DEAD": 1
},
"43": {
"FETCHED": 1
},
"42": {
"FETCHED": 1
},
"41": {
"BLOCKED": 1
},
"40": {
"ERROR": 1
},
"39": {
"FETCHED": 1
},
"38": {
"FETCHED": 1
},
"35": {
"FETCHED": 1
},
"34": {
"FETCHED": 1
},
"33": {
"BLOCKED": 1
},
"32": {
"BLOCKED": 1
},
"30": {
"BLOCKED": 1
},
"29": {
"FETCHED": 1
},
"28": {
"FETCHED": 1
},
"27": {
"FETCHED": 1
},
"26": {
"FETCHED": 1
},
"25": {
"FETCHED": 1
},
"24": {
"FETCHED": 1
},
"23": {
"FETCHED": 1
},
"22": {
"FETCHED": 1
},
"21": {
"THIN": 1
},
"20": {
"FETCHED": 1
},
"19": {
"FETCHED": 1
},
"18": {
"THIN": 1
},
"16": {
"BLOCKED": 1
},
"15": {
"FETCHED": 1
},
"14": {
"FETCHED": 1
},
"13": {
"FETCHED": 1
},
"12": {
"FETCHED": 1
},
"10": {
"FETCHED": 1
},
"9": {
"BLOCKED": 1
},
"8": {
"FETCHED": 1
},
"7": {
"FETCHED": 1
},
"6": {
"BLOCKED": 1
},
"5": {
"FETCHED": 1
},
"4": {
"FETCHED": 1
},
"3": {
"FETCHED": 1
},
"2": {
"FETCHED": 1
},
"1": {
"FETCHED": 1
},
"487": {
"FETCHED": 3
},
"486": {
"FETCHED": 1
},
"485": {
"FETCHED": 4
},
"484": {
"FETCHED": 3,
"NOT AN ARTICLE": 1,
"THIN": 1
},
"483": {
"FETCHED": 1,
"NOT AN ARTICLE": 1,
"THIN": 1
},
"482": {
"FETCHED": 5
},
"481": {
"FETCHED": 5
},
"480": {
"FETCHED": 3,
"BLOCKED": 1
},
"479": {
"FETCHED": 2,
"NOT AN ARTICLE": 1
},
"478": {
"FETCHED": 4
},
"477": {
"FETCHED": 2
},
"476": {
"FETCHED": 4,
"BLOCKED": 1
},
"475": {
"BLOCKED": 3,
"FETCHED": 2
},
"474": {
"FETCHED": 4
},
"473": {
"FETCHED": 2
},
"472": {
"FETCHED": 4
},
"471": {
"FETCHED": 4
},
"470": {
"FETCHED": 4
},
"469": {
"FETCHED": 4
},
"468": {
"FETCHED": 4,
"BLOCKED": 1
},
"467": {
"BLOCKED": 1,
"FETCHED": 1,
"THIN": 2
},
"466": {
"FETCHED": 4
},
"465": {
"NOT AN ARTICLE": 1,
"FETCHED": 1
},
"464": {
"FETCHED": 3
},
"463": {
"FETCHED": 3,
"BLOCKED": 1
}
}
Reference in New Issue View Git Blame Copy Permalink