feat(sources): Wayback pass, automatic trimming, detention rule, ten cases re-sourced
Second and third rounds on the dossier pipeline, reviewed locally before commit. Retrieval - wayback_pass.py: retries every BLOCKED/DEAD/THIN/ERROR linked source through the Wayback Machine; blocks carry the snapshot date, archive URL and the live verdict. 143 slots retried: 93 fetched, 37 no snapshot, 12 script shells, 1 PDF. - fetch_sources.py: fetch_wayback() helper. - add_extra_sources.py: files staged extra_* finds (web search, not on the DB record) into the store with a provenance note. - Cases re-sourced by web search: 248 (Oslo: Document.no, Avisa Oslo, NRK; the linked Le Parisien piece is case 242 and is marked OFF-CASE), 258 Kharkiv, 260 Singapore, 358 Bangkok, 365 Las Vegas, 388 Verneuil-sur-Seine, 390 Zoersel, 430 Homestead. 341 of 364 cases now hold a fetched article; 11, 66 and 399 have no public text source (podcast, police video, direct victim report). Trimming - auto_trim.py: case-anchored furniture cut for UNTRIMMED blocks. Finds the body run that mentions the case, merges across subheadings and short furniture gaps, drops teasers, share bars, date/URL/caption lines and subscription pitches; refuses pages with no record term or almost no body. 302 blocks trimmed; 16 left on auto-trim-review.md (7 OFF-CASE suspects). Every cut is labelled AUTO-TRIMMED, UNREVIEWED in the dossier; the full extract stays in staging/. Decisions with anchors in trim-decisions-auto.json. - build_cases.py / verify_all.py: banners for auto-trimmed and archived blocks, staged-file check extended to Wayback blocks, flag legend under the record. Detention rule - README "Definitions": the DB field `kidnappings` is the DETENTION violence type (victim, guard, staff or relative held to force submission or execute the theft), distinct from the Kidnapping scenario (taken away and held). - detention-flag-review.md / detention-flag-corrections.json: 40 records reviewed with evidence; 30 set-to-1 proposals accepted by the owner on 2026-09-06 (listed in corrections-approved.md), 10 still open. - apply_detention_wording.py: "Violence Used" in the 70 reviewed summaries now names detention explicitly (62 of 70 labelled), supported by the summary's own text; idempotent; supersedes the batch scripts' wording. Worklist and docs - sofia-worklist.md: 248 decisions, detention rule item replacing the old "no abduction" item, fresh-search section for the textless cases. - README-START-HERE.md: progress notes, run commands, next steps. - Bug fixed in passing: Wayback blocks stored in-memory text with carriage returns; now stored as read back from disk. verify_all.py PASSES (2321 checks). Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GZZENdTLzNGsbNy4DyF1yt
This commit is contained in:
StellarCrow
co-authored by
Claude Fable 5.1
Claude Fable 5.1
parent
499fd61f79
commit
439e83a4cb
@@ -26,6 +26,9 @@ DATABASE RECORD
|
||||
notes burglars took an damaged atms
|
||||
has_processed_date 1
|
||||
created_at 2025-11-13 05:44:45
|
||||
(flag legend: 'kidnappings' is the DETENTION flag — 1 when the victim was held against
|
||||
their will at any point, tied, locked in, held at gunpoint or taken away; it is NOT the
|
||||
same as the 'Kidnapping' scenario, which means taken away and held. See README, Definitions.)
|
||||
|
||||
AI SUMMARY [generated at bulk import, NOT verified against sources]
|
||||
**Victim:** Coinflip ATM
|
||||
@@ -58,19 +61,19 @@ By Eleanor Wilson2:30pm Dec 3, 2024/ Police hunt crypto ATM thieves in Melbourn
|
||||
Police are on the hunt for a pair of thieves who escaped with a cryptocurrency ATM after a ram raid at a shopping centre in Melbourne's northern suburbs this morning.Police allege a stolen Toyota Ute rammed the front doors of Merrifield City shopping centre in Mickleham just after 4am, before reversing into two ATM machines inside.CCTV vision exclusively obtained by 9News shows one of the men, dressed in bright orange, using a sledge hammer to knock a Coinflip Bitcoin ATM to the ground.CCTV captured the men dragging the ATM out of the Mickleham shopping centre. (Nine)The pair then ditched the Toyota when the machine proved too heavy to lift onto the back tray and instead dragged it out by hand, fleeing the scene in a dark-coloured sedan with the Coinflip ATM.Police will allege the thieves then dumped the ATM in a Coolaroo car park, before setting it alight.The Coinflip ATM, which allow users to buy and sell crypto using cash, had been pried open.Coinflip ATMs are used to trade cash for Bitcoin. (Nine) YOU MAY ALSO LIKE Crypto expert Steve Sammartino said crypto machines do not have the same security measures as conventional ATMS, which could have aided the thieves."The crypto machines aren't as robust as typical ATMs which are issued via banks," Sammartino said."Not all of them have dye bombs so that the money is unusable after they're broken into."The Coinflip ATM was found pried open and alight in a Coolaroo car park. (Nine)The offenders remain on the run and the sedan has not been located at this stage.
|
||||
|
||||
------------------------------------------------------------------------------------------------
|
||||
FETCHED ARTICLE 1 [RAW EXTRACT — NOT YET TRIMMED]
|
||||
!! This is the whole page as extracted. It still contains site furniture,
|
||||
!! and may contain teaser headlines for UNRELATED cases. Trim on read-through.
|
||||
!! Do not quote from it without checking the passage belongs to this case.
|
||||
FETCHED ARTICLE 1 [AUTO-TRIMMED — UNREVIEWED]
|
||||
!! Furniture was cut by a script keyed on this case's record, not by a person.
|
||||
!! It may still carry passages about OTHER cases from a round-up article.
|
||||
!! The full page extract is kept in staging/ if a cut needs revisiting.
|
||||
Source 9news.com.au
|
||||
URL https://www.9news.com.au/national/police-hunt-crypto-atm-thieves-in-melbourne-shopping-centre-ram-raid-mickleham/8e7b6106-ab8c-4374-82b5-76f147c42da8
|
||||
Field url
|
||||
Retrieved 2026-09-05T12:49:39+00:00 via raw HTTP retrieval, deterministic extraction (HTTP 200)
|
||||
Language unknown
|
||||
Kept paragraphs ALL 16 paragraphs, untrimmed
|
||||
Length 1,816 chars
|
||||
Integrity sha256 d4aafb096d74a5d9d4fa6d017daf2c995e7abdce2006f8ee1956b2b7b2098415
|
||||
Trimmed NOT TRIMMED. Full page extract; trim on read-through.
|
||||
Kept paragraphs headline [0] + 1-11 of 16
|
||||
Length 1,545 chars
|
||||
Integrity sha256 99b8ff04f2d72b6cdca97b60c0c815eb43e8e94a52371c5c144d78e2b5bf8897
|
||||
Trimmed AUTO-TRIMMED, unreviewed: kept paragraphs 1-11 plus headline [0]; dropped 0 leading and 4 trailing paragraphs. Case-term hits on page: 5.
|
||||
Caveat retrieved from a live page on the date above. Unlike text copied
|
||||
from the spreadsheet, there is no second copy to hash it against.
|
||||
------------------------------------------------------------------------------------------------
|
||||
@@ -101,14 +104,6 @@ The offenders remain on the run and the sedan has not been located at this stage
|
||||
|
||||
Anyone who witnessed the ram-raid or the fire, has dashcam/CCTV footage or information is urged to contact Crime Stoppers on 1800 333 000.
|
||||
|
||||
The Aussie family who moved overseas to buy a house back home
|
||||
|
||||
Five children hospitalised after jumping castles go airborne in two separate incidents
|
||||
|
||||
Qantas plane diverted after suspected engine issue
|
||||
|
||||
More than 46,000 homes without power as destructive winds lash NSW
|
||||
|
||||
================================================================================================
|
||||
generated from attacks-export-Gart-website.json + reported_K&R | case 198
|
||||
================================================================================================
|
||||
|
||||
Reference in New Issue
Block a user