feat(sources): Wayback pass, automatic trimming, detention rule, ten cases re-sourced
Second and third rounds on the dossier pipeline, reviewed locally before commit. Retrieval - wayback_pass.py: retries every BLOCKED/DEAD/THIN/ERROR linked source through the Wayback Machine; blocks carry the snapshot date, archive URL and the live verdict. 143 slots retried: 93 fetched, 37 no snapshot, 12 script shells, 1 PDF. - fetch_sources.py: fetch_wayback() helper. - add_extra_sources.py: files staged extra_* finds (web search, not on the DB record) into the store with a provenance note. - Cases re-sourced by web search: 248 (Oslo: Document.no, Avisa Oslo, NRK; the linked Le Parisien piece is case 242 and is marked OFF-CASE), 258 Kharkiv, 260 Singapore, 358 Bangkok, 365 Las Vegas, 388 Verneuil-sur-Seine, 390 Zoersel, 430 Homestead. 341 of 364 cases now hold a fetched article; 11, 66 and 399 have no public text source (podcast, police video, direct victim report). Trimming - auto_trim.py: case-anchored furniture cut for UNTRIMMED blocks. Finds the body run that mentions the case, merges across subheadings and short furniture gaps, drops teasers, share bars, date/URL/caption lines and subscription pitches; refuses pages with no record term or almost no body. 302 blocks trimmed; 16 left on auto-trim-review.md (7 OFF-CASE suspects). Every cut is labelled AUTO-TRIMMED, UNREVIEWED in the dossier; the full extract stays in staging/. Decisions with anchors in trim-decisions-auto.json. - build_cases.py / verify_all.py: banners for auto-trimmed and archived blocks, staged-file check extended to Wayback blocks, flag legend under the record. Detention rule - README "Definitions": the DB field `kidnappings` is the DETENTION violence type (victim, guard, staff or relative held to force submission or execute the theft), distinct from the Kidnapping scenario (taken away and held). - detention-flag-review.md / detention-flag-corrections.json: 40 records reviewed with evidence; 30 set-to-1 proposals accepted by the owner on 2026-09-06 (listed in corrections-approved.md), 10 still open. - apply_detention_wording.py: "Violence Used" in the 70 reviewed summaries now names detention explicitly (62 of 70 labelled), supported by the summary's own text; idempotent; supersedes the batch scripts' wording. Worklist and docs - sofia-worklist.md: 248 decisions, detention rule item replacing the old "no abduction" item, fresh-search section for the textless cases. - README-START-HERE.md: progress notes, run commands, next steps. - Bug fixed in passing: Wayback blocks stored in-memory text with carriage returns; now stored as read back from disk. verify_all.py PASSES (2321 checks). Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GZZENdTLzNGsbNy4DyF1yt
This commit is contained in:
StellarCrow
co-authored by
Claude Fable 5.1
Claude Fable 5.1
parent
499fd61f79
commit
439e83a4cb
@@ -26,6 +26,9 @@ DATABASE RECORD
|
||||
notes obducted outside his home waiting for taxi, not on lopp’s list, cash and 400k USDT taken
|
||||
has_processed_date 0
|
||||
created_at 2025-11-14 09:05:23
|
||||
(flag legend: 'kidnappings' is the DETENTION flag — 1 when the victim was held against
|
||||
their will at any point, tied, locked in, held at gunpoint or taken away; it is NOT the
|
||||
same as the 'Kidnapping' scenario, which means taken away and held. See README, Definitions.)
|
||||
|
||||
AI SUMMARY [revised on review, verified against the sources in this file. Live DB still holds the shorter bulk-import summary — apply this to it.]
|
||||
**Victims:** A 59-year-old Johor businessman, abducted outside his home in Iskandar Puteri, Malaysia.
|
||||
@@ -34,7 +37,7 @@ AI SUMMARY [revised on review, verified against the sources in this file. Live
|
||||
|
||||
**Attack Method:** He was seized at 5 a.m. on 13 October 2024 outside his home as he prepared to take a ride-hailing car to Senai International Airport for a business trip.
|
||||
|
||||
**Violence Used:** From the suspects police seized a Beretta pistol, 250 live rounds and a pair of handcuffs.
|
||||
**Violence Used:** Detention — seized outside his home and held until the ransom was paid; from the suspects police seized a Beretta pistol, 250 live rounds and a pair of handcuffs.
|
||||
|
||||
**Crypto Demanded/Stolen:** The kidnappers first sought RM30 million, lowered to RM20 million after negotiation, reportedly paid; police recovered RM7.2 million of it — RM1.95 million cash, S$1 million (RM3.3 million) in foreign currency, and 400,000 USDT (about RM1.75 million).
|
||||
|
||||
@@ -83,19 +86,19 @@ The 59-year-old victim was abducted outside his home at 5am on October 13 while
|
||||
|
||||
|
||||
------------------------------------------------------------------------------------------------
|
||||
FETCHED ARTICLE 1 [RAW EXTRACT — NOT YET TRIMMED]
|
||||
!! This is the whole page as extracted. It still contains site furniture,
|
||||
!! and may contain teaser headlines for UNRELATED cases. Trim on read-through.
|
||||
!! Do not quote from it without checking the passage belongs to this case.
|
||||
FETCHED ARTICLE 1 [AUTO-TRIMMED — UNREVIEWED]
|
||||
!! Furniture was cut by a script keyed on this case's record, not by a person.
|
||||
!! It may still carry passages about OTHER cases from a round-up article.
|
||||
!! The full page extract is kept in staging/ if a cut needs revisiting.
|
||||
Source malaymail.com
|
||||
URL https://www.malaymail.com/news/malaysia/2024/10/30/johor-police-recover-rm72m-in-ransom-from-johor-businessman-kidnapping-remand-extended-for-vietnamese-suspects/155314
|
||||
Field url
|
||||
Retrieved 2026-09-05T12:44:06+00:00 via raw HTTP retrieval, deterministic extraction (HTTP 200)
|
||||
Language unknown
|
||||
Kept paragraphs ALL 53 paragraphs, untrimmed
|
||||
Length 6,328 chars
|
||||
Integrity sha256 78abfe56d9da94714cb5f98cef2838eabedb810d1f57096a3f7fbe4476886f08
|
||||
Trimmed NOT TRIMMED. Full page extract; trim on read-through.
|
||||
Kept paragraphs headline [0] + 19-46 of 53
|
||||
Length 3,962 chars
|
||||
Integrity sha256 72db9dfdd6fc82839d18385ff49506b59172a77a96980a186cc22ffaa43eaa21
|
||||
Trimmed AUTO-TRIMMED, unreviewed: kept paragraphs 19-46 plus headline [0]; dropped 18 leading and 6 trailing paragraphs. Case-term hits on page: 27.
|
||||
Caveat retrieved from a live page on the date above. Unlike text copied
|
||||
from the spreadsheet, there is no second copy to hash it against.
|
||||
------------------------------------------------------------------------------------------------
|
||||
@@ -104,42 +107,6 @@ ORIGINAL (unknown, verbatim as retrieved)
|
||||
|
||||
Johor police recover RM7.2m in ransom from Johor businessman kidnapping; remand extended for Vietnamese suspects | Malay Mail
|
||||
|
||||
For a taste of old Seremban, start your morning at Restoran Sun Meng with strong ‘kopi’, butter ‘kaya’ toast and hearty, hand-torn ‘mee hoon kueh’
|
||||
|
||||
Chinese national skips S$560,000 fine for smuggling 30,000 bottles of beer in Singapore, heads to jail instead
|
||||
|
||||
Mbappe penalty miss seals Real Madrid’s first defeat under Mourinho
|
||||
|
||||
As smoke spreads across South-east Asia, Indonesia works with neighbours to tackle transboundary haze
|
||||
|
||||
‘If Langkawi too small’: Defence minister says LIMA may need alternative venue
|
||||
|
||||
Nepal clears SMART deployment as families of missing Malaysians await news
|
||||
|
||||
Early-morning fire destroys five business premises at Penang’s Chew Jetty heritage area
|
||||
|
||||
Don’t hate me because I’m beautiful — Khoo Ying Hooi
|
||||
|
||||
Where have all the people gone? From restaurants to running tracks, Singapore adjusts outdoor activities as haze bites
|
||||
|
||||
Government ready to declare emergency if API exceeds 400, says Arthur Kurup
|
||||
|
||||
MACC detains company owner for allegedly soliciting RM30,000 to secure defence‑sector financing
|
||||
|
||||
Sungai Besi Highway’s 400m lane‑widening project completed, opens to traffic Monday
|
||||
|
||||
Nine days on, Nepali soldiers pull Chinese national alive from hydropower tunnel
|
||||
|
||||
Police detain 11 over machete attack in Ipoh that left victim seriously injured
|
||||
|
||||
Isak strikes twice as Liverpool get Iraola off the mark
|
||||
|
||||
Johor police recover RM7.2m in ransom from Johor businessman kidnapping; remand extended for Vietnamese suspects
|
||||
|
||||
Bukit Aman Criminal Investigation Department (CID) director Datuk Seri Mohd Shuhaily Mohd Zain (3rd left) with a seized firearm and part of the ransom that was recovered from the suspects of a kidnapping case during a media conference held at the Johor police contingent headquarters in Johor Baru October 30, 2024. — Picture by Ben Tan
|
||||
|
||||
Stay updated on the latest news and insights. Subscribe to our newsletter here
|
||||
|
||||
Earn a fixed rate of up to 4.2%* p.a. for 210 days with Versa Save! Plus, enjoy an additional FREE RM10 when you sign up using code VERSAMM10 with a min. cash-in of RM100 today. T&Cs apply.
|
||||
|
||||
Make Malay Mail your preferred source on Google Giving you news that matter to Malaysians. Make Malay Mail your preferred source when you search for news on Google.
|
||||
@@ -196,18 +163,6 @@ The kidnappers initially sought a ransom of RM30 million, but the amount was rep
|
||||
|
||||
The 59-year-old victim was abducted outside his home at 5am on October 13 while preparing to take a ride-hailing service to Senai International Airport for a business trip.
|
||||
|
||||
Police probe into businessman kidnap case ongoing
|
||||
|
||||
Three Vietnamese nationals remanded for alleged kidnapping and RM20m ransom of Johor tycoon
|
||||
|
||||
Blood is not thicker: Family among 13 nabbed over kidnap, ransom of Johor magnate for alleged RM20m
|
||||
|
||||
Final victim found, four‑day search ends in Kota Tinggi drowning tragedy
|
||||
|
||||
‘Round‑the‑clock service’: Puspakom plans 24‑hour operations for vehicle inspections
|
||||
|
||||
Miti seeks Budget 2027 allocations to accelerate semiconductor industry, expand Malaysian exports
|
||||
|
||||
================================================================================================
|
||||
generated from attacks-export-Gart-website.json + reported_K&R | case 317
|
||||
================================================================================================
|
||||
|
||||
Reference in New Issue
Block a user