feat(sources): Wayback pass, automatic trimming, detention rule, ten cases re-sourced
Second and third rounds on the dossier pipeline, reviewed locally before commit. Retrieval - wayback_pass.py: retries every BLOCKED/DEAD/THIN/ERROR linked source through the Wayback Machine; blocks carry the snapshot date, archive URL and the live verdict. 143 slots retried: 93 fetched, 37 no snapshot, 12 script shells, 1 PDF. - fetch_sources.py: fetch_wayback() helper. - add_extra_sources.py: files staged extra_* finds (web search, not on the DB record) into the store with a provenance note. - Cases re-sourced by web search: 248 (Oslo: Document.no, Avisa Oslo, NRK; the linked Le Parisien piece is case 242 and is marked OFF-CASE), 258 Kharkiv, 260 Singapore, 358 Bangkok, 365 Las Vegas, 388 Verneuil-sur-Seine, 390 Zoersel, 430 Homestead. 341 of 364 cases now hold a fetched article; 11, 66 and 399 have no public text source (podcast, police video, direct victim report). Trimming - auto_trim.py: case-anchored furniture cut for UNTRIMMED blocks. Finds the body run that mentions the case, merges across subheadings and short furniture gaps, drops teasers, share bars, date/URL/caption lines and subscription pitches; refuses pages with no record term or almost no body. 302 blocks trimmed; 16 left on auto-trim-review.md (7 OFF-CASE suspects). Every cut is labelled AUTO-TRIMMED, UNREVIEWED in the dossier; the full extract stays in staging/. Decisions with anchors in trim-decisions-auto.json. - build_cases.py / verify_all.py: banners for auto-trimmed and archived blocks, staged-file check extended to Wayback blocks, flag legend under the record. Detention rule - README "Definitions": the DB field `kidnappings` is the DETENTION violence type (victim, guard, staff or relative held to force submission or execute the theft), distinct from the Kidnapping scenario (taken away and held). - detention-flag-review.md / detention-flag-corrections.json: 40 records reviewed with evidence; 30 set-to-1 proposals accepted by the owner on 2026-09-06 (listed in corrections-approved.md), 10 still open. - apply_detention_wording.py: "Violence Used" in the 70 reviewed summaries now names detention explicitly (62 of 70 labelled), supported by the summary's own text; idempotent; supersedes the batch scripts' wording. Worklist and docs - sofia-worklist.md: 248 decisions, detention rule item replacing the old "no abduction" item, fresh-search section for the textless cases. - README-START-HERE.md: progress notes, run commands, next steps. - Bug fixed in passing: Wayback blocks stored in-memory text with carriage returns; now stored as read back from disk. verify_all.py PASSES (2321 checks). Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GZZENdTLzNGsbNy4DyF1yt
This commit is contained in:
StellarCrow
co-authored by
Claude Fable 5.1
Claude Fable 5.1
parent
499fd61f79
commit
439e83a4cb
@@ -26,6 +26,9 @@ DATABASE RECORD
|
||||
notes (null)
|
||||
has_processed_date 1
|
||||
created_at 2025-11-13 05:44:45
|
||||
(flag legend: 'kidnappings' is the DETENTION flag — 1 when the victim was held against
|
||||
their will at any point, tied, locked in, held at gunpoint or taken away; it is NOT the
|
||||
same as the 'Kidnapping' scenario, which means taken away and held. See README, Definitions.)
|
||||
|
||||
AI SUMMARY [revised on review, verified against the sources in this file. Live DB still holds the shorter bulk-import summary — apply this to it.]
|
||||
**Victims:** Mohammed Ismail, seized in PIB Colony, Karachi, Pakistan.
|
||||
@@ -34,7 +37,7 @@ AI SUMMARY [revised on review, verified against the sources in this file. Live
|
||||
|
||||
**Attack Method:** On 13 April 2025 the gang — using a black Vigo (a four-wheel drive) with a fake government plate, masks, arms, walkie-talkies and handcuffs — abducted Ismail and took him to a warehouse in Steel Town.
|
||||
|
||||
**Violence Used:** He was held by an armed group that accused him of illegal Hundi/Hawala dealing and threatened him.
|
||||
**Violence Used:** Detention — abducted and held by an armed group that accused him of illegal Hundi/Hawala dealing and threatened him.
|
||||
|
||||
**Crypto Demanded/Stolen:** They questioned him about his Bitcoin business, took his iPhone, and said they would contact him about money later.
|
||||
|
||||
@@ -66,19 +69,19 @@ Thereafter, they took his iPhone and asked him that they would contact him about
|
||||
|
||||
|
||||
------------------------------------------------------------------------------------------------
|
||||
FETCHED ARTICLE 1 [RAW EXTRACT — NOT YET TRIMMED]
|
||||
!! This is the whole page as extracted. It still contains site furniture,
|
||||
!! and may contain teaser headlines for UNRELATED cases. Trim on read-through.
|
||||
!! Do not quote from it without checking the passage belongs to this case.
|
||||
FETCHED ARTICLE 1 [AUTO-TRIMMED — UNREVIEWED]
|
||||
!! Furniture was cut by a script keyed on this case's record, not by a person.
|
||||
!! It may still carry passages about OTHER cases from a round-up article.
|
||||
!! The full page extract is kept in staging/ if a cut needs revisiting.
|
||||
Source dawn.com
|
||||
URL https://www.dawn.com/news/1907634
|
||||
Field url
|
||||
Retrieved 2026-09-05T12:47:32+00:00 via raw HTTP retrieval, deterministic extraction (HTTP 200)
|
||||
Language unknown
|
||||
Kept paragraphs ALL 43 paragraphs, untrimmed
|
||||
Length 4,448 chars
|
||||
Integrity sha256 3df29a46e87befe02a21069e741756f10e90e2c7b9a0854e96c98dab60689252
|
||||
Trimmed NOT TRIMMED. Full page extract; trim on read-through.
|
||||
Kept paragraphs headline [0] + 4-11 of 43
|
||||
Length 1,690 chars
|
||||
Integrity sha256 19dc37938d2adaac05c6aeb4ffa1babe3beaf277a485e060e52363f45be14ef0
|
||||
Trimmed AUTO-TRIMMED, unreviewed: kept paragraphs 4-11 plus headline [0]; dropped 3 leading and 31 trailing paragraphs. Case-term hits on page: 16.
|
||||
Caveat retrieved from a live page on the date above. Unlike text copied
|
||||
from the spreadsheet, there is no second copy to hash it against.
|
||||
------------------------------------------------------------------------------------------------
|
||||
@@ -87,14 +90,6 @@ ORIGINAL (unknown, verbatim as retrieved)
|
||||
|
||||
Gang of kidnappers posing as law enforcers busted - Newspaper - DAWN.COM
|
||||
|
||||
Get the latest news and updates from Dawn
|
||||
|
||||
Gang of kidnappers posing as law enforcers busted
|
||||
|
||||
The Newspaper's Staff Reporter
|
||||
Published
|
||||
May 1, 2025
|
||||
|
||||
KARACHI: The counter-terrorism department on Wednesday claimed to have busted a gang involved in the recent cases of ‘short-term’ kidnapping for ransom in Karachi.
|
||||
|
||||
CTD DSP Raja Umer Khattab said the gang used a Vigo, a four-wheel drive vehicle, and introduced themselves as “officials of law enforcement agencies” to their prey.
|
||||
@@ -111,68 +106,6 @@ They asked him about Bitcoin business and threatened him that he was involved in
|
||||
|
||||
Thereafter, they took his iPhone and asked him that they would contact him about money later on. They dropped him on Sharea Faisal near a stop.
|
||||
|
||||
Woman involved in 2024 Karsaz accident acquitted in drug case
|
||||
|
||||
Barbs fly in Sindh Assembly as Muttahida’s bid to table resolution against ‘Sindhudesh’ scuttled
|
||||
|
||||
Six JI workers sent to prison for ‘rioting’ in Karachi
|
||||
|
||||
Ex-Pakistan coach Jason Gillespie tells Aaqib Javed to 'look in the mirror' over cricket team sackings
|
||||
|
||||
Karachi court acquits driver in drug case filed over 2024 accident that killed 2 in Karsaz
|
||||
|
||||
PM Shehbaz discusses need for ML-1 railway project's early groundbreaking in meeting with ADB official
|
||||
|
||||
Govt reduces petrol price by Rs3.13, increases HSD by Rs3.74
|
||||
|
||||
Pakistan, Kyrgyzstan eye $200m trade in two years
|
||||
|
||||
NCCIA issues fresh notices to Momina Iqbal, PML-N MPA Chadhar after new evidence emerges in harassment case
|
||||
|
||||
Govt transfers ISI’s internal wing chief Maj Gen Faisal Naseer to Nacta
|
||||
|
||||
Eight Pakistan Bar Council members reject proposed changes to council rules
|
||||
|
||||
Trump envoys land in Moscow for Russia-Ukraine peace push
|
||||
|
||||
US ambassador says Israel 'has responsibility' to ensure safety of West Bank Palestinians
|
||||
|
||||
Naqvi says new administrative units to be formed only with people's consent
|
||||
|
||||
Chinese national rescued from tunnel in Nepal 10 days after catastrophic flooding
|
||||
|
||||
Police charge sheet says building management at fault for Gul Plaza inferno
|
||||
|
||||
A negotiated solution must be found for all contentious issues.
|
||||
|
||||
PAKISTAN has raised a record $3bn in its single largest international capital market transaction through a...
|
||||
|
||||
AT least the government is not trying to cover it up. That, perhaps, is the only silver lining in the alarming...
|
||||
|
||||
THE Israeli defence minister has recently confirmed what many across the world already know: the Zionist state seeks...
|
||||
|
||||
WHILE diplomatic efforts are underway to restore dialogue with Taliban-ruled Afghanistan, as the Foreign Office has...
|
||||
|
||||
THE Committee on Genetically Modified Corn has approved GM maize cultivation alongside hybrid and organic varieties....
|
||||
|
||||
Pakistan’s strongest case for adding new treasures to the World Heritage List is to show that those already recognised by the world are being cared for as if they matter.
|
||||
|
||||
Nepal’s Himalayan Disaster: Climate Change, Floods & The Warning We Missed
|
||||
|
||||
Why Is Pakistan Cricket Failing? Plus Premier League Deadline Day Drama
|
||||
|
||||
Makkah Defence Alliance: Can It Become a “Muslim NATO”?
|
||||
|
||||
The Problem With AI Watermarks: Ihsan Ayyub Qazi Explains Claude’s Text Watermark
|
||||
|
||||
Pakistan’s EV Revolution: Are Electric Bikes the Future?
|
||||
|
||||
How Pakistan Can Finance Climate Disasters Before They Strike
|
||||
|
||||
Online Hate Is Following Pakistani Women Home
|
||||
|
||||
‘Only 5pc Pakistanis use ride-hailing services’
|
||||
|
||||
================================================================================================
|
||||
generated from attacks-export-Gart-website.json + reported_K&R | case 224
|
||||
================================================================================================
|
||||
|
||||
Reference in New Issue
Block a user