feat(sources): Wayback pass, automatic trimming, detention rule, ten cases re-sourced
Second and third rounds on the dossier pipeline, reviewed locally before commit. Retrieval - wayback_pass.py: retries every BLOCKED/DEAD/THIN/ERROR linked source through the Wayback Machine; blocks carry the snapshot date, archive URL and the live verdict. 143 slots retried: 93 fetched, 37 no snapshot, 12 script shells, 1 PDF. - fetch_sources.py: fetch_wayback() helper. - add_extra_sources.py: files staged extra_* finds (web search, not on the DB record) into the store with a provenance note. - Cases re-sourced by web search: 248 (Oslo: Document.no, Avisa Oslo, NRK; the linked Le Parisien piece is case 242 and is marked OFF-CASE), 258 Kharkiv, 260 Singapore, 358 Bangkok, 365 Las Vegas, 388 Verneuil-sur-Seine, 390 Zoersel, 430 Homestead. 341 of 364 cases now hold a fetched article; 11, 66 and 399 have no public text source (podcast, police video, direct victim report). Trimming - auto_trim.py: case-anchored furniture cut for UNTRIMMED blocks. Finds the body run that mentions the case, merges across subheadings and short furniture gaps, drops teasers, share bars, date/URL/caption lines and subscription pitches; refuses pages with no record term or almost no body. 302 blocks trimmed; 16 left on auto-trim-review.md (7 OFF-CASE suspects). Every cut is labelled AUTO-TRIMMED, UNREVIEWED in the dossier; the full extract stays in staging/. Decisions with anchors in trim-decisions-auto.json. - build_cases.py / verify_all.py: banners for auto-trimmed and archived blocks, staged-file check extended to Wayback blocks, flag legend under the record. Detention rule - README "Definitions": the DB field `kidnappings` is the DETENTION violence type (victim, guard, staff or relative held to force submission or execute the theft), distinct from the Kidnapping scenario (taken away and held). - detention-flag-review.md / detention-flag-corrections.json: 40 records reviewed with evidence; 30 set-to-1 proposals accepted by the owner on 2026-09-06 (listed in corrections-approved.md), 10 still open. - apply_detention_wording.py: "Violence Used" in the 70 reviewed summaries now names detention explicitly (62 of 70 labelled), supported by the summary's own text; idempotent; supersedes the batch scripts' wording. Worklist and docs - sofia-worklist.md: 248 decisions, detention rule item replacing the old "no abduction" item, fresh-search section for the textless cases. - README-START-HERE.md: progress notes, run commands, next steps. - Bug fixed in passing: Wayback blocks stored in-memory text with carriage returns; now stored as read back from disk. verify_all.py PASSES (2321 checks). Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GZZENdTLzNGsbNy4DyF1yt
This commit is contained in:
co-authored by
Claude Fable 5.1
parent
499fd61f79
commit
439e83a4cb
@@ -26,6 +26,9 @@ DATABASE RECORD
|
||||
notes (null)
|
||||
has_processed_date 1
|
||||
created_at 2025-11-13 05:44:45
|
||||
(flag legend: 'kidnappings' is the DETENTION flag — 1 when the victim was held against
|
||||
their will at any point, tied, locked in, held at gunpoint or taken away; it is NOT the
|
||||
same as the 'Kidnapping' scenario, which means taken away and held. See README, Definitions.)
|
||||
|
||||
AI SUMMARY [generated at bulk import, NOT verified against sources]
|
||||
**Victim:** Andrew ______
|
||||
@@ -64,19 +67,19 @@ Andrew is currently in intensive care being treated for burns.
|
||||
|
||||
|
||||
------------------------------------------------------------------------------------------------
|
||||
FETCHED ARTICLE 1 [RAW EXTRACT — NOT YET TRIMMED]
|
||||
!! This is the whole page as extracted. It still contains site furniture,
|
||||
!! and may contain teaser headlines for UNRELATED cases. Trim on read-through.
|
||||
!! Do not quote from it without checking the passage belongs to this case.
|
||||
FETCHED ARTICLE 1 [AUTO-TRIMMED — UNREVIEWED]
|
||||
!! Furniture was cut by a script keyed on this case's record, not by a person.
|
||||
!! It may still carry passages about OTHER cases from a round-up article.
|
||||
!! The full page extract is kept in staging/ if a cut needs revisiting.
|
||||
Source financemagnates.com
|
||||
URL https://www.financemagnates.com/cryptocurrency/news/south-africa-man-tortured-for-bitcoins-in-intensive-care/
|
||||
Field url
|
||||
Retrieved 2026-09-05T12:55:07+00:00 via raw HTTP retrieval, deterministic extraction (HTTP 200)
|
||||
Language unknown
|
||||
Kept paragraphs ALL 62 paragraphs, untrimmed
|
||||
Length 9,578 chars
|
||||
Integrity sha256 5c4dec4dde5a91dce5c179c250c21a43f02dc9f66a99ae0b4f37a27ec458f075
|
||||
Trimmed NOT TRIMMED. Full page extract; trim on read-through.
|
||||
Kept paragraphs headline [0] + 4-15 of 62
|
||||
Length 4,863 chars
|
||||
Integrity sha256 2a6d83f0347b9e6a429dc76ed6cb31a38e8fb2276f417f7493c65f962b4c86cc
|
||||
Trimmed AUTO-TRIMMED, unreviewed: kept paragraphs 4-15 plus headline [0]; dropped 3 leading and 46 trailing paragraphs. Case-term hits on page: 14.
|
||||
Caveat retrieved from a live page on the date above. Unlike text copied
|
||||
from the spreadsheet, there is no second copy to hash it against.
|
||||
------------------------------------------------------------------------------------------------
|
||||
@@ -85,14 +88,6 @@ ORIGINAL (unknown, verbatim as retrieved)
|
||||
|
||||
South Africa: Man Tortured for Bitcoins, in Intensive Care | Finance Magnates
|
||||
|
||||
>
|
||||
South Africa: Man Tortured for Bitcoins, in Intensive Care
|
||||
|
||||
South Africa: Man Tortured for Bitcoins, in Intensive Care
|
||||
|
||||
Tuesday, 04/12/2018 | 14:24 GMT by
|
||||
Simon Golstein
|
||||
|
||||
The victim was burned with a hot iron and lost Bitcoin worth hundreds of thousands of dollars.
|
||||
|
||||
A Bitcoin
|
||||
@@ -131,114 +126,6 @@ Weekly Review: Nigeria Proposes New CFD Rules; SVG Pauses Crypto Applications
|
||||
Federal Courts Now Disagree on Kalshi’s Sports Contracts. New Jersey Wants the Supreme Court to Settle the Fight
|
||||
Friday, 04/09/2026 | 19:15 GMT
|
||||
|
||||
CySEC Flags 10 Websites as Unauthorised for Investment or Crypto Services
|
||||
Friday, 04/09/2026 | 17:27 GMT
|
||||
|
||||
Europe's Economic Crossroads: Recession Fears and S&P Global's Contrasting Outlook
|
||||
|
||||
Decarbonization and Climate Realities: Shaping the Future Investment Landscape
|
||||
|
||||
Coinbase Lets UK Users Trade US Stocks While Wall Street Sleeps
|
||||
|
||||
7 Things We Wish Someone Had Told Us Before We Started Trading
|
||||
|
||||
How Low Can SIlver Go? XAG/USD Breaks 200-Day EMA, Opening 29% Drop Silver Price Prediction to $45
|
||||
Wednesday, 02/09/2026 | 12:14 GMT
|
||||
|
||||
Bitcoin Price Prediction: Golden Cross Nears as $84K Blocks $100K per BTC
|
||||
Tuesday, 01/09/2026 | 09:17 GMT
|
||||
|
||||
Gold Drops 3%, but Bullish EMA Cross Keeps $4900 Price Prediction Alive
|
||||
Monday, 31/08/2026 | 10:28 GMT
|
||||
|
||||
Craig Wright Talks About Metanet: a New, More Commercial Internet
|
||||
|
||||
Monex to Open Coincheck in the US to Cater to Institutional Traders
|
||||
|
||||
Saudi Arabia and the UAE Central Banks to Create Joint Token
|
||||
|
||||
Mark Karpeles of Mt Gox Faces Ten Year Sentence for Embezzlement
|
||||
|
||||
The Netherlands to License Crypto Firms that Report Customers
|
||||
|
||||
UK Crypto Exchange CEX.IO Updates KYC - No More Anonymous Transactions
|
||||
|
||||
The Stablecoin in the Headlines Is Not the Stablecoin I Know
|
||||
|
||||
Saint Vincent Regulator Freezes Virtual Asset Applications, Existing Submissions Continue
|
||||
|
||||
Kraken Parent Pushes IPO to Q2 2027 at Earliest
|
||||
|
||||
ASIC Crypto License Applications Pass 45 Before September Deadline
|
||||
|
||||
Binance’s Push Into US Stock Options Shows How Far It Has Moved Beyond Crypto
|
||||
|
||||
Bybit Launches Options on Its Own SpaceX and NVIDIA Perpetual
|
||||
|
||||
Nigeria Proposes New FX Rules; Revolut Gains US Bank Approval
|
||||
|
||||
Today’s financial news recap covers Nigeria proposes new FX and CFD rules, Revolut secures conditional US bank approval, and Saint Vincent freezes new virtual asset applications.
|
||||
|
||||
|
||||
Finance Magnates Daily Recap brings you the latest news from forex and CFD brokers, fintech, payments, cryptocurrency, digital assets, trading platforms, financial regulation and global markets.
|
||||
|
||||
|
||||
Get the key company news, executive moves, deals, regulatory updates and market developments of the day, in just a few minutes. New episodes published every weekday.
|
||||
|
||||
|
||||
Read more: https://www.financemagnates.com
|
||||
|
||||
|
||||
#FinanceMagnates #ForexNews #FintechNews
|
||||
|
||||
XTB Founder Sells $410m; Tickmill’s Mattus Warns Brokers
|
||||
|
||||
Today’s financial news recap covers XTB founder Jakub Zabłocki sells another $410 million in shares, Tickmill’s Ingmar Mattus warns of a mindset problem, and Kraken’s parent pushes its IPO to 2027.
|
||||
|
||||
|
||||
Finance Magnates Daily Recap brings you the latest news from forex and CFD brokers, fintech, payments, cryptocurrency, digital assets, trading platforms, financial regulation and global markets.
|
||||
|
||||
|
||||
Get the key company news, executive moves, deals, regulatory updates and market developments of the day, in just a few minutes. New episodes published every weekday.
|
||||
|
||||
|
||||
Read more: https://www.financemagnates.com
|
||||
|
||||
|
||||
#FinanceMagnates #ForexNews #FintechNews
|
||||
|
||||
FTMO Enters Futures Prop Trading; Brazil Sees Strong Retail Activity
|
||||
|
||||
Today’s financial news recap covers FTMO launches futures prop trading, Brazil's retail derivatives market posts strong daily activity, and Leverate adds direct crypto deposits.
|
||||
|
||||
|
||||
Finance Magnates Daily Recap brings you the latest news from forex and CFD brokers, fintech, payments, cryptocurrency, digital assets, trading platforms, financial regulation and global markets.
|
||||
|
||||
|
||||
Get the key company news, executive moves, deals, regulatory updates and market developments of the day, in just a few minutes. New episodes published every weekday.
|
||||
|
||||
|
||||
Read more: https://www.financemagnates.com
|
||||
|
||||
|
||||
#FinanceMagnates #ForexNews #FintechNews
|
||||
|
||||
Nobody looks forward to their annual CPD requirements.
|
||||
|
||||
But Continuing Professional Development doesn’t have to be a box-checking exercise.
|
||||
|
||||
FM Academy takes a more engaging, practical approach to CPD, helping finance professionals get useful knowledge from their learning, not just the credits.
|
||||
|
||||
Explore FM Academy: https://lnkd.in/dPBd3AFG
|
||||
|
||||
#FinanceMagnates #FMAcademy #CPD #Fintech #ProfessionalDevelopment
|
||||
|
||||
Capital.com UK Revenue Falls; eToro Partners with Leeds
|
||||
|
||||
Today's Monday, the 31st of August 2026, and these are our main stories: Capital.com's UK revenue falls sharply, eToro expands its football partnerships, and the FCA steps up action on whistleblowing.
|
||||
|
||||
!"#$%&'()*+,-./0123456789:;<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyz{|} !"#$%&'()*+,-./0123456789:;<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyz{|}
|
||||
|
||||
================================================================================================
|
||||
generated from attacks-export-Gart-website.json + reported_K&R | case 048
|
||||
================================================================================================
|
||||
|
||||
Reference in New Issue
Block a user