feat(sources): Wayback pass, automatic trimming, detention rule, ten cases re-sourced

Second and third rounds on the dossier pipeline, reviewed locally before commit.

Retrieval
- wayback_pass.py: retries every BLOCKED/DEAD/THIN/ERROR linked source through
  the Wayback Machine; blocks carry the snapshot date, archive URL and the live
  verdict. 143 slots retried: 93 fetched, 37 no snapshot, 12 script shells, 1 PDF.
- fetch_sources.py: fetch_wayback() helper.
- add_extra_sources.py: files staged extra_* finds (web search, not on the DB
  record) into the store with a provenance note.
- Cases re-sourced by web search: 248 (Oslo: Document.no, Avisa Oslo, NRK; the
  linked Le Parisien piece is case 242 and is marked OFF-CASE), 258 Kharkiv,
  260 Singapore, 358 Bangkok, 365 Las Vegas, 388 Verneuil-sur-Seine, 390 Zoersel,
  430 Homestead. 341 of 364 cases now hold a fetched article; 11, 66 and 399
  have no public text source (podcast, police video, direct victim report).

Trimming
- auto_trim.py: case-anchored furniture cut for UNTRIMMED blocks. Finds the body
  run that mentions the case, merges across subheadings and short furniture
  gaps, drops teasers, share bars, date/URL/caption lines and subscription
  pitches; refuses pages with no record term or almost no body. 302 blocks
  trimmed; 16 left on auto-trim-review.md (7 OFF-CASE suspects). Every cut is
  labelled AUTO-TRIMMED, UNREVIEWED in the dossier; the full extract stays in
  staging/. Decisions with anchors in trim-decisions-auto.json.
- build_cases.py / verify_all.py: banners for auto-trimmed and archived blocks,
  staged-file check extended to Wayback blocks, flag legend under the record.

Detention rule
- README "Definitions": the DB field `kidnappings` is the DETENTION violence
  type (victim, guard, staff or relative held to force submission or execute
  the theft), distinct from the Kidnapping scenario (taken away and held).
- detention-flag-review.md / detention-flag-corrections.json: 40 records
  reviewed with evidence; 30 set-to-1 proposals accepted by the owner on
  2026-09-06 (listed in corrections-approved.md), 10 still open.
- apply_detention_wording.py: "Violence Used" in the 70 reviewed summaries now
  names detention explicitly (62 of 70 labelled), supported by the summary's
  own text; idempotent; supersedes the batch scripts' wording.

Worklist and docs
- sofia-worklist.md: 248 decisions, detention rule item replacing the old
  "no abduction" item, fresh-search section for the textless cases.
- README-START-HERE.md: progress notes, run commands, next steps.
- Bug fixed in passing: Wayback blocks stored in-memory text with carriage
  returns; now stored as read back from disk.

verify_all.py PASSES (2321 checks).

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GZZENdTLzNGsbNy4DyF1yt
This commit is contained in:
StellarCrow
2026-09-06 19:36:45 +02:00
co-authored by Claude Fable 5.1
parent 499fd61f79
commit 439e83a4cb
588 changed files with 24800 additions and 13190 deletions
+11 -68
View File
@@ -26,6 +26,9 @@ DATABASE RECORD
notes The article is badly translated, so it's hard to tell how much was taken. It says "Rs 1.3 crore in bitcoins" - not sure what that means.
has_processed_date 1
created_at 2025-11-13 05:44:45
(flag legend: 'kidnappings' is the DETENTION flag — 1 when the victim was held against
their will at any point, tied, locked in, held at gunpoint or taken away; it is NOT the
same as the 'Kidnapping' scenario, which means taken away and held. See README, Definitions.)
AI SUMMARY [generated at bulk import, NOT verified against sources]
**Victim:** Arjun Bhargav
@@ -81,19 +84,19 @@ DCP (East Zone) Prachi Singh said the abductors, who pretended to be real estate
DCP Singh said that police were tipped off by an informer about the miscreants who had abducted the businessman a week ago in a car bearing the plate of high court. "We laid a trap. On Tuesday, they visited the Kalindi Park locality probably to collect more money from the businessman. Two of them started to flee but fell at a muddy place. We nabbed them and their aide later," she said.
------------------------------------------------------------------------------------------------
FETCHED ARTICLE 1 [RAW EXTRACT — NOT YET TRIMMED]
!! This is the whole page as extracted. It still contains site furniture,
!! and may contain teaser headlines for UNRELATED cases. Trim on read-through.
!! Do not quote from it without checking the passage belongs to this case.
FETCHED ARTICLE 1 [AUTO-TRIMMED — UNREVIEWED]
!! Furniture was cut by a script keyed on this case's record, not by a person.
!! It may still carry passages about OTHER cases from a round-up article.
!! The full page extract is kept in staging/ if a cut needs revisiting.
Source timesofindia.indiatimes.com
URL https://timesofindia.indiatimes.com/city/lucknow/uttar-pradesh-three-take-rs-1-3-crore-ransom-in-bitcoins-from-realtor-held/articleshow/93603640.cms
Field url
Retrieved 2026-09-05T12:51:57+00:00 via raw HTTP retrieval, deterministic extraction (HTTP 200)
Language unknown
Kept paragraphs ALL 33 paragraphs, untrimmed
Length 10,394 chars
Integrity sha256 610d327aba69f72dfaaa4003e01423dfe66af5eb4443b8a650210690857b914b
Trimmed NOT TRIMMED. Full page extract; trim on read-through.
Kept paragraphs headline [0] + 2-3 of 33
Length 2,153 chars
Integrity sha256 573099a8ce71aa2375e8ce83e8ef975146aab966cdba5ff386b67a1c6db1b1c8
Trimmed AUTO-TRIMMED, unreviewed: kept paragraphs 2-3 plus headline [0]; dropped 1 leading and 29 trailing paragraphs. Case-term hits on page: 23.
Caveat retrieved from a live page on the date above. Unlike text copied
from the spreadsheet, there is no second copy to hash it against.
------------------------------------------------------------------------------------------------
@@ -102,70 +105,10 @@ ORIGINAL (unknown, verbatim as retrieved)
Uttar Pradesh: Three take Rs 1.3 crore ransom in bitcoins from realtor, held | Lucknow News - The Times of India
Uttar Pradesh: Three take Rs 1.3 crore ransom in bitcoins from realtor, held
LUCKNOW: In a first-of-its-kind crime reported in the state capital, three captors of a real-estate businessman used cryptocurrency to their advantage and took a ransom of Rs 1.3 crore in bitcoins before releasing him. The stunning fact emerged a week after the police arrested the three, Sandeep Pratap Singh and Vijay Pratap Singh aka Visnhu, both from neighbouring Barabanki district, and Rajveer Singh of Hardoi district. Police said that the arrested accused were in the know that the victim traded in cryptocurrency.Police recovered Rs 30,000 in cash, a country-made pistol, three live cartridges, five mobile phones and a car from them. According to police, the trio abducted Arjun Bhargav, of Indraprasth Grand near Kalindi Park in Vrindavan Yojana, on the pretext of showing him a plot in Barabanki on August 7. They held him hostage at a house where they thrashed him, trained a pistol on him and got Rs 1.3 crore in bitcoins transferred to their account.DCP (East Zone) Prachi Singh said the abductors, who pretended to be real estate dealers, met Bhargav and took him to Barabanki."On the way, they tied his hands and legs and took him to a house in Barabanki where they tortured him for three hours," said Singh. The officer said the victim's wife, Nidhi Bhargava, said in the FIR that abductors trained pistols on Bhargav forcing him to disclose the password and then got all the bitcoins transferred to their account.
"They also forced my husband to transfer the money into their bank account and opened fire when he resisted it. Luckily, he was not hurt. They then transported him to Lucknow and dumped him on the roadside," she said.DCP Singh said that police were tipped off by an informer about the miscreants who had abducted the businessman a week ago in a car bearing the plate of high court. "We laid a trap. On Tuesday, they visited the Kalindi Park locality probably to collect more money from the businessman. Two of them started to flee but fell at a muddy place. We nabbed them and their aide later," she said.
Maharashtra Elections 2026 Live Updates: Mumbai police tighten security ahead of BMC polls; 1,700 candidates in race for 227 seats
'Skipped tournament due to extreme Delhi air': Danish shuttler Anders Antonsen shares AQI screenshot; fined $5,000
Delhi-NCR shivers under fog blanket: Cold wave continues, IMD issues 'yellow' alert; flight ops impacted
Forced to pay for bullets that killed their kids': Iranians in India recount Tehran horror
New Delhi weather today: Sunny skies, mild temperatures; AQI remains poor
Power, promises & poison: Chilling plan that saw 7 Telangana sarpanches cull 500 dogs
Mini secretariat in Dwarka: Delhi govt approves Rs 213 crore project; 12 more planned to boost governance
From slums to stages: Inside the shadow economy of Maharashtra's local polls; how election season becomes daily extra income
Mumbai BMC elections 2026: Whats open and closed on polling day- check all details
Red Fort blast fallout: Police verification for all new students, staff at Al-Falah University; many leave campus
'I want to resign, my job is taking my life, shares employee: Have Indian workplaces normalised burnout?
Maharashtra BMC Elections 2026 Live Updates: Mumbai police tighten security ahead of BMC polls; Nagpur BJP leader attacked
IND vs USA Live Score, ICC Under 19 World Cup 2026: Vaibhav Sooryavanshi in spotlight as favourites India face USA in the opener
IBPS PO, SO result 2025 released at ibps.in: Direct link to download scorecards here
Stock market holiday today: Are NSE, BSE closed for trading on January 15? Check details
IBPS RRB Clerk Prelims Result 2025 Live Updates: IBPS RRB Clerk scorecards expected to be released soon at ibps.in, check latest updates here
'Do not repeat same mistake': Iran's fresh warning to Trump; Air India, IndiGo issue advisory amid airspace closure
Bangladesh cricket in turmoil: Players boycott threat as BCB disowns directors remarks amid T20 World Cup standoff
Iran airspace sudden closure: AI cancels 3 US flights; IndiGo flight returns to Baku
Maharashtra BMC Elections 2026Steve CohenMumbai Chandigarh FlightBMC Elections ScheduleWorld Largest Beaver DamDonald TrumpAlex BregmanDwyane Wade WifeA'ja wilsonIND U19 vs USA U19 Live ScoreKobe Bryant WifeMLB Trade RumorsGreenland DisputeStephen Curry FatherBudget 2026Iran ProtestsBank holiday todayCheck Voting BoothIBPS RRB Clerk Prelims ResultStock market holidayIBPS PO SO ResultAndrea BocelliHaley Baylee ConfessionMike TomlinPatrick MahomesJayden Daniels InjuryTravis Kelces ExIShowSpeed Net WorthWPL 2026 ScheduleT20 World Cup 2026 Schedule
About usCreate Your Own AdTerms of Use and Grievance Redressal Policy Privacy policyAdvertise with usRSSNewsletterFeedbackePaperSitemapArchives
CricbuzzLifestyleNewspaper SubscriptionFood NewsTVTimes PrimeTravel DestinationsWhats HotETimesTimes LifeTimes PetsMyLifeXP
CouponDuniaTechGigTimesJobsBollywood NewsTimes MobileGadgetsTimes EventsWork with UsColombiaTOI Global
Jana NayaganBhuvan BamAamir KhanCountries With Most VegetariansBeatriz TaufenbachBaby Boy NamesStranger ThingsSteamed Breakfast DishesAmritha RajanLaughter Chefs Season 3Allu ArjunParasakthi CollectionSnake Plant BenefitsBigg Boss Marathi Contestants ListDhanushDisha PataniHrithik RoshanBhuvan BamDhurandharPlatoJana Nayagan Movie HearingThe Raja Saab Box Office CollectionMary KomJana NayaganAnaganaga Twitter ReviewDhurandhar Movie CollectionZeenat AmanMana ShankaraVaraprasad Garu CollectionDhurandhar Movie ReviewDev AnandWilliam ShakespeareAslam Style Butter Chicken At HomeFlushing Garlic Down ToiletsWorld's Only Floating National ParkTiny Ancient CreatureLongest Venomous King CobraNorthern LightsRichest Men In The WorldApple iPhone 17Makar Sankranti 2026First Medical Evacuation From ISS
Bangladesh Cricket TeamMustafizur RahmanSanjay ManjrekarVaibhav SooryavanshiIndia Office Work CultureSSC CGL Tier 1CBSEBank of Maharashtra Apprenticeship VacanciesRed fort blastSadhguruDwarka SecretariatTelangana sarpanchesMahayuti vs ThackerayDelhi weatherDelih-NCR fogMaharashtra Elections 2026Haryana rapeBank holiday todayStock Market HolidayIndia vs New ZealandUtah Jazz vs Chicago BullsG7 EconomyWhite House MeetingUS Immigration Policy 2026US Freezes Visa ProcessingCanada Travel BanMohammad RizwanAdin Ross ControversyGold price predictionCardi BTJ WattJensen HuangNyt ConnectionsMicrosoft Makes 5 PromisesOnePlus Ceo Pete LauJeff BezosFree Starlink In IranVerizon OutageElon MuskMark ZuckerbergMeta LayoffsWordle Today
HeadlinesSports NewsBusiness NewsIndia NewsWorld NewsBollywood NewsHealth+ TipsIndian TV ShowsTechnologyTravelEtimesHealth & FitnessDelhi Gold Rate TodayChinese Horoscope PredictionsMarketsAstrologyWeather TodayPlatinum Rate TodaySilver Rate TodayGold Rate TodayIs Bank open todayIs Bank Open TomorrowBank Holidays January 2026Public Holidays January 2026DeorhiNFL ScheduleTechnology NewsInternational SportsPublic HolidaysBank Holidays
Stephen Fleming press conference: How JSK are dealing with absence of Faf du PlessisSenuran Muthusamy press conference: 'Aiming to carry momentum into playoffs' | SA20Chandigarh Headlines Today — The Biggest Updates You Need to Know.Lucknow Headlines Today — The Biggest Updates You Need to Know.Iran Unrest Worries Families Of Indian Students, Parents Appeal To Govt For HelpUS Freezes Visas, Middle East Tensions Rise, NASA Mission Cut Short And MoreUS Senate Hearing Turns Viral After Indian-Origin Doctor Refuses Yes Or No On Men Getting PregnantNSA Ajit Dovals Speech Rattles Pakistan, Triggers Fury As India Calls It Strategic AnxietyAttack Plan Dropped? Trump Says Iran Killings Have Stopped And Executions Wont Take PlaceTimothy Busfields Lawyer Says He Passed Lie Detector Amid Abuse Allegations | WATCHCan Men Get Pregnant?: Senator Josh Hawley Leaves Woke Doctor Speechless, FumblingIran Unrest Worries Families Of Indian Students, Parents Appeal To Govt For HelpJamiat Chief Madani Slams Congress For Flexible Policy On Hate Politics; BJP, VHP ReactACMA President Says Auto Parts Industry May Face Slowdown In Second Half, Pins Hopes On Trade DealsNATO Chief Greenlights US Invasion Of Greenland? Trump, Mark Rutte Shock Europe With Big DeclarationDenmark Pours Cold Water On Trump's 'Dream To Conquer' Greenland; Laughs Off Russia, China ThreatHeavily Armed Federal Agents Storm Timothy Busfields NY Home After SurrenderTrump's Troops To 'STORM Iran In 24 Hours': Qatar Confirms Drawdown At US Air Base, Saudi On Alert
Jailer 2: Vijay Sethupathi confirms cameo in the Rajinikanth-Nelson Dilipkumar film; makes special exception for the Tamil superstar"Not all metro stories are bad": Metro stranger's 'quietly beautiful' bangle give away to the admirer is the kindest thing on the internet"Our youth events have long been the pathway for cricket's biggest stars": ICC chairman Jay Shah ahead of U-19 CWCPune shocker: 2 Nigerians bludgeon their friend to death after dispute over woman; detainedBajaj Chetak C25 e-scooter launched at 91,399: Battery, specs & moreRBI Office Attendant recruitment 2026: Registration window opens for 572 posts; direct link to apply hereNani celebrates Bhogi with family; shared pictures from their simple and silent celebrationsBill Gates starts working on his plan to shut down what is one of the world's most-influential foundations; sets layoff target and ...An evening steeped in Punjabi spirit and Lohri traditionsFrom pyres to preparation: Where do Nagpurs IAS aspirants go to study? A crematorium library-cum-peaceful learning spaceBattle for PMC & PCMC: Defining day for cities next 5 years; tough contests across wardsIBPS PO, SO result 2025 released at ibps.in: Direct link to download scorecards hereBengaluru: Budding tennis players get CSR boosterThese birth dates should keep Peacock feather with themAdhuna: Threadarte weaves the power of the presentRabindra Sangeet gets a global orchestral canvasJana Nayagan censor row: Supreme Court rejects makers' plea; sent back to High CourtCoastal Road wont make it easier: TMM race director
Copyright © 2026 Bennett, Coleman & Co. Ltd. All rights reserved. For reprint rights: Times Syndication Service
================================================================================================
generated from attacks-export-Gart-website.json + reported_K&R | case 134
================================================================================================