Sofia/DB-cleanup
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Activity

feat(sources): Wayback pass, automatic trimming, detention rule, ten cases re-sourced

Browse Source 
Second and third rounds on the dossier pipeline, reviewed locally before commit.

Retrieval
- wayback_pass.py: retries every BLOCKED/DEAD/THIN/ERROR linked source through
  the Wayback Machine; blocks carry the snapshot date, archive URL and the live
  verdict. 143 slots retried: 93 fetched, 37 no snapshot, 12 script shells, 1 PDF.
- fetch_sources.py: fetch_wayback() helper.
- add_extra_sources.py: files staged extra_* finds (web search, not on the DB
  record) into the store with a provenance note.
- Cases re-sourced by web search: 248 (Oslo: Document.no, Avisa Oslo, NRK; the
  linked Le Parisien piece is case 242 and is marked OFF-CASE), 258 Kharkiv,
  260 Singapore, 358 Bangkok, 365 Las Vegas, 388 Verneuil-sur-Seine, 390 Zoersel,
  430 Homestead. 341 of 364 cases now hold a fetched article; 11, 66 and 399
  have no public text source (podcast, police video, direct victim report).

Trimming
- auto_trim.py: case-anchored furniture cut for UNTRIMMED blocks. Finds the body
  run that mentions the case, merges across subheadings and short furniture
  gaps, drops teasers, share bars, date/URL/caption lines and subscription
  pitches; refuses pages with no record term or almost no body. 302 blocks
  trimmed; 16 left on auto-trim-review.md (7 OFF-CASE suspects). Every cut is
  labelled AUTO-TRIMMED, UNREVIEWED in the dossier; the full extract stays in
  staging/. Decisions with anchors in trim-decisions-auto.json.
- build_cases.py / verify_all.py: banners for auto-trimmed and archived blocks,
  staged-file check extended to Wayback blocks, flag legend under the record.

Detention rule
- README "Definitions": the DB field `kidnappings` is the DETENTION violence
  type (victim, guard, staff or relative held to force submission or execute
  the theft), distinct from the Kidnapping scenario (taken away and held).
- detention-flag-review.md / detention-flag-corrections.json: 40 records
  reviewed with evidence; 30 set-to-1 proposals accepted by the owner on
  2026-09-06 (listed in corrections-approved.md), 10 still open.
- apply_detention_wording.py: "Violence Used" in the 70 reviewed summaries now
  names detention explicitly (62 of 70 labelled), supported by the summary's
  own text; idempotent; supersedes the batch scripts' wording.

Worklist and docs
- sofia-worklist.md: 248 decisions, detention rule item replacing the old
  "no abduction" item, fresh-search section for the textless cases.
- README-START-HERE.md: progress notes, run commands, next steps.
- Bug fixed in passing: Wayback blocks stored in-memory text with carriage
  returns; now stored as read back from disk.

verify_all.py PASSES (2321 checks).

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GZZENdTLzNGsbNy4DyF1yt
This commit is contained in:
StellarCrow
2026-09-06 19:36:45 +02:00
co-authored by Claude Fable 5.1
parent 499fd61f79
commit 439e83a4cb
588 changed files with 24800 additions and 13190 deletions
Download Patch File Download Diff File Expand all files Collapse all files
merge-output/staging/228/02_reuters-com-wayback.txt
+69
View File
@@ -0,0 +1,69 @@
Men plead not guilty in NY to kidnapping, setting friend on fire with tequila for crypto | Reuters
Exclusive news, data and analytics for financial market professionalsLearn more aboutRefinitiv
Item 1 of 7 William Duplessie appears in Manhattan Criminal Court on cryptocurrency-related kidnapping charges, in New York City, U.S., June 11, 2025. REUTERS/Kylie Cooper
[1/7]William Duplessie appears in Manhattan Criminal Court on cryptocurrency-related kidnapping charges, in New York City, U.S., June 11, 2025. REUTERS/Kylie Cooper Purchase Licensing Rights, opens new tab
Defense disputes prosecution's allegations of torture
Defendants face possible life in prison if convicted
Cryptocurrency kidnappings rise as bitcoin price surges
NEW YORK, June 11 (Reuters) - Two men pleaded not guilty on Wednesday to charges they kidnapped a friend for three weeks at a townhouse in Manhattan's upscale SoHo neighborhood, cut him with a chainsaw and set him on fire after dousing him with tequila to try to get him to reveal his bitcoin password.
Defendants John Woeltz, 37, and William Duplessie, 33, appeared in a Manhattan court before Justice Gregory Carro, who denied their request to be released on bail pending trial on charges that carry up to a life sentence if convicted.
Sign up here.
Their lawyers during the hearing disputed the prosecution account that the men had tortured the alleged victim, who was not identified by name in court. Duplessie's lawyer Sam Talkin said the alleged victim was "having the time of his life" and took part in a "sex orgy" while at the townhouse.
The surge in the price of bitcoin and other cryptocurrencies in recent years has created a new group of wealthy investors who present tempting targets for criminals, according to security experts.
Prosecutor Sarah Khan told the hearing that the defendants and the alleged victim were involved in cryptocurrency investing and had communicated with each other electronically for years.
During an in-person meeting that began on May 6 in Manhattan, Duplessie and Woeltz took the alleged victim's devices and began a series of brutal beatings, Khan said.
"They pistol whipped him with a gun, they cut him with a small chainsaw and they used various other instruments," Khan said.
The defendants also urinated on the alleged victim to put out fires on his body that they set after dousing him with tequila, Khan said.
After three weeks, the alleged victim and Woeltz left the SoHo townhouse to retrieve the man's phone so he could transfer his cryptocurrency, Khan said. The alleged victim managed to run away and found a uniformed police officer, Khan added. He was barefoot and bleeding when he escaped, Khan said.
"He was in severe distress," Khan added.
Khan said authorities found a chainsaw, a loaded pistol and a photograph of Duplessie pointing a gun at the alleged victim when they searched the townhouse.
The alleged incident follows three cryptocurrency-linked kidnappings or kidnapping attempts in France this year.
Woeltz and Duplessie have been detained since being arrested last month on kidnapping and other charges. Carro ordered them to be detained without bail at least until their next hearing on July 15.
In urging Carro to release Duplessie on bail, Talkin said the alleged victim was free to leave the townhouse as he pleased. The man went out to church, clubs and dinners during the three weeks, according Wayne Gosnell, a lawyer for Woeltz.
"He could have talked to any passerby and told them, 'I'm in trouble, I need help,'" Gosnell told the judge.
Reporting by Luc Cohen in New York; Editing by Will Dunham and Noeleen Walder
Our Standards: The Thomson Reuters Trust Principles., opens new tab
Reports on the New York federal courts. Previously worked as a correspondent in Venezuela and Argentina.
United StatescategoryTroops in LA can detain individuals, official says, as protests spread across US
WorldcategoryBrian Wilson, founder of surf band The Beach Boys, dies aged 82
United StatescategoryTrump tariffs may remain in effect while appeals proceed, US appeals court rules
United StatescategoryMusk says some of his posts about Trump 'went too far'
Men plead not guilty in NY to kidnapping, setting friend on fire with tequila for crypto
United Statescategory · June 11, 2025 · 5:45 PM UTC · ago
Two men pleaded not guilty on Wednesday to charges they kidnapped a friend for three weeks at a townhouse in Manhattan's upscale SoHo neighborhood, cut him with a chainsaw and set him on fire after dousing him with tequila to try to get him to reveal his bitcoin password.
Middle EastcategoryUS embassy in Iraq preparing for ordered evacuation due to 'heightened security risks', sources say
EuropecategoryPolish government wins confidence vote after presidential election blow
merge-output/staging/228/index.json
+8 -5
View File
@@ -19,10 +19,13 @@
"field": "url_2",
"url": "https://www.reuters.com/world/us/two-men-plead-not-guilty-violent-new-york-crypto-kidnapping-case-2025-06-11/",
"host": "reuters.com",
"fetched_at": "2026-09-05T12:47:30+00:00",
"verdict": "BLOCKED",
"method": "raw",
"http": 401,
"note": "raw request refused; try the WebFetch path, which is a model transcription and must be labelled as such"
"fetched_at": "2026-09-05T13:27:41+00:00",
"verdict": "FETCHED",
"method": "wayback",
"snapshot": "20250611175722",
"archive_url": "http://web.archive.org/web/20250611175722/https://www.reuters.com/world/us/two-men-plead-not-guilty-violent-new-york-crypto-kidnapping-case-2025-06-11/",
"chars": 4818,
"sha256": "8bfd27224bee89528e196bfdd88a112131427cf372f0bf955b02dfc51755d783",
"live_verdict": "BLOCKED"
}
]