feat(sources): Wayback pass, automatic trimming, detention rule, ten cases re-sourced

Second and third rounds on the dossier pipeline, reviewed locally before commit.

Retrieval
- wayback_pass.py: retries every BLOCKED/DEAD/THIN/ERROR linked source through
  the Wayback Machine; blocks carry the snapshot date, archive URL and the live
  verdict. 143 slots retried: 93 fetched, 37 no snapshot, 12 script shells, 1 PDF.
- fetch_sources.py: fetch_wayback() helper.
- add_extra_sources.py: files staged extra_* finds (web search, not on the DB
  record) into the store with a provenance note.
- Cases re-sourced by web search: 248 (Oslo: Document.no, Avisa Oslo, NRK; the
  linked Le Parisien piece is case 242 and is marked OFF-CASE), 258 Kharkiv,
  260 Singapore, 358 Bangkok, 365 Las Vegas, 388 Verneuil-sur-Seine, 390 Zoersel,
  430 Homestead. 341 of 364 cases now hold a fetched article; 11, 66 and 399
  have no public text source (podcast, police video, direct victim report).

Trimming
- auto_trim.py: case-anchored furniture cut for UNTRIMMED blocks. Finds the body
  run that mentions the case, merges across subheadings and short furniture
  gaps, drops teasers, share bars, date/URL/caption lines and subscription
  pitches; refuses pages with no record term or almost no body. 302 blocks
  trimmed; 16 left on auto-trim-review.md (7 OFF-CASE suspects). Every cut is
  labelled AUTO-TRIMMED, UNREVIEWED in the dossier; the full extract stays in
  staging/. Decisions with anchors in trim-decisions-auto.json.
- build_cases.py / verify_all.py: banners for auto-trimmed and archived blocks,
  staged-file check extended to Wayback blocks, flag legend under the record.

Detention rule
- README "Definitions": the DB field `kidnappings` is the DETENTION violence
  type (victim, guard, staff or relative held to force submission or execute
  the theft), distinct from the Kidnapping scenario (taken away and held).
- detention-flag-review.md / detention-flag-corrections.json: 40 records
  reviewed with evidence; 30 set-to-1 proposals accepted by the owner on
  2026-09-06 (listed in corrections-approved.md), 10 still open.
- apply_detention_wording.py: "Violence Used" in the 70 reviewed summaries now
  names detention explicitly (62 of 70 labelled), supported by the summary's
  own text; idempotent; supersedes the batch scripts' wording.

Worklist and docs
- sofia-worklist.md: 248 decisions, detention rule item replacing the old
  "no abduction" item, fresh-search section for the textless cases.
- README-START-HERE.md: progress notes, run commands, next steps.
- Bug fixed in passing: Wayback blocks stored in-memory text with carriage
  returns; now stored as read back from disk.

verify_all.py PASSES (2321 checks).

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GZZENdTLzNGsbNy4DyF1yt
This commit is contained in:
StellarCrow
2026-09-06 19:36:45 +02:00
co-authored by Claude Fable 5.1
parent 499fd61f79
commit 439e83a4cb
588 changed files with 24800 additions and 13190 deletions
@@ -26,6 +26,9 @@ DATABASE RECORD
notes The group fled and met up with a second team including Osama to collect and divide the proceeds. Seven total charged federally; all ordered detained.
has_processed_date 0
created_at 2026-05-25 17:38:02
(flag legend: 'kidnappings' is the DETENTION flag — 1 when the victim was held against
their will at any point, tied, locked in, held at gunpoint or taken away; it is NOT the
same as the 'Kidnapping' scenario, which means taken away and held. See README, Definitions.)
AI SUMMARY [generated at bulk import, NOT verified against sources]
**Victims:** Unidentified individual, Winnetka, Cook County (North Shore suburb), Illinois. Home address targeted for cryptocurrency holdings and safe contents.
@@ -44,10 +47,6 @@ LINKED SOURCES
[url] https://chicago.suntimes.com/chicago-gangs/2026/04/28/chicago-crime-lil-zay-osama-drill-rap-winnetka-robbery
[url_2] https://www.justice.gov/usao-edny/pr/rapper-known-lil-zay-osama-sentenced-14-months-prison-possessing-illegal-machinegun
OTHER LINKED SOURCES
[THIN] url_2 None — extractor recovered very little; needs the WebFetch path or a site-specific rule
https://www.justice.gov/usao-edny/pr/rapper-known-lil-zay-osama-sentenced-14-months-prison-possessing-illegal-machinegun
------------------------------------------------------------------------------------------------
FETCHED ARTICLE 1
Source chicago.suntimes.com
@@ -105,6 +104,56 @@ The rapper blamed the attack on kids having too much time on their hands and sai
But Osamas also been in trouble with the feds before. A federal judge in Brooklyn sentenced him in 2024 to 14 months in prison after he pleaded guilty to possession of a machine gun. He left the pistol — affixed with a switch that turned it into an automatic weapon — in the back of a rideshare vehicle that took him from a luxury Manhattan hotel to a recording studio in Queens, prosecutors said.
------------------------------------------------------------------------------------------------
FETCHED ARTICLE 2 [AUTO-TRIMMED — UNREVIEWED]
!! Furniture was cut by a script keyed on this case's record, not by a person.
!! It may still carry passages about OTHER cases from a round-up article.
!! The full page extract is kept in staging/ if a cut needs revisiting.
Source justice.gov
URL https://www.justice.gov/usao-edny/pr/rapper-known-lil-zay-osama-sentenced-14-months-prison-possessing-illegal-machinegun
Field url_2
Retrieved 2026-09-05T13:21:41+00:00 via Wayback Machine snapshot 20260525035549, deterministic extraction (HTTP None)
Language unknown
Kept paragraphs headline [0] + 9-21 of 22
Length 4,227 chars
Integrity sha256 c55c868dd67026d76645effaab087bcf12c09351d46037daf7fa904ec6c49dd0
Trimmed AUTO-TRIMMED, unreviewed: kept paragraphs 9-21 plus headline [0]; dropped 8 leading and 0 trailing paragraphs. Case-term hits on page: 8.
Note live URL was THIN on the first pass; text comes from an archived copy dated 2026-05-25
Archive http://web.archive.org/web/20260525035549/https://www.justice.gov/usao-edny/pr/rapper-known-lil-zay-osama-sentenced-14-months-prison-possessing-illegal-machinegun
Caveat retrieved from a Wayback Machine snapshot, not the live page. The
snapshot date is in the method line; the live URL was unreadable.
------------------------------------------------------------------------------------------------
ORIGINAL (unknown, verbatim as retrieved)
Eastern District of New York | Rapper Known as "Lil Zay Osama" Sentenced to 14 Months in Prison for Possessing an Illegal Machinegun | United States Department of Justice
Earlier today, at the federal courthouse in Brooklyn, Isaiah Dukes, also known as “Lil Zay Osama,” was sentenced by United States District Judge Nina R. Morrison to 14 months in prison and a $10,000 fine. Dukes was indicted in January 2024 for possession of a machinegun, and pleaded guilty in May 2024.
Breon Peace, United States Attorney for the Eastern District of New York, Bryan Miller, Special Agent in Charge, Bureau of Alcohol, Tobacco, Firearms and Explosives, New York Field Office (ATF), and Thomas G. Donlon, Interim Commissioner, New York City Police Department (NYPD) announced the sentence.
“The defendant knowingly carried a fully automatic weapon, a pistol with a switch device whose only purpose is to make a dangerous weapon all the more deadly and then carelessly left that gun in the back of a rideshare,” stated United States Attorney Peace. “Todays sentence serves as a warning that those who possess illegal guns, particularly with switches that convert those guns into machineguns, will be held accountable for their actions and for the danger they pose to our community.”
“This sentencing highlights a crucial point: possessing a machine gun conversion device is illegal under federal law. Machine gun conversion devices exponentially increase the lethality of firearms and put our communities in serious danger. Every device removed from our streets represents lives saved and tragedies prevented. The ATF's primary goal is safeguarding the public from violent crimes, and the removal of these devices significantly contributes to achieving this mission. We are grateful to the ATF NY Joint Firearms Task Force, NYPD, and EDNY for their dedicated efforts in this endeavor. ATF proudly collaborates with our law enforcement partners to eliminate these dangerous devices from our streets and ensure public safety,” stated ATF Special Agent in Charge Bryan Miller.
“Todays sentence serves as a reminder to anyone who may bring an illegal firearm, especially one that has been modified to increase its lethality, into New York City: There are serious consequences for your reckless actions,” stated NYPD Interim Commissioner Donlon. “The NYPD and our law enforcement partners are fully committed to holding criminals accountable and ensuring the safety of our streets and communities for all New Yorkers.”
As set forth in the governments sentencing memorandum and other court documents, on September 29, 2022, Dukes carried a loaded Glock pistol affixed with a switch — a device that when attached to the back of a handgun like a Glock converts the firearm into a fully automatic weapon. Dukes was arrested after leaving the firearm in a rideshare vehicle that brought him from a luxury hotel in Manhattan to a recording studio in Queens. Law enforcement subsequently determined that the firearm could automatically fire more than one round with a single function of the trigger, rendering it a machinegun.
Assistant United States Attorneys Gilbert M. Rein and Rebecca M. Schuman are in charge of the prosecution, with assistance from Paralegal Specialist Rachel Friedman.
Staten Island Man Convicted of Firearms Trafficking Conspiracy and Obstruction of Justice
Earlier today, a federal jury in Brooklyn convicted Brandon Nudelman on all three counts of a second superseding indictment charging him with firearms trafficking conspiracy, firearms trafficking, and conspiracy to...
Two Defendants Charged With Murdering Man at a Queens Intersection
Earlier today, at the federal courthouse in Brooklyn, an indictment was unsealed charging Rafael Hernandez, also known as “Cap” and “Ralphy,” and Joibel Perez, also known as “J.P.,” with multiple...
International Arms Dealer Sentenced to 39 Months Imprisonment for Conspiring to Export American-Made Firearms and Ammunition to Russia
Earlier today in federal court in Brooklyn, Kyrgyz national Sergei Zharnovnikov was sentenced to 39 months imprisonment for conspiracy to export American-made firearms. The proceeding was held before United States District Judge...
================================================================================================
generated from attacks-export-Gart-website.json + reported_K&R | case 442
================================================================================================