feat(sources): Wayback pass, automatic trimming, detention rule, ten cases re-sourced

Second and third rounds on the dossier pipeline, reviewed locally before commit.

Retrieval
- wayback_pass.py: retries every BLOCKED/DEAD/THIN/ERROR linked source through
  the Wayback Machine; blocks carry the snapshot date, archive URL and the live
  verdict. 143 slots retried: 93 fetched, 37 no snapshot, 12 script shells, 1 PDF.
- fetch_sources.py: fetch_wayback() helper.
- add_extra_sources.py: files staged extra_* finds (web search, not on the DB
  record) into the store with a provenance note.
- Cases re-sourced by web search: 248 (Oslo: Document.no, Avisa Oslo, NRK; the
  linked Le Parisien piece is case 242 and is marked OFF-CASE), 258 Kharkiv,
  260 Singapore, 358 Bangkok, 365 Las Vegas, 388 Verneuil-sur-Seine, 390 Zoersel,
  430 Homestead. 341 of 364 cases now hold a fetched article; 11, 66 and 399
  have no public text source (podcast, police video, direct victim report).

Trimming
- auto_trim.py: case-anchored furniture cut for UNTRIMMED blocks. Finds the body
  run that mentions the case, merges across subheadings and short furniture
  gaps, drops teasers, share bars, date/URL/caption lines and subscription
  pitches; refuses pages with no record term or almost no body. 302 blocks
  trimmed; 16 left on auto-trim-review.md (7 OFF-CASE suspects). Every cut is
  labelled AUTO-TRIMMED, UNREVIEWED in the dossier; the full extract stays in
  staging/. Decisions with anchors in trim-decisions-auto.json.
- build_cases.py / verify_all.py: banners for auto-trimmed and archived blocks,
  staged-file check extended to Wayback blocks, flag legend under the record.

Detention rule
- README "Definitions": the DB field `kidnappings` is the DETENTION violence
  type (victim, guard, staff or relative held to force submission or execute
  the theft), distinct from the Kidnapping scenario (taken away and held).
- detention-flag-review.md / detention-flag-corrections.json: 40 records
  reviewed with evidence; 30 set-to-1 proposals accepted by the owner on
  2026-09-06 (listed in corrections-approved.md), 10 still open.
- apply_detention_wording.py: "Violence Used" in the 70 reviewed summaries now
  names detention explicitly (62 of 70 labelled), supported by the summary's
  own text; idempotent; supersedes the batch scripts' wording.

Worklist and docs
- sofia-worklist.md: 248 decisions, detention rule item replacing the old
  "no abduction" item, fresh-search section for the textless cases.
- README-START-HERE.md: progress notes, run commands, next steps.
- Bug fixed in passing: Wayback blocks stored in-memory text with carriage
  returns; now stored as read back from disk.

verify_all.py PASSES (2321 checks).

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GZZENdTLzNGsbNy4DyF1yt
This commit is contained in:
StellarCrow
2026-09-06 19:36:45 +02:00
co-authored by Claude Fable 5.1
parent 499fd61f79
commit 439e83a4cb
588 changed files with 24800 additions and 13190 deletions
@@ -0,0 +1,41 @@
Durham man says 'enemies' called 911 to report false hostage situation
DURHAM, N.C. (WNCN) A Durham man is claiming that hes the latest victim of “swatting” after someone anonymously called police to report a false hostage situation at his home on Monday morning.
Police responded to the 1300 block of Whispering Oaks Lane in response to call about a hostage situation at one of the homes on the street. The call came in around 9 a.m., police said.
The 911 caller told dispatch he had already shot someone and was holding others hostage in the house.Listen to the 911 call at the top of this story
The caller also said he had explosives by the front door.
“By my voice, you can tell Im not in a mental health state,” the caller said. “Im all over the place. I dont know what to do.”
The caller then began to make demands.
“If I dont get $60,000, Im going to blow the whole (expletive) block up,” the caller said. “If I see any police coming toward the front door who arent handling a bag full of money, Ill shoot them on sight.”
The caller also tells the dispatcher he shot the victim 15 times with an assault rifle.
Authorities staged nearby on Cardinal Lake Drive while they worked to determine what was happening.
Police, EMS, a mobile command truck and armed officers in bulletproof vests were all at the scene. When authorities approached the home, the owner came out and told them that the call was false and that they never made any call to police and there was no hostage situation at the home.
Homeowner Jameson Lopp told CBS North Carolina that he works for a software company and has made several online, anonymous “enemies” and that he believes one of them was getting “revenge.”
“I am not intimated by this. This is actually, from my perspective evidence that the people who want to do this do not have the guts to say anything to my face. They dont have the guts to come here and actually tell me what their problem is with me,” said Lopp.
Durham police have not confirmed this to be a swatting case. At last check, police have not been able to track the caller.
Could an Annuity Help Guarantee Your Lifelong Income?
When Should You Call For A Free Roof Inspection?
Woman shot at Thanksgiving family gathering in Raleigh; fines possible for COVID-19 violations, police say
Nash County deputy seriously injured in crash in Rocky Mount, police say
Family of woman hit by car after deadly shooting in Durham says hes always worried for their safety
NC woman arrested on multiple charges in connection with fatal hit-and-run
Georgia secretary of state blasts President Trump over Georgia elections
+8 -5
View File
@@ -5,10 +5,13 @@
"field": "url",
"url": "https://www.cbs17.com/news/durham-man-says-enemies-called-911-to-report-false-hostage-situation/",
"host": "cbs17.com",
"fetched_at": "2026-09-05T12:56:37+00:00",
"verdict": "BLOCKED",
"method": "raw",
"http": 403,
"note": "raw request refused; try the WebFetch path, which is a model transcription and must be labelled as such"
"fetched_at": "2026-09-05T13:32:50+00:00",
"verdict": "FETCHED",
"method": "wayback",
"snapshot": "20201127135714",
"archive_url": "http://web.archive.org/web/20201127135714/https://www.cbs17.com/news/durham-man-says-enemies-called-911-to-report-false-hostage-situation/",
"chars": 2639,
"sha256": "20a92f53fbeeb1ddf24830d1320974082317495f2b66c390a801b36f3c15375c",
"live_verdict": "BLOCKED"
}
]