feat(sources): Wayback pass, automatic trimming, detention rule, ten cases re-sourced

Second and third rounds on the dossier pipeline, reviewed locally before commit.

Retrieval
- wayback_pass.py: retries every BLOCKED/DEAD/THIN/ERROR linked source through
  the Wayback Machine; blocks carry the snapshot date, archive URL and the live
  verdict. 143 slots retried: 93 fetched, 37 no snapshot, 12 script shells, 1 PDF.
- fetch_sources.py: fetch_wayback() helper.
- add_extra_sources.py: files staged extra_* finds (web search, not on the DB
  record) into the store with a provenance note.
- Cases re-sourced by web search: 248 (Oslo: Document.no, Avisa Oslo, NRK; the
  linked Le Parisien piece is case 242 and is marked OFF-CASE), 258 Kharkiv,
  260 Singapore, 358 Bangkok, 365 Las Vegas, 388 Verneuil-sur-Seine, 390 Zoersel,
  430 Homestead. 341 of 364 cases now hold a fetched article; 11, 66 and 399
  have no public text source (podcast, police video, direct victim report).

Trimming
- auto_trim.py: case-anchored furniture cut for UNTRIMMED blocks. Finds the body
  run that mentions the case, merges across subheadings and short furniture
  gaps, drops teasers, share bars, date/URL/caption lines and subscription
  pitches; refuses pages with no record term or almost no body. 302 blocks
  trimmed; 16 left on auto-trim-review.md (7 OFF-CASE suspects). Every cut is
  labelled AUTO-TRIMMED, UNREVIEWED in the dossier; the full extract stays in
  staging/. Decisions with anchors in trim-decisions-auto.json.
- build_cases.py / verify_all.py: banners for auto-trimmed and archived blocks,
  staged-file check extended to Wayback blocks, flag legend under the record.

Detention rule
- README "Definitions": the DB field `kidnappings` is the DETENTION violence
  type (victim, guard, staff or relative held to force submission or execute
  the theft), distinct from the Kidnapping scenario (taken away and held).
- detention-flag-review.md / detention-flag-corrections.json: 40 records
  reviewed with evidence; 30 set-to-1 proposals accepted by the owner on
  2026-09-06 (listed in corrections-approved.md), 10 still open.
- apply_detention_wording.py: "Violence Used" in the 70 reviewed summaries now
  names detention explicitly (62 of 70 labelled), supported by the summary's
  own text; idempotent; supersedes the batch scripts' wording.

Worklist and docs
- sofia-worklist.md: 248 decisions, detention rule item replacing the old
  "no abduction" item, fresh-search section for the textless cases.
- README-START-HERE.md: progress notes, run commands, next steps.
- Bug fixed in passing: Wayback blocks stored in-memory text with carriage
  returns; now stored as read back from disk.

verify_all.py PASSES (2321 checks).

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GZZENdTLzNGsbNy4DyF1yt
This commit is contained in:
StellarCrow
2026-09-06 19:36:45 +02:00
co-authored by Claude Fable 5.1
parent 499fd61f79
commit 439e83a4cb
588 changed files with 24800 additions and 13190 deletions
+69 -4
View File
@@ -26,6 +26,9 @@ DATABASE RECORD
notes thief posing as a delivery person, brandished a gun and tied up the victim with duct tape
has_processed_date 0
created_at 2025-12-02 17:02:34
(flag legend: 'kidnappings' is the DETENTION flag — 1 when the victim was held against
their will at any point, tied, locked in, held at gunpoint or taken away; it is NOT the
same as the 'Kidnapping' scenario, which means taken away and held. See README, Definitions.)
AI SUMMARY [generated at bulk import, NOT verified against sources]
**Victim:** Homeowner in San Francisco, USA (identity undisclosed)
@@ -44,10 +47,6 @@ LINKED SOURCES
[url] https://www.sfchronicle.com/crime/article/sf-cryptocurrency-robbery-21203804.php
[url_2] https://www.kron4.com/news/technology-ai/tech-expert-reveals-how-to-protect-your-cryptocurrency-after-11-million-theft/
OTHER LINKED SOURCES
[BLOCKED] url_2 None — raw request refused; try the WebFetch path, which is a model transcription and must be labelled as such
https://www.kron4.com/news/technology-ai/tech-expert-reveals-how-to-protect-your-cryptocurrency-after-11-million-theft/
------------------------------------------------------------------------------------------------
FETCHED ARTICLE 1
Source sfchronicle.com
@@ -89,6 +88,72 @@ Police said officers responded to the home at about 6:45 p.m. and found the vict
Attempts to reach the person listed in public records as the homeowner were unsuccessful.
------------------------------------------------------------------------------------------------
FETCHED ARTICLE 2 [AUTO-TRIMMED — UNREVIEWED]
!! Furniture was cut by a script keyed on this case's record, not by a person.
!! It may still carry passages about OTHER cases from a round-up article.
!! The full page extract is kept in staging/ if a cut needs revisiting.
Source kron4.com
URL https://www.kron4.com/news/technology-ai/tech-expert-reveals-how-to-protect-your-cryptocurrency-after-11-million-theft/
Field url_2
Retrieved 2026-09-05T13:25:34+00:00 via Wayback Machine snapshot 20251220082119, deterministic extraction (HTTP None)
Language unknown
Kept paragraphs headline [0] + 1-21 of 49
Length 3,056 chars
Integrity sha256 79a531ade50933b4ecd54c2101f6441f41da0146b6baaaf5d974855c496da3eb
Trimmed AUTO-TRIMMED, unreviewed: kept paragraphs 1-21 plus headline [0]; dropped 0 leading and 27 trailing paragraphs. Case-term hits on page: 6.
Note live URL was BLOCKED on the first pass; text comes from an archived copy dated 2025-12-20
Archive http://web.archive.org/web/20251220082119/https://www.kron4.com/news/technology-ai/tech-expert-reveals-how-to-protect-your-cryptocurrency-after-11-million-theft/
Caveat retrieved from a Wayback Machine snapshot, not the live page. The
snapshot date is in the method line; the live URL was unreadable.
------------------------------------------------------------------------------------------------
ORIGINAL (unknown, verbatim as retrieved)
San Francisco Crypto Crime: $11M Stolen in Bitcoin Heist
Editors Note: The video attached to this article has been updated to remove an image of a house.
SAN FRANCISCO (KRON) — A crypto crime was committed in San Francisco on Saturday.
Police say it happened around 6:45 pm. According to the San Francisco Chronicle, $11 million in cryptocurrency was taken. The newspaper reported that the victim had $11 million in cryptocurrency stolen by a man posing as a delivery person.
According to the Chronicle, the suspect brandished a gun and tied up the victim with duct tape. The suspect reportedly then escaped with the victims belongings.
San Francisco police say that officers responded to a residence on Dorland Street in the citys Mission District around 6:45 p.m. Saturday — a victim inside his home who said he had been physically restrained and suffered what police referred to as “financial loss.”
Paramedics were dispatched to the residence where the victim suffered “non-life-threatening injuries.” As of Monday evening, no arrests have been made in the crime on Dorland Street.
KRON4 spoke with a tech expert about how the currency can be protected.
San Jose State professor Ahmed Banafa wrote a book on how to protect your cryptocurrency and says crimes like the one that occurred in San Francisco over the weekend are happening more often than you think.
Banafa wrote a book on the technology of crypto and has heard of others being targeted for the currency. Some victims even filed reports of kidnapping and torture.
Banafa says the case from Saturday proves the importance of dividing your crypto up when dealing with large sums.
“Its clear who they are going after, and its not a surprise,” said Banafa.
“If you have 11 million dollars, which is the number were talking about here, Im not going to keep it on one device. I can divide it into multiple devices, in multiple wallets. Its like having your money in multiple accounts in the bank,” Banafa added.
The tech expert also recommends using multi-signature, where cryptocurrency cannot be transferred unless multiple people agree to it. If youre dealing with millions, security measures around your property are also important.
“Physical security is living somewhere you have cameras, dont open the door to people unless you make sure that you know them. All the kinds of things to protect yourself,” Banafa said.
If you have any information about what happened, youre asked to contact SFPD to help with their investigation.
Amazons first Super Saturday Sale has huge discounts …
Amazons first-ever Super Saturday Sale has deep discounts designed specifically for gifts that can still arrive in time for Christmas.
Get prepared with these party essentials to ring …
From dazzling decorations to fun props and everything in between, weve rounded up all the party supplies you need to ring in 2026.
Walmarts Flash Deals are filled with hidden gems …
Huge savings at Walmart are just a few clicks away. Here are the deals you should check out this week.
================================================================================================
generated from attacks-export-Gart-website.json + reported_K&R | case 360
================================================================================================