feat(sources): Wayback pass, automatic trimming, detention rule, ten cases re-sourced

Second and third rounds on the dossier pipeline, reviewed locally before commit.

Retrieval
- wayback_pass.py: retries every BLOCKED/DEAD/THIN/ERROR linked source through
  the Wayback Machine; blocks carry the snapshot date, archive URL and the live
  verdict. 143 slots retried: 93 fetched, 37 no snapshot, 12 script shells, 1 PDF.
- fetch_sources.py: fetch_wayback() helper.
- add_extra_sources.py: files staged extra_* finds (web search, not on the DB
  record) into the store with a provenance note.
- Cases re-sourced by web search: 248 (Oslo: Document.no, Avisa Oslo, NRK; the
  linked Le Parisien piece is case 242 and is marked OFF-CASE), 258 Kharkiv,
  260 Singapore, 358 Bangkok, 365 Las Vegas, 388 Verneuil-sur-Seine, 390 Zoersel,
  430 Homestead. 341 of 364 cases now hold a fetched article; 11, 66 and 399
  have no public text source (podcast, police video, direct victim report).

Trimming
- auto_trim.py: case-anchored furniture cut for UNTRIMMED blocks. Finds the body
  run that mentions the case, merges across subheadings and short furniture
  gaps, drops teasers, share bars, date/URL/caption lines and subscription
  pitches; refuses pages with no record term or almost no body. 302 blocks
  trimmed; 16 left on auto-trim-review.md (7 OFF-CASE suspects). Every cut is
  labelled AUTO-TRIMMED, UNREVIEWED in the dossier; the full extract stays in
  staging/. Decisions with anchors in trim-decisions-auto.json.
- build_cases.py / verify_all.py: banners for auto-trimmed and archived blocks,
  staged-file check extended to Wayback blocks, flag legend under the record.

Detention rule
- README "Definitions": the DB field `kidnappings` is the DETENTION violence
  type (victim, guard, staff or relative held to force submission or execute
  the theft), distinct from the Kidnapping scenario (taken away and held).
- detention-flag-review.md / detention-flag-corrections.json: 40 records
  reviewed with evidence; 30 set-to-1 proposals accepted by the owner on
  2026-09-06 (listed in corrections-approved.md), 10 still open.
- apply_detention_wording.py: "Violence Used" in the 70 reviewed summaries now
  names detention explicitly (62 of 70 labelled), supported by the summary's
  own text; idempotent; supersedes the batch scripts' wording.

Worklist and docs
- sofia-worklist.md: 248 decisions, detention rule item replacing the old
  "no abduction" item, fresh-search section for the textless cases.
- README-START-HERE.md: progress notes, run commands, next steps.
- Bug fixed in passing: Wayback blocks stored in-memory text with carriage
  returns; now stored as read back from disk.

verify_all.py PASSES (2321 checks).

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GZZENdTLzNGsbNy4DyF1yt
This commit is contained in:
StellarCrow
2026-09-06 19:36:45 +02:00
co-authored by Claude Fable 5.1
parent 499fd61f79
commit 439e83a4cb
588 changed files with 24800 additions and 13190 deletions
+11 -114
View File
@@ -26,6 +26,9 @@ DATABASE RECORD
notes they invited the victim to their "house"
has_processed_date 0
created_at 2025-11-14 09:05:23
(flag legend: 'kidnappings' is the DETENTION flag — 1 when the victim was held against
their will at any point, tied, locked in, held at gunpoint or taken away; it is NOT the
same as the 'Kidnapping' scenario, which means taken away and held. See README, Definitions.)
AI SUMMARY [revised on review, verified against the sources in this file. Live DB still holds the shorter bulk-import summary — apply this to it.]
**Victims:** An unidentified Odessa resident who had come to buy cryptocurrency.
@@ -70,19 +73,19 @@ Police are currently taking measures to identify other persons involved in the c
Criminal liability for open theft of anothers property is provided for under Article 187 of the Criminal Code. The punishment depends on the specific part of this article (from 3 to 15 years). Part 4 applies mandatory confiscation of property. According to classification, this crime is considered especially serious.
------------------------------------------------------------------------------------------------
FETCHED ARTICLE 1 [RAW EXTRACT — NOT YET TRIMMED]
!! This is the whole page as extracted. It still contains site furniture,
!! and may contain teaser headlines for UNRELATED cases. Trim on read-through.
!! Do not quote from it without checking the passage belongs to this case.
FETCHED ARTICLE 1 [AUTO-TRIMMED — UNREVIEWED]
!! Furniture was cut by a script keyed on this case's record, not by a person.
!! It may still carry passages about OTHER cases from a round-up article.
!! The full page extract is kept in staging/ if a cut needs revisiting.
Source bizlim.com
URL https://bizlim.com/crypto/news/odessa-robbery-for-1-5-million-uah-on-the-sale-of-crypto-currency.html
Field url
Retrieved 2026-09-05T12:45:39+00:00 via raw HTTP retrieval, deterministic extraction (HTTP 200)
Language unknown
Kept paragraphs ALL 53 paragraphs, untrimmed
Length 4,835 chars
Integrity sha256 e6d6ad2d8a0b786bbb2c3cdbb8c2a8eae799fb432394edeac08863c52e6456a0
Trimmed NOT TRIMMED. Full page extract; trim on read-through.
Kept paragraphs headline [0] + 1-7 of 53
Length 1,426 chars
Integrity sha256 8dab9e532e31201e0dfa63f4008bbb68a5a7cb4a94b34632793b2c60720edc91
Trimmed AUTO-TRIMMED, unreviewed: kept paragraphs 1-7 plus headline [0]; dropped 0 leading and 45 trailing paragraphs. Case-term hits on page: 8.
Caveat retrieved from a live page on the date above. Unlike text copied
from the spreadsheet, there is no second copy to hash it against.
------------------------------------------------------------------------------------------------
@@ -105,112 +108,6 @@ ORIGINAL (unknown, verbatim as retrieved)
Уголовная ответственность за открытое хищение чужого имущества предусмотрено ст. 187 УК. Наказание зависит от конкретной части указанной статьи (от 3-х до 15 лет). По части 4 применяется обязательная конфискация имущества. По классификации, данное преступление относится к особо тяжким.
# криптовалюты
# мошенничество
# Украина
# Одесса
# разбой
← Россия: РАКИБ собирается сертифицировать криптовалютных трейдеров
Билл Гейтс: Я поставил бы против биткоина и криптовалют →
Комиссия по ценным бумагам выпустила руководство по цифровым активам (10.04.2019)
TOP-3 легальных компаний, выпускающих ICO в 2019 году (09.04.2019)
Объем торговли криптовалютой достиг исторического максимума (08.04.2019)
SEC перенесла срок принятия решения по биткойн-ETF VanEck/CBOE и Bitwise (08.04.2019)
Объем торгов биткоин-фьючерсами на CME взлетел на 950% (07.04.2019)
Исследование: почти 70% криптобирж работают без KYC (06.04.2019)
Microsoft Bing: "криптовалюта — главный инструмент мошенников и аферистов" (05.04.2019)
Одесские радикалы штурмовали офис крипто-бизнесмена
Мошенники запустили фейковую электронную валюту "от Нацбанка Украины"
Киберполиция Украины задержала сотрудника криптобиржи за хищении средств
Новости криптовалют, блокчейн, рынки, биржи, финансы, регулирование, стартапы
Али Мартинес назвал 3 причины готовности мемкоина Dogecoin к прорыву
Uniswap инвестировала в PONS. Токен взлетел до нового максимума
Объявлена важнейшая дата принятия Закона о крипто-буле (Закона о ясности)!
Южная Корея переведет рынок капитала в ончейн на базе Avalanche
Биткоин падает ниже $80 000 из-за опасений повышения ставки ФРС
Аналитики Fidelity назвали сроки завершения медвежьего тренда на крипторынке
QuFi испытала постквантовую защиту биткоина без изменения блокчейна
СМИ: экс-министру РФ заочно предъявили обвинение по делу «Финико»
Andreessen Horowitz: Скорость — больше не показатель хорошего блокчейна
Цифровой рубль, биткоин-ралли и ИИ, который просто не нанимает
Cryptocurrency news Bitcoin, etherium, altcoins, Blockchain, crypto exchange, law regulation
Toyota spent years moving slowly on EVs. I drove its new, affordable C-HR to see whether the wait paid off.
Uber says it can replace car ownership. My used Toyota Yaris proved its point.
One runner spent $40,000, another took a second job. Marathoners are making big sacrifices to chase medals worldwide.
GoMining Hack Drains 600+ Wallets, Thieves Consolidate $2.8M in ETH
Leaked Ripple Docs Name Uber and Airbnb as Prime Use Cases for Instant Worker Payouts
Metaplanets Business Head Phil Geiger Departs to Pursue New Bitcoin Ventures
Breaking: Anthropic IPO Eyes October Launch At $2 Trillion Valuation To Beat SpaceX
SEC Clears Bitcoin, Ether, XRP, Solana As Commodities Under Nasdaq Texas Rule Change
Texas Man Alters Treasury Check to Unlock Over $100,000 in Bank Account: Report
Fake GOP Convention Site Tops Google, Redirects to Epstein Files
CRYPTOBUZZ Talk about bitcoin, altcoins, blockchain, crypto exchange, law regulation, etc.
The Bitcoin Group #503 - Winter Over? - Give Nothing - ATM Scams, Film and Sports
Stellars Tokenized Asset Market Surges to $4 Billion
CLARITY Stalls, Kalshi Heads Toward SCOTUS & Wall Street Goes Onchain
Korea Blockchain Week 2026: FACTBLOCK CEO Andrew Park on What's Coming to Seoul | Bitcoin.com News
The 100X Crypto Trade Isnt Where You Think - CoinMarketCaps Alice Liu | Trade Secrets
Zcash Hits $1,000 as Short Sellers Lose $34 Million
Wall Street Is Already On-Chain | Consensus 2026 Miami
$1.3 Million Bitcoin Will Be “Relatively Easy,” Says Bitwises Matt Hougan
Bitcoin The People's Money or Elite Whale Passes
================================================================================================
generated from attacks-export-Gart-website.json + reported_K&R | case 270
================================================================================================