Sofia/DB-cleanup
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Activity

feat(sources): fetch linked URLs for the 252 spreadsheet-only cases

Browse Source 
Until now only cases 357+ (plus a few older ones) had their linked URLs
fetched; the other 252 dossiers held just the text pasted into the
spreadsheet, often only the lede. This pass fetches every linked URL for
those cases so the full text is on file before link rot takes it.

- stage_all.py: new --include-sheet-cases flag that lifts the skip on
  cases holding spreadsheet articles. Resumable as before.
- staging/: raw extracts and index.json for the 252 cases.
- sourced-articles.json, case-files-manifest.json: 188 new UNTRIMMED
  blocks. 179 cases gained at least one fetched article; 73 got none
  (49 BLOCKED, 18 THIN, 9 DEAD, 4 video/social, 3 ERROR).
- sources/*.txt: rebuilt with build_cases.py --all. Sheet pastes are
  kept; fetched blocks sit beside them under the NOT YET TRIMMED banner.
  Files previously committed with CRLF are now LF.
- wayback-availability.json: Wayback snapshots exist for 73 of the 98
  failed URL slots; input for an archive-fetch pass.
- README-START-HERE.md: progress note and next step.

verify_all.py PASSES (1836 checks).

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GZZENdTLzNGsbNy4DyF1yt
This commit is contained in:
StellarCrow
2026-09-05 15:02:39 +02:00
co-authored by Claude Fable 5.1
parent ba7529ea50
commit 499fd61f79
785 changed files with 69932 additions and 16771 deletions
Download Patch File Download Diff File Expand all files Collapse all files
merge-output/sources/022_Pavel-Lerner.txt
+50
View File
@@ -104,6 +104,56 @@ Exmo spokesman Anatoliy Larin told the BBC: "We are doing everything possible to
"Despite the situation the exchange is working as usual. We also want to stress that nature of Pavel's job at Exmo doesn't assume access either to storages or any personal data of users. All users' funds are absolutely safe."
------------------------------------------------------------------------------------------------
FETCHED ARTICLE 1 [RAW EXTRACT — NOT YET TRIMMED]
!! This is the whole page as extracted. It still contains site furniture,
!! and may contain teaser headlines for UNRELATED cases. Trim on read-through.
!! Do not quote from it without checking the passage belongs to this case.
Source bbc.com
URL https://www.bbc.com/news/business-42505261
Field url
Retrieved 2026-09-05T12:56:24+00:00 via raw HTTP retrieval, deterministic extraction (HTTP 200)
Language unknown
Kept paragraphs ALL 15 paragraphs, untrimmed
Length 1,532 chars
Integrity sha256 ad7efb5633b96ac6eefbb11377c322d35407afa68247e8e1f8078f550c797b87
Trimmed NOT TRIMMED. Full page extract; trim on read-through.
Caveat retrieved from a live page on the date above. Unlike text copied
from the spreadsheet, there is no second copy to hash it against.
------------------------------------------------------------------------------------------------
ORIGINAL (unknown, verbatim as retrieved)
Exmo Bitcoin exchange manager kidnapped in Kiev
A manager of the Exmo Bitcoin exchange has been kidnapped in Ukraine.
According to Russian and Ukrainian media reports Pavel Lerner, 40, was kidnapped while leaving his office in Kiev's Obolon district on 26 December.
The reports said he was dragged into a black Mercedes-Benz by men wearing balaclavas.
Police in Kiev confirmed to the BBC that a man had been kidnapped on the day in question, but would not confirm his identity.
A spokeswoman said that the matter was currently under investigation, and that more information would be made public later on.
Mr Lerner is a prominent Russian blockchain expert and the news of his kidnapping has stunned many in the international cryptocurrency community.
Exmo described him as an analytics manager.
Blockchain is the technology that underpins the digital currency Bitcoin.
Exmo Finance is registered with Companies House in the UK, but has its main operations in Ukraine.
According to its website, it has 94,955 active users trading cryptocurrencies.
Separately, Exmo said in a tweet that it been the target of a cyber attack on Thursday.
Exmo spokesman Anatoliy Larin told the BBC: "We are doing everything possible to speed up the search for Pavel Lerner.
"Despite the situation the exchange is working as usual. We also want to stress that nature of Pavel's job at Exmo doesn't assume access either to storages or any personal data of users. All users' funds are absolutely safe."
Would you want to get paid in Bitcoin?
================================================================================================
generated from attacks-export-Gart-website.json + reported_K&R | case 022
================================================================================================