feat(sources): fetch linked URLs for the 252 spreadsheet-only cases

Until now only cases 357+ (plus a few older ones) had their linked URLs
fetched; the other 252 dossiers held just the text pasted into the
spreadsheet, often only the lede. This pass fetches every linked URL for
those cases so the full text is on file before link rot takes it.

- stage_all.py: new --include-sheet-cases flag that lifts the skip on
  cases holding spreadsheet articles. Resumable as before.
- staging/: raw extracts and index.json for the 252 cases.
- sourced-articles.json, case-files-manifest.json: 188 new UNTRIMMED
  blocks. 179 cases gained at least one fetched article; 73 got none
  (49 BLOCKED, 18 THIN, 9 DEAD, 4 video/social, 3 ERROR).
- sources/*.txt: rebuilt with build_cases.py --all. Sheet pastes are
  kept; fetched blocks sit beside them under the NOT YET TRIMMED banner.
  Files previously committed with CRLF are now LF.
- wayback-availability.json: Wayback snapshots exist for 73 of the 98
  failed URL slots; input for an archive-fetch pass.
- README-START-HERE.md: progress note and next step.

verify_all.py PASSES (1836 checks).

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GZZENdTLzNGsbNy4DyF1yt
This commit is contained in:
StellarCrow
2026-09-05 15:02:39 +02:00
co-authored by Claude Fable 5.1
parent ba7529ea50
commit 499fd61f79
785 changed files with 69932 additions and 16771 deletions
@@ -0,0 +1,39 @@
Armed men force their way into Calgary home, steal cryptocurrency keys | Calgary Herald
This advertisement has not loaded yet, but your article continues below.
Calgary police are asking the public to help identify a suspect linked to a violent home invasion earlier this week in the southwest community of Canyon Meadows.
Around midnight on April 13, two men armed with handguns forced their way into an apartment in the 11600 block of Elbow Drive S.W., police said.
The men tied up the apartments resident and stole computers, jewelry and bank cards from the suite. They also took cryptocurrency keys, which allow holders access to digital financial accounts.
The men forced the victim to disclose his bank PINs, then put him in a storage room and fled.
Your weekday lunchtime roundup of curated links, news highlights, analysis and features.
By signing up you consent to receive the above newsletter from Postmedia Network Inc.
Thanks for signing up!
A welcome email is on its way. If you don't see it, please check your junk folder.
The next issue of Noon News Roundup will soon be in your inbox.
We encountered an issue signing you up. Please try again
Interested in more newsletters? Browse here.
The victim, who sustained minor injuries, was able to free himself and call 911, police said.
A man later used one of the victims bank cards to withdraw money at an ATM in Crescent Heights, near the intersection of 12th Avenue and Centre Street N.E. The ATM recorded an image of the man, who is unknown to the victim.
Anyone with information on the crime or the suspects is urged to call the police non-emergency line at 403-266-1234. Anonymous tips can also be submitted to Crime Stoppers at 1-800-222-8477 or calgarycrimestoppers.org.
This advertisement has not loaded yet.
You must be logged in to join the discussion or read more comments.
Postmedia is committed to maintaining a lively but civil forum for discussion. Please keep comments relevant and respectful. Comments may take up to an hour to appear on the site. You will receive an email if there is a reply to your comment, an update to a thread you follow or if a user you follow comments. Visit our Community Guidelines for more information.
This website uses cookies to personalize your content (including ads), and allows us to analyze our traffic. Read more about cookies here. By continuing to use our site, you agree to our Terms of Use and Privacy Policy.
+16
View File
@@ -0,0 +1,16 @@
[
{
"case": 85,
"n": 1,
"field": "url",
"url": "https://calgaryherald.com/news/crime/police-seek-suspects-in-canyon-meadows-home-invasion",
"host": "calgaryherald.com",
"fetched_at": "2026-09-05T12:53:51+00:00",
"verdict": "FETCHED",
"method": "raw",
"http": 200,
"chars": 2450,
"sha256": "61f25f82de44607e1c952cdfc56b86deb520c7fd5fef59ea18afed97510e24ff",
"final_url": null
}
]