feat(sources): fetch linked URLs for the 252 spreadsheet-only cases

Until now only cases 357+ (plus a few older ones) had their linked URLs
fetched; the other 252 dossiers held just the text pasted into the
spreadsheet, often only the lede. This pass fetches every linked URL for
those cases so the full text is on file before link rot takes it.

- stage_all.py: new --include-sheet-cases flag that lifts the skip on
  cases holding spreadsheet articles. Resumable as before.
- staging/: raw extracts and index.json for the 252 cases.
- sourced-articles.json, case-files-manifest.json: 188 new UNTRIMMED
  blocks. 179 cases gained at least one fetched article; 73 got none
  (49 BLOCKED, 18 THIN, 9 DEAD, 4 video/social, 3 ERROR).
- sources/*.txt: rebuilt with build_cases.py --all. Sheet pastes are
  kept; fetched blocks sit beside them under the NOT YET TRIMMED banner.
  Files previously committed with CRLF are now LF.
- wayback-availability.json: Wayback snapshots exist for 73 of the 98
  failed URL slots; input for an archive-fetch pass.
- README-START-HERE.md: progress note and next step.

verify_all.py PASSES (1836 checks).

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GZZENdTLzNGsbNy4DyF1yt
This commit is contained in:
StellarCrow
2026-09-05 15:02:39 +02:00
co-authored by Claude Fable 5.1
parent ba7529ea50
commit 499fd61f79
785 changed files with 69932 additions and 16771 deletions
+125
View File
@@ -0,0 +1,125 @@
3 men charged in Montreal cryptocurrency robbery, kidnapping
Skip to main content
3 men facing kidnapping, robbery and other charges in crypto theft: Montreal police
Updated: April 10, 2025 at 11:36a.m. EDT
Published: April 10, 2025 at 11:24a.m. EDT
It took more than 5 years for this cyclist to ride through all of Torontos streets. Heres what he had to say
Driver flees after motorcycle crash on Gardiner Expressway
Order in urgent circumstances: B.C. regulator suspends real estate agent
Alberta Independence group releases transition paper if Albertans vote on separation
80-year-old woman hit by Calgary Transit bus suffers serious injuries: police
The Long Walk Back: Cancer survivor walks 240 kilometres from Montreal to Ottawa to thank the team that saved her life
ByWard Market café now serving Canadiano coffee as trade war continues
Loyola High School forgoes Quebec funding to preserve its Catholic mission
Meet the organization behind most of Montreals murals
Province launches online portal for businesses hit by impending tariffs
Classroom complexity team staffing below target as Alberta students return to school
Man accused in Halifax Costco racist tirade video now facing eight charges
Pioneering pilot remembered in Cape Breton 90 years after historic flight
30 to 40 Calls a Day: Winnipeg Animal Shelters freeze new animal admissions
Golfers encounter black bear on Manitoba golf course
You have dreams about this one: Roughriders-Blue Bombers Labour Day rivalry needs no extra hype
Sask. court dismisses appeal in case of drug, alcohol tests for SaskEnergy workers
Kitchener couple call insurance process unfair after tree falls on garage
Here is a list of the Ontario cities that saw the most rain during Wednesdays storm
Its very disturbing: Graphic anti-abortion flyers spark Saskatoon petition
Saskatoon University Bridge reopens after months-long closure
North Bay police believe vehicle was intentionally set on fire
Southern Ont. man fined for Manitoulin deer hunt violation
VIDEO: Car strikes building in east London
Heavy police response in southeast St. Thomas neighbourhood Friday
It feels like magic; Pure Countrys Shannon Ella receives international award nomination
Convicted abuser, pimp sentenced to time served for assaulting woman who claimed she was labour trafficked
Windsor homeowner counts her blessings after tornado tears roof from nearby home
Windsor offering post-storm tree cleanup support after over 400 requests for service
Why isnt Greater Victoria using the Island Rail Corridor for higher capacity transit?
Victoria transit dispute: Overtime ban to end as union and employer enter mediation
Jazz Aviation flight attendants vote in favour of strike mandate
Day care ordered to pay $5,000 after refusing spot for child with severe allergies
U.S. federal judge extends block on Trump executive order seeking to limit mail voting in the midterms
Colorado man who was free on bond in wife's alleged killing is jailed after hit-and-run
Ministers asked to prove progress ahead of cabinet retreat: sources
Carney chooses senior bureaucrat Scott Jones to head cyberspy agency
PM Carney says U.S. officials have changed red lines in trade deal since talks collapsed
U.S. labour relations board sees setback in Starbucks anti-unionization case
August jobs report disappointing but too soon to sound the alarm: economists
Nearly 2,000 fall ill in suspected food poisoning linked to Indonesia's free school meals program
How changing sleep habits could help improve academic performance for students
Lindsay Clancy trial highlights growing efforts to aid jurors after traumatic cases
British star of Man About the House sitcom dies
Director Maggie Gyllenhaal ditched AI for Marilyn Monroe film
Kendall Jenner, John Malkovich and Parker Posey arrive at the 2026 Venice Film Festival
Sabalenka, Pegula get through tough tests at U.S. Open, with Williams sisters playing doubles at night
Former Cowboys running back Emmitt Smith is sued by investor over wind farm project
A stone-touch stirred controversy at the Olympics. Now Canada has banned the move
71-year-old climbs Mount Kilimanjaro less than 9 months after urgent back surgery
He thought hed never see his 1985 Greek vacation romance again. Then he felt a tap on the shoulder
How a Dostoevsky novella took TikTok by storm
Rescuers in Nepal pull 2 people alive from the debris 10 days after devastating floods
Trump again seeks to remove protections for wolves
Effectively irreversible: Changes to Canadas climate permanent, federal report says
Rescue satellite gets close to NASA's doomed telescope, even if it can't save it
Why Mexican cartels are increasingly using car bombs and other explosives
Official White House website debuts video game that lets users capture people at the southern border
+16
View File
@@ -0,0 +1,16 @@
[
{
"case": 187,
"n": 1,
"field": "url",
"url": "https://www.ctvnews.ca/montreal/article/3-men-facing-kidnapping-robbery-and-other-charges-in-crypto-theft-montreal-police/",
"host": "ctvnews.ca",
"fetched_at": "2026-09-05T12:50:08+00:00",
"verdict": "FETCHED",
"method": "raw",
"http": 200,
"chars": 4886,
"sha256": "9305daee0b23db67692783cdfa091b3642a4c06d99ecc18eed82cee51ad49644",
"final_url": null
}
]