feat(sources): Wayback pass, automatic trimming, detention rule, ten cases re-sourced

Second and third rounds on the dossier pipeline, reviewed locally before commit.

Retrieval
- wayback_pass.py: retries every BLOCKED/DEAD/THIN/ERROR linked source through
  the Wayback Machine; blocks carry the snapshot date, archive URL and the live
  verdict. 143 slots retried: 93 fetched, 37 no snapshot, 12 script shells, 1 PDF.
- fetch_sources.py: fetch_wayback() helper.
- add_extra_sources.py: files staged extra_* finds (web search, not on the DB
  record) into the store with a provenance note.
- Cases re-sourced by web search: 248 (Oslo: Document.no, Avisa Oslo, NRK; the
  linked Le Parisien piece is case 242 and is marked OFF-CASE), 258 Kharkiv,
  260 Singapore, 358 Bangkok, 365 Las Vegas, 388 Verneuil-sur-Seine, 390 Zoersel,
  430 Homestead. 341 of 364 cases now hold a fetched article; 11, 66 and 399
  have no public text source (podcast, police video, direct victim report).

Trimming
- auto_trim.py: case-anchored furniture cut for UNTRIMMED blocks. Finds the body
  run that mentions the case, merges across subheadings and short furniture
  gaps, drops teasers, share bars, date/URL/caption lines and subscription
  pitches; refuses pages with no record term or almost no body. 302 blocks
  trimmed; 16 left on auto-trim-review.md (7 OFF-CASE suspects). Every cut is
  labelled AUTO-TRIMMED, UNREVIEWED in the dossier; the full extract stays in
  staging/. Decisions with anchors in trim-decisions-auto.json.
- build_cases.py / verify_all.py: banners for auto-trimmed and archived blocks,
  staged-file check extended to Wayback blocks, flag legend under the record.

Detention rule
- README "Definitions": the DB field `kidnappings` is the DETENTION violence
  type (victim, guard, staff or relative held to force submission or execute
  the theft), distinct from the Kidnapping scenario (taken away and held).
- detention-flag-review.md / detention-flag-corrections.json: 40 records
  reviewed with evidence; 30 set-to-1 proposals accepted by the owner on
  2026-09-06 (listed in corrections-approved.md), 10 still open.
- apply_detention_wording.py: "Violence Used" in the 70 reviewed summaries now
  names detention explicitly (62 of 70 labelled), supported by the summary's
  own text; idempotent; supersedes the batch scripts' wording.

Worklist and docs
- sofia-worklist.md: 248 decisions, detention rule item replacing the old
  "no abduction" item, fresh-search section for the textless cases.
- README-START-HERE.md: progress notes, run commands, next steps.
- Bug fixed in passing: Wayback blocks stored in-memory text with carriage
  returns; now stored as read back from disk.

verify_all.py PASSES (2321 checks).

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GZZENdTLzNGsbNy4DyF1yt
This commit is contained in:
StellarCrow
2026-09-06 19:36:45 +02:00
co-authored by Claude Fable 5.1
parent 499fd61f79
commit 439e83a4cb
588 changed files with 24800 additions and 13190 deletions
@@ -26,6 +26,9 @@ DATABASE RECORD
notes Suspects observed and spotted each time due to security measures in place after January 28 incident.
has_processed_date 0
created_at 2026-05-25 17:12:06
(flag legend: 'kidnappings' is the DETENTION flag — 1 when the victim was held against
their will at any point, tied, locked in, held at gunpoint or taken away; it is NOT the
same as the 'Kidnapping' scenario, which means taken away and held. See README, Definitions.)
AI SUMMARY [generated at bulk import, NOT verified against sources]
**Victims:** Male crypto entrepreneur, his partner, four children (three young), and a private music teacher present at the time. Southwest borough, Montréal.
@@ -45,14 +48,219 @@ LINKED SOURCES
[url_2] https://www.ctvnews.ca/montreal/on-patrol/article/two-men-arrested-on-canada-wide-arrest-warrants-after-montreal-home-invasion/
[url_3] https://www.noovo.info/nouvelles/patrouille/article/invasion-a-domicile-le-spvm-met-le-grapin-sur-un-mineur-et-un-complice-majeur-en-ontario/
OTHER LINKED SOURCES
[BLOCKED] url None — raw request refused; try the WebFetch path, which is a model transcription and must be labelled as such
https://www.journaldemontreal.com/2026/05/07/violations-de-domicile-une-famille-montrealaise-prise-pour-cible-pour-de-la-cryptomonnaie
[THIN] url_2 ctvnews.ca — JS-rendered index page; only unrelated teaser headlines extracted (no article body). This case is sourced by its noovo-info article, so this can be dropped.
https://www.ctvnews.ca/montreal/on-patrol/article/two-men-arrested-on-canada-wide-arrest-warrants-after-montreal-home-invasion/
------------------------------------------------------------------------------------------------
FETCHED ARTICLE 1 [AUTO-TRIMMED — UNREVIEWED]
!! Furniture was cut by a script keyed on this case's record, not by a person.
!! It may still carry passages about OTHER cases from a round-up article.
!! The full page extract is kept in staging/ if a cut needs revisiting.
Source journaldemontreal.com
URL https://www.journaldemontreal.com/2026/05/07/violations-de-domicile-une-famille-montrealaise-prise-pour-cible-pour-de-la-cryptomonnaie
Field url
Retrieved 2026-09-05T13:21:59+00:00 via Wayback Machine snapshot 20260509063918, deterministic extraction (HTTP None)
Language unknown
Kept paragraphs headline [0] + 3-24 of 26
Length 3,854 chars
Integrity sha256 096e1774d23579568290c907062d38b6512b22aea936c0ef9978092ee2594ffb
Trimmed AUTO-TRIMMED, unreviewed: kept paragraphs 3-24 plus headline [0]; dropped 2 leading and 1 trailing paragraphs. Case-term hits on page: 17.
Note live URL was BLOCKED on the first pass; text comes from an archived copy dated 2026-05-09
Archive http://web.archive.org/web/20260509063918/https://www.journaldemontreal.com/2026/05/07/violations-de-domicile-une-famille-montrealaise-prise-pour-cible-pour-de-la-cryptomonnaie
Caveat retrieved from a Wayback Machine snapshot, not the live page. The
snapshot date is in the method line; the live URL was unreadable.
------------------------------------------------------------------------------------------------
ORIGINAL (unknown, verbatim as retrieved)
Violations de domicile: une famille montréalaise prise pour cible pour de la cryptomonnaie | JDM
Cette résidence de larrondissement Sud-Ouest a été prise pour cible quatre fois en quelques semaines par des suspects voulant y perpétrer des violations de domicile.
PHOTO OLIVIER FAUCHER
La famille dun Montréalais œuvrant en cryptomonnaie a été ciblée par quatre tentatives de violations de domicile en quelques semaines cet hiver, dont une où un coup de feu a été tiré et qui a récemment mené à deux arrestations.
« Cest un crime crapuleux et violent », sindigne Pierre-Marc Houle, commandant de la Section des enquêtes par projet Sud du Service de police de la Ville de Montréal (SPVM).
Le corps de police a annoncé jeudi larrestation dans la région de Toronto dun mineur de 17 ans et de Christopher Ethan Prince, 20 ans, en lien avec une violation de domicile survenue le 28 janvier dernier, dans larrondissement du Sud-Ouest.
Ce jour-là, un entrepreneur du domaine de la cryptomonnaie se trouvait dans sa maison avec sa conjointe et ses quatre enfants, dont trois sont en bas âge. Un professeur de musique privé se trouvait aussi dans la résidence.
• Regardez aussi ce podcast vidéo tiré de l'émission de Benoit Dutrizac, diffusée sur les plateformes QUB et simultanément sur le 99.5 FM Montréal :
Vers 19 h 30, un individu prétendant être un livreur de colis sest présenté à la résidence familiale. Lorsquun occupant a ouvert la porte, lui et trois complices seraient entrés.
« Quand la victime [lentrepreneur en cryptomonnaie] est descendue du deuxième étage, cest là quelle a été confrontée avec les suspects. Lun dentre eux aurait fait feu et cest un autre suspect qui aurait été atteint à labdomen », a indiqué M. Houle.
Le commandant Pierre-Marc Houle, chef de section des enquêtes par projets Sud du SPVM
Photo Agence QMI, JOEL LEMAY
Le père de famille na heureusement subi quune légère blessure du bras, qui na pas été causée par le coup de feu.
Les bandits ont ensuite pris la fuite en laissant plusieurs « éléments de preuves » sur les lieux, selon le SPVM.
Les suspects, originaires de la région de Toronto, ne se connaissaient pas tous. Ils auraient accepté un contrat via les réseaux sociaux qui ciblait cet homme en lien avec la cryptomonnaie, a précisé le commandant Houle.
La famille n’était toutefois pas au bout de ses peines. Début mars, des suspects ont fait trois nouvelles tentatives de violation de domicile en autant de jours à la même résidence.
« Ça na pas fonctionné, mais cest très inquiétant. Il y a eu des moyens de protection déployés [sur la maison] et les suspects ont été aperçus. Ils ne sont pas rentrés dans la maison », fait savoir le commandant Houle.
Le 11 mars, la famille a décidé de quitter les lieux pour des raisons de sécurité.
« On se met à la place des victimes qui sont carrément traumatisées. Ce sont ces gens sans histoire », déplore M. Houle.
Au cours des dernières années, plusieurs crimes similaires en lien avec la cryptomonnaie sont survenus dans le grand Montréal. Dans la plupart des cas, lobjectif est de dérober des fonds sur place en obtenant un transfert pouvant atteindre des centaines de milliers de dollars.
Lenquête sur l’événement du 28 janvier se poursuit afin de retrouver deux autres suspects, dont un âgé de 16 ans. Dautres individus pourraient aussi être traqués par le SPVM en lien avec les tentatives de début mars, précise le commandant Houle.
Un survol intelligent pour rester à jour, même le midi
Voir toutes nos infolettres
Voir la politique de confidentialité
Vous devez être connecté pour commenter. Se connecter
Bienvenue dans la section commentaires! Notre objectif est de créer un espace pour un discours réfléchi et productif. En publiant un commentaire, vous acceptez de vous conformer aux Conditions d'utilisation.
------------------------------------------------------------------------------------------------
FETCHED ARTICLE 1
FETCHED ARTICLE 2 [RAW EXTRACT — NOT YET TRIMMED]
!! This is the whole page as extracted. It still contains site furniture,
!! and may contain teaser headlines for UNRELATED cases. Trim on read-through.
!! Do not quote from it without checking the passage belongs to this case.
Source ctvnews.ca
URL https://www.ctvnews.ca/montreal/on-patrol/article/two-men-arrested-on-canada-wide-arrest-warrants-after-montreal-home-invasion/
Field url_2
Retrieved 2026-09-05T13:22:03+00:00 via Wayback Machine snapshot 20260508125554, deterministic extraction (HTTP None)
Language unknown
Kept paragraphs ALL 58 paragraphs, untrimmed
Length 4,561 chars
Integrity sha256 f9041f3bc48cf4f1deaf2a0640c5553aa91503b7f0b22f8ed2aaf3aaf78d380d
Trimmed NOT TRIMMED. Full page extract; trim on read-through.
Note live URL was THIN on the first pass; text comes from an archived copy dated 2026-05-08
Archive http://web.archive.org/web/20260508125554/https://www.ctvnews.ca/montreal/on-patrol/article/two-men-arrested-on-canada-wide-arrest-warrants-after-montreal-home-invasion/
Caveat retrieved from a Wayback Machine snapshot, not the live page. The
snapshot date is in the method line; the live URL was unreadable.
------------------------------------------------------------------------------------------------
ORIGINAL (unknown, verbatim as retrieved)
Two arrested in Ontario after Montreal home invasion
Skip to main content
Two men arrested on Canada-wide arrest warrants after Montreal home invasion
No one showed any compassion: A woman ordered flowers for her mothers funeral in Toronto. They sent them to a B.C. church instead.
Mississauga launches investigation after Waterloo councillor waited hours for an accessible taxi ride
Hikers wearing shorts and running shoes rescued from North Shore alpine trail
Tumbler Ridge Secondary School to be torn down in wake of mass shooting
Calgary dad attacked without provocation while walking his teen to the bus stop
Ottawa couple credits dog for alerting them to overnight fire
'Never felt it like this': Famous Montreal barber sees new level of Canadiens fever
Canadiens look to even second-round series with Sabres before shifting to Montreal
Looking over their shoulders: Advocates call for anti-Islamophobia supports as man charged in St. Albert assault
Sentence hiked for man who cut off woman's finger and forced her to eat it
Every parents worst nightmare: Mothers push for runaway child bill after teens repeatedly leave home
No deal reached in CUPE strike, N.S. long-term care workers remain on picket lines
Manitoba Premier Wab Kinew wants word ban lifted in legislature
Regina German Club fundraising for major repairs following roof leak
Regina city council has approved REALs sale to Brandt: now what?
How did a toddler disappear from a Brantford street in 1963?
Hundreds evacuated due to flooding in northern Sask. First Nation communities
Saskatoon pilot project to remove most Sutherland parking pay stations
Former CEO charged with fraud in connection with northern Ont. gold mine
Toronto-linked drug suspects charged in northwestern Ont.
Municipal laws dont matter when people are being killed: London resident calls for safety improvement at Highbury and Dingman
Green Lane Landfill nears capacity, St. Thomas seeks answers from Toronto on waste future
Temperatures to drop to freezing mark in some parts of region
Where construction crews are at with Dunlop Street underpass
Over 500 TRQSS workers may have reached a deal with their employer
Windsor Regional says no local hantavirus planning underway, risk to public remains low
Independents branded 'NDP farm team' for helping shut down FOI debate
Canadian unable to visit dying brother due to U.K. passport issue
B.C. anti-gang unit says 11 arrested in illegal gambling investigation
Spain readies for evacuations as a hantavirus-hit cruise ship heads for the Canary Islands
Starmer says he wont quit after local elections deliver losses for Labour, wins for Reform UK
Dutch Princess Margriet visiting birthplace, attending tulip festival while in Ottawa
Snowbirds could be grounded for years, Conservatives warn
PM Carney planning new legislation to expedite more project approvals
Japanese video-game maker Nintendo raises Switch price, forecasts lower profits
Telus reports first-quarter profit and revenue down from year ago
How a mother of Elon Musks children became a key witness in his lawsuit against OpenAI
Being married may come with an unexpected health benefit, study suggests
Government says 3 Canadians isolating at home after hantavirus ship outbreak
Worried about hantavirus? Take precautions when opening cottages, sheds, PHAC expert advises
David Attenborough, the excited but hushed voice of nature programs, turns 100
No, AI actors are not eligible for the Golden Globes, organizers say
Blake Lively's lawyers fuel feud with claim of victory after 'It Ends With Us' settlement
Canada captain Davies sustains hamstring injury weeks before World Cup
Real Madrid's Valverde suffers head injury in alleged altercation with teammate Tchouaméni
U.S. President Trump on high World Cup ticket prices: I wouldnt pay it either
Was Bigfoot just spotted in Ohio? Reported sightings stoke a long-running hunt for answers
Elaborately decorated skeletons in Catholic churches across Bavaria take some visitors by surprise
Why modern witches are making pilgrimages to an ancient Turkish temple
At least 3 hikers killed by volcano eruption on Indonesian island
Parade of ghostly icebergs brings joy and wonder to Newfoundland and Labrador
8-year-old boy attacked by beaver at park, hospitalized
Tech is turning increasingly to religion in a quest to create ethical AI
A new experiment deepens the mystery over gravitational constant, Big G
As AI fuels a surge in travel scams, here's how you can protect yourself
------------------------------------------------------------------------------------------------
FETCHED ARTICLE 3
Source noovo.info
URL https://www.noovo.info/nouvelles/patrouille/article/invasion-a-domicile-le-spvm-met-le-grapin-sur-un-mineur-et-un-complice-majeur-en-ontario/
Field url_3