Sofia/DB-cleanup
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Activity

feat(sources): Wayback pass, automatic trimming, detention rule, ten cases re-sourced

Browse Source 
Second and third rounds on the dossier pipeline, reviewed locally before commit.

Retrieval
- wayback_pass.py: retries every BLOCKED/DEAD/THIN/ERROR linked source through
  the Wayback Machine; blocks carry the snapshot date, archive URL and the live
  verdict. 143 slots retried: 93 fetched, 37 no snapshot, 12 script shells, 1 PDF.
- fetch_sources.py: fetch_wayback() helper.
- add_extra_sources.py: files staged extra_* finds (web search, not on the DB
  record) into the store with a provenance note.
- Cases re-sourced by web search: 248 (Oslo: Document.no, Avisa Oslo, NRK; the
  linked Le Parisien piece is case 242 and is marked OFF-CASE), 258 Kharkiv,
  260 Singapore, 358 Bangkok, 365 Las Vegas, 388 Verneuil-sur-Seine, 390 Zoersel,
  430 Homestead. 341 of 364 cases now hold a fetched article; 11, 66 and 399
  have no public text source (podcast, police video, direct victim report).

Trimming
- auto_trim.py: case-anchored furniture cut for UNTRIMMED blocks. Finds the body
  run that mentions the case, merges across subheadings and short furniture
  gaps, drops teasers, share bars, date/URL/caption lines and subscription
  pitches; refuses pages with no record term or almost no body. 302 blocks
  trimmed; 16 left on auto-trim-review.md (7 OFF-CASE suspects). Every cut is
  labelled AUTO-TRIMMED, UNREVIEWED in the dossier; the full extract stays in
  staging/. Decisions with anchors in trim-decisions-auto.json.
- build_cases.py / verify_all.py: banners for auto-trimmed and archived blocks,
  staged-file check extended to Wayback blocks, flag legend under the record.

Detention rule
- README "Definitions": the DB field `kidnappings` is the DETENTION violence
  type (victim, guard, staff or relative held to force submission or execute
  the theft), distinct from the Kidnapping scenario (taken away and held).
- detention-flag-review.md / detention-flag-corrections.json: 40 records
  reviewed with evidence; 30 set-to-1 proposals accepted by the owner on
  2026-09-06 (listed in corrections-approved.md), 10 still open.
- apply_detention_wording.py: "Violence Used" in the 70 reviewed summaries now
  names detention explicitly (62 of 70 labelled), supported by the summary's
  own text; idempotent; supersedes the batch scripts' wording.

Worklist and docs
- sofia-worklist.md: 248 decisions, detention rule item replacing the old
  "no abduction" item, fresh-search section for the textless cases.
- README-START-HERE.md: progress notes, run commands, next steps.
- Bug fixed in passing: Wayback blocks stored in-memory text with carriage
  returns; now stored as read back from disk.

verify_all.py PASSES (2321 checks).

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GZZENdTLzNGsbNy4DyF1yt
This commit is contained in:
StellarCrow
2026-09-06 19:36:45 +02:00
co-authored by Claude Fable 5.1
parent 499fd61f79
commit 439e83a4cb
588 changed files with 24800 additions and 13190 deletions
Download Patch File Download Diff File Expand all files Collapse all files
merge-output/sources/411_Igor-Komarov.txt
+108 -5
View File
@@ -26,6 +26,9 @@ DATABASE RECORD
notes Graphic videos showed severe injuries (severed fingers, broken limbs) as captors demanded repayment for allegedly stolen funds.
has_processed_date 0
created_at 2026-03-05 17:15:59
(flag legend: 'kidnappings' is the DETENTION flag — 1 when the victim was held against
their will at any point, tied, locked in, held at gunpoint or taken away; it is NOT the
same as the 'Kidnapping' scenario, which means taken away and held. See README, Definitions.)
AI SUMMARY [generated at bulk import, NOT verified against sources]
**Victim:** Igor Sergeevich Komarov, 28, from Dnipro, Ukraine. Son of Sergey Komarov (alleged Kramatorsk crime figure). Alleged involvement in Ukrainian fraudulent call center operations. Vacationing with girlfriend Yeva Mishalova and friend Yermak Petrovsky.
@@ -45,10 +48,6 @@ LINKED SOURCES
[url_2] https://www.boredpanda.com/horrifying-discovery-in-bali-after-igor-komarov-ransom-video/
[url_3] https://english.pravda.ru/news/hotspots/165992-bali-body-parts-ukrainian-igor-komarov-kidnapping/
OTHER LINKED SOURCES
[DEAD] url_2 None — raw request refused; try the WebFetch path, which is a model transcription and must be labelled as such
https://www.boredpanda.com/horrifying-discovery-in-bali-after-igor-komarov-ransom-video/
------------------------------------------------------------------------------------------------
FETCHED ARTICLE 1
Source ibtimes.co.uk
@@ -105,7 +104,111 @@ A lot of people are wondering why Komarov was the only one taken while everyone
With no verified police reports or official confirmation from authorities, most of what is known about the case is still unconfirmed. For now, the statements made in the ransom video and reported by media outlets should be viewed with caution rather than as established fact.
------------------------------------------------------------------------------------------------
FETCHED ARTICLE 2
FETCHED ARTICLE 2 [AUTO-TRIMMED — UNREVIEWED]
!! Furniture was cut by a script keyed on this case's record, not by a person.
!! It may still carry passages about OTHER cases from a round-up article.
!! The full page extract is kept in staging/ if a cut needs revisiting.
Source boredpanda.com
URL https://www.boredpanda.com/horrifying-discovery-in-bali-after-igor-komarov-ransom-video/
Field url_2
Retrieved 2026-09-05T13:23:25+00:00 via Wayback Machine snapshot 20260421221556, deterministic extraction (HTTP None)
Language unknown
Kept paragraphs headline [0] + 31-71 excl [33] of 137
Length 5,202 chars
Integrity sha256 56d70a36e4777a91cefbf3b55105254e236bae6e07161b8d9c2c5a591282a252
Trimmed AUTO-TRIMMED, unreviewed: kept paragraphs 31-71 plus headline [0]; dropped 30 leading and 65 trailing paragraphs and 1 interior furniture line(s). Case-term hits on page: 43. PAYWALL marker seen on page.
Note live URL was DEAD on the first pass; text comes from an archived copy dated 2026-04-21
Archive http://web.archive.org/web/20260421221556/https://www.boredpanda.com/horrifying-discovery-in-bali-after-igor-komarov-ransom-video/
Caveat retrieved from a Wayback Machine snapshot, not the live page. The
snapshot date is in the method line; the live URL was unreadable.
------------------------------------------------------------------------------------------------
ORIGINAL (unknown, verbatim as retrieved)
Horrifying Discovery In Bali After Young Tourist's Chilling Ransom Video | Bored Panda
Simple Interface - Even Your Cat Can Use It!
Discover trivia, brain teasers, and quirky quizzes — fresh every week!
Young Tourist, 28, Begs Family To Pay $10 Million After Being Abducted During Bali Vacation
Link copied!
Igor Komarov, a 28-year-old tourist, was abducted on February 15 while riding a motorcycle in Bali.
Komarov was traveling with his girlfriend, Yeva Mishalova, a social media influencer.
His location was reportedly revealed to the abductors when Mishalova posted a photo of them on Valentine’s Day with geolocation.
In the days that followed his disappearance, a $10 million “ransom video” surfaced on Telegram, appearing to show Komarov battered and bruised while reading a prepared statement.
Igor Komarov, 28, was abducted in Bali during a vacation with his girlfriend.
A ransom video showed Komarov battered, pleading with his parents to pay $10 million allegedly stolen from abductors.
The main suspect, who rented the car used to abduct the victim, has been arrested, authorities said.
A 28-year-old man was reportedly abducted in Bali, Indonesia
Trigger warning: This article contains details that some readers may find distressing.
In the message, the perpetrators, suspected members of a transnational criminal network, claimed they staged the abduction to recover $10 million that the victim’s family had allegedly stolen from them in a scam.
“Mummy, Daddy, I beg you, help me please, you stole those ten million, which they ask for, return these ten million please,” Komarov said in the video that is part of the investigation by Bali police.
“I will return everything to all those people from whom you have taken; they already chopped off some of my limbs, I have broken legs [and they] punched [my] rib cage. I’m already on meds, I already have no limbs,” Komarov said.
A ransom video later surfaced showing Igor Komarov pleading with his parents to pay $10 million
“An infection will start soon. I’m just d*ing, ” Komarov continued in Ukrainian during the three-minute video. “I ask you very much, this is a very serious organization, please help me, no one can find me, neither mafiosos, no one, I was already taken to another country.”
The 28-year-old begged his family to bring him home and pay the $10 million “which we stole.” He said that, as soon as the payment was made, he would be returned home.
Additionally, Komarov instructed his family “not to communicate with any other people.”
Police identified one of the vehicles used in the abduction, a rental car, and tracked it to a location in Tabanan, Bali.
At the villa, investigators found a mobile phone and a bag belonging to the victim, along with traces of blood that matched stains found inside the vehicle.
On February 17, two days after Komarov was abducted, police announced they had discovered severed human body parts at the mouth of the Wos River on Bali’s lower east coast, approximately 30 km (18 miles) from Tabanan.
The captors claimed they were seeking to recover money they said Komarov’s family had taken from them in a scam
🇺🇦🚨 UKRAINIAN MAFIA BOSS’S SON KIDNAPPED IN BALI FOR 10M PAYBACK
A video circulating on social media claims Igor Komarov, son of a Dnipro gangster from Dnipro, was kidnapped in Bali. The kidnappers in the clip say no cops, no mafia, nobody can help.
They’re demanding 10M they… pic.twitter.com/linfyjun9i
— Mario Nawfal (@MarioNawfal) February 21, 2026
Authorities have not yet formally confirmed the identity of the remains, but forensic analysis suggests they belonged to a man who had lost his life approximately three days before the discovery.
Police in Bali told news.com.au that they had made a partial match between Komarov’s tattoos and the tattoos on some of the body parts.
“We cannot speculate. All possibilities are being investigated, but conclusions must be based on scientific investigation and forensic results,” stated Senior Commissioner Ariasandy.
Police traced a rental car used in the abduction to a villa, where they found the victim’s phone
The coroner in Bali added, “It’s impossible to identify the deceased due to advanced decomposition. However, based on the skull characteristics, I can say that he is Caucasian.”
Police announced they have arrested the prime suspect who rented the vehicle, identified only as “CH,” in West Nusa Tenggara.
Severed human body parts were found near the Wos River and are currently undergoing forensic analysis
Six other suspects, also foreign nationals, are wanted for questioning in connection with the crime.
“Initially, we secured one foreign national with the initials CH, who rented vehicles using a false passport,” authorities said. “Following further investigation, we named six other foreign nationals as suspects — RM, BK, AS, VN, SM, and DH.”
The body belonged to a Caucasian male with tattoos matching Komarov’s
Four of the suspects reportedly fled Bali via the international airport, while the remaining two are thought to remain on the island or another province in Indonesia.
All six have been placed on Indonesia’s wanted persons list and Interpol’s Red Notice.
------------------------------------------------------------------------------------------------
FETCHED ARTICLE 3
Source english.pravda.ru
URL https://english.pravda.ru/news/hotspots/165992-bali-body-parts-ukrainian-igor-komarov-kidnapping/
Field url_3