@nytimes
Visual Investigations, using computational methods (Computer Vision, GeoSpatial Analytics, etc.) Muzafir from Mumbai. I tweet about 🏏 + 🦉a lot
When a 2,000-pound bomb detonates, it creates a blastwave that can harm people up to 3,000 feet away. Our Visual Investigation suggests Israel routinely dropped this bomb in the area south of Wadi Gaza - the place it had repeatedly told civilians in Gaza to move to for safety.
Sometimes 2,000-pound bombs leave craters in the ground where they strike that are approximately 40ft in diameter. Leveraging this fact, we trained an object detection AI algorithm to find craters visible in satellite imagery of south Gaza
Using the platform
@picterra
, we trained the algorithm with many examples of the types of craters we were looking for. So that the training data most closely resembled the final imagery we would run the algorithm on, we used examples of craters from Gaza itself as training data.
Once trained, we ran the object detection algorithm on
@planet
satellite images of southern Gaza from November 16th and 17th. We ran 3 iterations of the algorithm, which produced 1,643 detections in all.
Though for our final analysis we were interested in craters roughly ~40ft in diameter or larger, we used these as well as smaller craters in the training data to make the detector more robust. Later, we removed small craters the detector found from our final findings.
We needed to verify these detections. In
@qgis
we drew ~100m boxes around each detection, stitching together detections that were within 100m of each other, so that we were left with 1,185 boxes.
Further, our final crater count (208), likely only captures a portion of 2,000lb bombs dropped on south Gaza during our analysis period. Here are some additional reasons the analysis might have missed bombs 👇
Then, we set up a workflow where for each geotagged box, we had the corresponding Planet satellite image from Nov 16th/17th on the right, and an image from early in the conflict on the left.
In response to our questions about the use of 2,000lb bombs in southern Gaza, an Israeli military spokesman said as part of a statement, that "Questions of this kind will be looked into at a later stage".
Our superb translators were Omar Duwaji, Lara Zoabi and Abeer Pamuk.
Finally, a huge thank you to
@marcgarlasco
for on-demand expert analysis at all hours of day or night,
@picterra
for being generous with resources and to
@Brian_Castner
for his insights.
Or 3 - craters that were already visible in the image from the early part of the conflict, meaning they were possibly created by bombs dropped in a prior conflict.
2 - Depending on soil conditions and other factors, 2,000lb bombs don’t always leave craters where they strike. This could possibly be the case in densely built up areas, where there are a lot of concrete structures on top of the ground.
3 - The algorithm, when measured against a small test dataset, correctly identified 91.8% of the craters in the dataset (not 100%), suggesting the algorithm itself might have missed some craters in the imagery we used.
4 - We’ve seen that craters are sometimes visible in satellite images taken at a particular angle, but not in images taken at a different angle. So the angle the 2 images we ran the algorithm on from Nov 16th and 17th might have contributed to the AI missing some craters.
A very close friend back in Mumbai, Vinay Parikh is in a critical condition with a terminal case of Leukemia. His only chance of a cure is through a stem cell donation, but there's currently no match in the registry. Please consider signing up, especially if you're South Asian!
Friends, we are thrilled to introduce you to our 2022-2023
@nytimes
Fellowship class. They will spend a year doing journalism in more than 20 departments at The Times. Join us in congratulating and welcoming them:
Someone very close to me is suffering from Leukemia.
Turns out something that would improve his condition is a bone marrow transplant from a perfect HLA (a type of blood classification) match.
1/3
After nearly 2 years, first as a fellow and then on contract, learning the ropes and getting to know the world’s best coworkers on the Visual Investigations team, I’m glad to say I’m joining the team full time!
@ninaberman
,
@SusanEMcG
,
@SveborK
,
@ghoshbhaskar10
, other amazing researchers at Columbia's DVMM lab, and I built an app called VizPol that helps reporters on the ground identify political symbols at demonstrations in real-time
HERE'S HOW NEWS AGENCIES AND NEWS CHANNELS SHARE AND AMPLIFY MISLEADING CLAIM. ANI ('South Asia's Leading Multimedia News Agency') was one of the first to tweet.
@ANI
claims that a Pakistani flag was hoisted on a house in Purnea, Bihar, They've not even used the world 'alleged'.
Humbled that our AI-driven investigation into Israel's use of 2k lb bombs in areas designated safe for Gaza's civilians shared in a
@PulitzerPrizes
. Much of our work would be impossible without people in Gaza who risk their lives every day to document destruction and suffering.
When a 2,000-pound bomb detonates, it creates a blastwave that can harm people up to 3,000 feet away. Our Visual Investigation suggests Israel routinely dropped this bomb in the area south of Wadi Gaza - the place it had repeatedly told civilians in Gaza to move to for safety.
NEW: We worked with the artificial intelligence company Synthetaic to detect and analyze the Chinese balloon in satellite imagery. This allowed us to track the movement of the balloon itself, not just its expected path based on weather projections
@SiddhantAdlakha
Totally agree with your takes and beautiful phrasing of them on Ken and Shiv. On Rome idk - I felt he sort of had a moment of clarity/emancipation, even relief at the end where he begins to glimpse a chance at a life not as failed scion
#2
?
@blprnt
I was always into birds but this pic began my 2020 avian photography journey... from early covid days, locked down in Mumbai, the Coppersmith Barbet of Carmichael Road that started it all:
New York Times journalists documented the atrocities of the war in Ukraine, used video evidence to prove Russia’s most gruesome war crimes and pierced Vladimir Putin’s secret plans. Here are the stories that just won a Pulitzer for international reporting.
Central Park Barred Owl alert!
North eastish part of the loch... Walk along the path and you can see it from a leafy offshoot to the right
#birdcp
@BirdCentralPark
Because
@ntabrizy
,
@CoraEngelbrecht
and
@sameenamin
were kind enough to bring me on to help report this raw story about the devastating attack against Baluchi protestors and peaceful prayer goers in Zahedan, Iran, I have my first ever NYT byline!
This attempt to characterize the blustering, contradictory person behind the leaks was a crash-course for us on how to join, archive, organize, and glean info from Discord servers— their content as well as their members. A valuable new OSINT skill 👇
BUT global HLA registries have a dearth of South Asian registrants, and typically a match is most likely from your own ethnic group.
So South Asians, wherever you are, pls consider registering! Sign up online and you're mailed a kit to cheek swab yourself, it's that simple!
2/3
A joy to work with
@YoniNachmany
on CHIPS (), a platform to quickly search for satellite image snapshots of a list of locations at
@bellingcat
's Digital Investigations Tool hackathon this weekend, and to win the greatest positive impact potential award!
When a 2,000-pound bomb detonates, it creates a blastwave that can harm people up to 3,000 feet away. Our Visual Investigation suggests Israel routinely dropped this bomb in the area south of Wadi Gaza - the place it had repeatedly told civilians in Gaza to move to for safety.
"Israeli officials said that Israel wanted to demolish Palestinian buildings close to the border [to] create a security “buffer zone” inside Gaza" to reduce the likelihood of attacks like Oct 7... "But most of the demolition locations identified by The Times occurred well outside
South Asians of NYC, we need your help 👇
If you are ever called up as a match the donation process is non-surgical, painless, safe, and you can always opt out.
After taking a sublime course on
#OSINT
with
@bellingcat
researchers I decided to try and put some of it into practice.
I don't want to comment on
#theletter
but I do want to note that speech has changed a lot over time. So, I decided to find out the age of each signatory:
Here are links to registries in India: (possibly a bit buggy on mobile)
the UK:
and the US:
If you do register let me know so we can check if you're a match ❤️
3/3
The 234th Air Assault regiment of Russia's military committed grievous atrocities, amounting to potential war crimes along one street in Bucha, near Kyiv in Ukraine.
My colleagues and I uncovered this using phone logs, military files and 23TB of video
OSINT 🧵: A method
@AricToler
,
@riley_mellen
, I and others used to find sources in our recent coverage of Jack Teixeira (JT). This piece didn't quote members of Thug Shaker Central (TCS), because it focused on JTs posts on another Discord server, but...
I wanted to make a data viz that captured what's felt like the most interminable last two and a half days since Wednesday morning.
I plotted each election update tweet from
@DecisionDeskHQ
between Wednesday at 8am and today at 8pm.
#Elections2020
Working for
@nytimes
is an honor and privilege. I know my colleagues feel the same way, and so walking out is not something we would do lightly.
But we know what we're worth, which is why I'm proud to stand with more than 1,100 of my
@NYTimesGuild
colleagues in our action today.
Parallax allows us to calculate the balloon's height too. Drawing lines connecting the satellite, the balloon and the ground and overlaying those lines creates “similar triangles” between the lines, which allows us to create an equation for the value of the balloon's height.
Our latest: a breakdown of how counter protestors attacked the pro-Palestine encampment at UCLA, setting off violence that remained unchecked for hours. Paywall free link:
@ninaberman
and I wrote about political symbols at the Capitol Hill insurrection that stood out to us for
@VICENews
. We've been studying symbols as part of our work on
@VizpolR
. A huge thank you to
@timmarchman
for getting this together with us!
Tremendous thanks to
@kashhill
for picking up on a few sentences in a paper I wrote in college, encouraging me to do a whole story about these sentences and helping me write it:
I talked to
@decka227
about our use of object detection in our story about Israel's use of 2k lb bombs in areas marked safe for Gaza's civlians. He also delineates
@invinst
/
@city_bureau
's fascinating leveraging of community knowledge to train an AI tool:
From
@TowCenter
's newsletter, my piece on the Pine Tree flag
Thank you
@SaraSheridan14
for helping get this whole thing together, to
@TXRhetorician
for speaking to me despite everything she's dealing with in TX and to
@ninaberman
for her amazing pics!
🚨🔔 We’re hiring! Come and join our team as a visual stories reporter.
If you have a track record of producing first-class visual journalism and love what happens when you combine great reporting, code and design, this role could be for you 👇
We reviewed radio traffic from Lansing, MI on the night of Feb. 13, where for over 3 hours law enforcement attempted to find an active shooter on the 8 sq. mile Michigan State University campus and the cities of East Lansing and Lansing beyond
.
@muyixiao
,
@stuartathompson
,
@paulmozur
and I investigated spam and bots on Twitter that drowned out information about the late November wave of historic anti-lockdown protests in China
Anti-government protests in Iran that erupted in September have led to a brutal crackdown by security forces. Our piece shows how security forces are using ambulances to infiltrate protests and detain protesters.
Below, an ambulance goes into a police station, an unusual sight:
One video from Rasht, which seems to have been filmed from inside a car, shows an ambulance on fire, apparently after being targeted by protesters. Someone in the car shouts, “They’re rescuing the girls! Come out!” as the car nears the ambulance.
Location:
Rasht, Gilan Province
Coordinates:
37.27732,
49.57534
Protestors torched an ambulance, which was being used by regime police officers, instead of medical personnel!
#Iran
#IranProvince
Here is the same frame from Aug '21 & '22, shown with median NDWI highlighted. NDWI correlates to plant water stress and ranges from -1 to 1, higher values meaning lower plant water stress. Here -1 is mapped to red, 0 to white and 1 to green. More green is less plant water stress
Planet Labs released some satellite imagery highlighting the severe drought occuring in Europe. These two PlanetScope images, captured on 14 Aug 2021 and 13 Aug 2022, show the drastically low water level of the Rhine River near Dusseldorf, Germany.
The Times analyzed and geolocated videos and photos showing ambulances entering or exiting police stations, or positioned just outside them, in at least six locations across the country.
(in one case the location was first mentioned here: )
تصویر که طی روزهای اخیر منتشر شده و ورود آمبولانس به یک کلانتری را نشان میدهد.
به نظر کلانتری ۱۵ شهرک (ولیعصر) در حومه شهر خوی میباشد.
احتمالا افرادی که طی اعتراضات در شهر خوی دستگیر میشوند به این مکان انتقال می یابند
.
38.4812482, 44.9488013
.
#مهسا_امینی
#MahsaAmini
This piece was really fun to work on and I'm very excited for it to herald in an entire brand of reporting that uses AI and other computational methods to report on findings from not just one or two, but thousands or millions of satellite images 🛰️
NEW: We worked with the artificial intelligence company Synthetaic to detect and analyze the Chinese balloon in satellite imagery. This allowed us to track the movement of the balloon itself, not just its expected path based on weather projections
Here's where I helped. I aided
@YousurAlhlou
,
@MashaFroliak
,
@dim109
and
@heytherehaley
in searching for and archiving social media and video content as they weaved this evidence into the narrative. I compiled vast volumes of data and helped them narrow in on useful tidbits.
Many (though not all) of the symbols it can identify are used by extremist groups. We hope this tool will help reporters more accurately determine which political groups are present at a demonstration and thereby curtail misinformation about people involved in demonstrations
Even one evening with your extraordinary students was such a blast! Can’t imagine how special a whole semester must have been. Shows what an open and supportive environment
@AzmatZahra
and you created. Seconded that there should be a line out the door to work with them! They had
From our last class of the semester
@columbiajourn
. Spending time with these students over the past few months — and especially watching their coverage in recent weeks — has been one of the greatest privileges. There should be a line out the door to work with them.
Growing up in Mumbai every winter you notice a burst of local news excitement about "the flamingos from Kutch". Spending time in a Navi Mumbai salt marsh with several hundred of these modern dinosaurs, the pinkish adults lost among the sea of brown juveniles, showed me just why.
15 stories in
#CommonGround
so far
I'm biased, of course, but check out for yourself what an interesting collection of stories we have, on subjects that you're unlikely to find elsewhere
All stories here:
I started the pandemic locked down in Mumbai, finally made it back to New York in September then drove across the US in November to LA where I'm going to live for a few months. I made sure to avoid humans the whole journey, but thankfully the avian world was never far away...
We share this award with colleagues who worked on other difficult stories in this crushing conflict.
As this work is recognized the journalists and bystanders in Gaza credited in our video must be acknowledged.
Finally we thank
@marcgarlasco
,
@Brian_Castner
,
@planet
,
@picterra
@CoreyJaskolski
first used RAIC to find the balloon over South Carolina, and then used a variety of techniques to narrow his search space to find it in the other locations, one of which was NOAA HYSPLIT air parcel back trajectory modeling ()
First birding expedition in my new home of LA! To the Ballona Wetlands Ecological Reserve's freshwater marsh. Highlights:
1. Allen's or Rufous Hummingbird
2. Red-winged Blackbird
3. Mr and Mrs Northern Shoveler
4. Black-crowned Night-Heron (have been trying to see one foreeever)
My take on
@SamGregory
from
@witnessorg
's talk on deepfakes at
#NYCML18
: The problem with fake synthetic media is not that its impossible to detect it as fake, its that its impossible to detect it at a faster rate than the daily news cycle can spread it
Even if you're unable to assist Vinay directly, your registration could potentially save someone else's life.
Sign up links:
For India - (ages 18-50)
For the US - (ages 18-35)
For the UK - (ages 17-55)
Then, using a website that archives Steam, we got lists of each of their current and friends and plotted a network graph, where nodes are Steam accounts and there are edges between our starter set of accounts (red nodes) and each of their friends. Names removed for privacy.
I’ll be continuing to navigate ways of leveraging computational tools in our investigations, like object detection to find craters created by 2,000lb bombs in southern Gaza, or network analysis to find members of a Discord group where classified documents were posted, and so on.
A source in Zahedan told
@ntabrizy
that they felt represented by our coverage, that it gives the world a glimpse of what happened to them.
Proud to see our story on A1 today.
Because
@ntabrizy
,
@CoraEngelbrecht
and
@sameenamin
were kind enough to bring me on to help report this raw story about the devastating attack against Baluchi protestors and peaceful prayer goers in Zahedan, Iran, I have my first ever NYT byline!
RAIC uses an unsupervised model, which satellite imagery expert Dr.
@HamedAlemo
says is a novel approach to object detection in satellite imagery. He adds that training data for tiny and rare objects is hard to create from large and noisy satellite imagery.
This is Pattewala. He was raised in a cordoned off zone within Kanha National Park after he got separated from his mother as a cub then gradually released back into the wild at first with a tracking collar (hence his name).
Here he is at 5, a full tiger with no more need for one
Shots from areas around Pune in west central Maharashtra that sit in the liminal zone between farmland and forest. Untouched enough for wildlife to exist but not as formal an experience as a national park. See the endangered Indian wolf amid relatedly endangered Indian grasslands