Bigger isn’t better, but major AI policies (like the Biden EO) focus only on model size & compute. However, models are useless without data! In our latest work, we highlight the need for data-centric AI policy and reveal the shortcomings of the status quo.
If you haven't already heard of xView3, come participate in our computer vision challenge to detect dark fishing vessels on synthetic aperture radar imagery! With >66M km^2 of imagery and >220k annotations, help us protect our oceans and biosphere!
Satellite images are captured from a variety of constellations, each with different resolutions. ML models must be fine-tuned to each satellite to work well. We present Scale-MAE, a pre-training method to make models robust to resolution. Accepted at ICCV!
If you're seeking to understand how Transformers work and where to make them better, there is no better paper to read than "Full Stack Optimization of Transformer Inference: a Survey" by Kim and Hooper with
@KurtKeutzer
and
@amir__gholami
@ra6bit
@fioroco
@matthew_d_green
This handout really helped me when I was learning how to read math: . The TL;DR is "just keep reading", but it does give a method as to how to read the math, and how people just make stuff up anyways so there's no consistency.
I read
@leopoldasch
's essay on the future of AI research and geopolitical competition. It's well-researched, well-presented, and passionate. However, Leopold advocates for an unreasonably strict and exclusionary future for AI development—a view that's gaining traction. (1/9)
I'm a PhD student in the Electrical Engineering and Computer Science school (BAIR lab) at UC Berkeley. Including the summer stipend, we get paid approximately $47,700/year. They also cover health insurance and any fees. Additionally, first years in BAIR get a $5k grant.
To increase transparency around grad school stipends, retweet this tweet with your department, university, and annual stipend. I'll go first: I'm a PhD student in the Computing and Mathematical Sciences (CMS) department at Caltech, and I'm paid $36k/year.
#StipendTransparency
I'd like to take a bit to address the racism I faced growing up in my community. I do want to make it clear, though, that the positive experiences I had at TJ far, far outweighed the negatives.
My brother and I moved to TJ when we were in 5th grade. 1/?
One of my colleagues is an F-35 instructor pilot. I'm teaching him machine learning and he's teaching me how to fly. We're both getting to learn something new. Man I love my job
@sei_etc
@DIU_x
From your cell phone to your TV, images and videos are now captured in 4K resolution or better. Vision methods, however, opt to downsize or crop them, losing information. We introduce xT, our framework to model large images end-to-end on contemporary GPUs!
Flight attendant: Is there a doctor onboard?
Dad: *nudging me* that should've been you
Me: Not now Dad
Dad: Not asking for a research scientist to help, are they?
Me: Dad, there's a medical emergency happening right now
Dad: Go and see if “double-blind peer review" helps
Being a grad student doesn’t have many perks, but one of the benefits of working on AI for humanitarian assistance is getting to do field work in cool places. Spending the week at Berkeley’s research station in French Polynesia, Gump Station!
Exciting news to share: I'll be joining
@Apple
in January as an Engineering Program Manager supporting the development of ML/AI algorithms on the AR/VR team! Looking forward to working on delivering impactful, game-changing software to the world 🍎🚀
Wow I am EXTREMELY impressed with
@MetaAI
's new Segment Anything model. Sonar is a modality largely ignored in computer vision. With just one + and - anchor, SA was able to accurately detect the fish in sonar from the Caltech Fish Counting Dataset!
@sarameghanbeery
I've been asked to join the Department of Justice this summer as an advisor for AI policy. The DOJ faces difficult questions as the AI landscape evolves for them internally and externally. I'm excited to be able to contribute to the nation's mission in a different way than usual!
Our paper, ClimSim, was just awarded Best Paper for the D&B track at NeurIPS! Congrats to the large team that worked on this. Please come see
@SungdukYu
's oral on Wednesday at 3:30 PM CT for the deep dive.
@NVIDIAAI
@SciPritchard
**Outstanding Datasets and Benchmarks Papers**
ClimSim: A large multi-scale dataset for hybrid physics-ML climate emulation
DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Models
Now open: the call for papers for the 5th Workshop on Artificial Intelligence for Humanitarian Assistance and Disaster Response at ICCV 23 in Paris. The submission deadline is June 16, 2023. More information on the website:
@esa
@ICRC
@WFP
@UCBerkeley
If you're a student who wants to do climate-related ML research but don't have the gear to start, I'd be happy to send 4 people a free 1080Ti (if you can cover shipping, no req.)! Just share your ML x Climate progress with the world and make a difference
@ai_climate
#AIforGood
You can’t just train a transformer on a bunch of data and call it a “foundation model”… why is the entire geospatial community calling random models “foundational” when they are trained on a small portion of the viable data distribution??
I'm elated to share that I'll be joining
@UCBerkeley
this upcoming semester as part of their AI/CV PhD program, working with
@trevordarrell
on efficient ML and policy for disasters.
This has been a dream of mine for years, and it's incredible that I'm finally able to pursue it 🚀
We created a place for students, alumni, faculty + staff at Thomas Jefferson High School to share their experiences with racism anonymously. Soon, we'll hold a listening session where we narrate the stories and discuss what we can do better as a community.
Hacker News comments about the firing of Sam Altman are *filled* with misogyny about Helen Toner and Tasha McCauley. Tech bros who have no idea what
@CSETGeorgetown
and
@RANDCorporation
are making insane claims about their credibility. Wtf is wrong with people.
@nicksaraev
@BDataScientist
This is a common myth taught to so many students because it helps build a mental model. Artificial neurons only mimic biological ones at a superficial level.
Applying for ML/AI/EECS grad school this year and are interested in climate/humanitarian assistance research? Please feel free to reach out to me so we can discuss what Berkeley is doing in this space and how you can be a great fit!
@colorado_reed
@medhini_n
@ClimateChangeAI
A lot of people are chasing certain jobs or skills because "that's what's paying well right now," even if they don't like what they're doing. I was hanging out with a friend last night and we had this discussion, I thought I'd distill the points:
“It’s helping to lift the fog of war. No longer can anyone hide.”
@planet
Labs CEO
@Will4Planet
on how their satellite data and AI is transforming damage assessment in
#Ukraine
&
#Turkey
, tackling food security & deforestation.
PLUS tracking China's
#spyballoon
!
Our team has been hard at work using our xView2-derived AI models to perform damage assessment over Turkey and Syria. You can view our outputs over key areas such as here: . New areas will be added as we get imagery!
Sometimes when I'm alone in a hotel room, I randomly give a crisp dab out the window in case anyone's watching. Tonight, someone actually saw and gave me a dab back. We live in great times.
In 2021 we released the xView3 dataset to detect dark vessels engaged in IUU fishing on synthetic aperture radar imagery. In the years since, we have been hard at work putting the resulting models into operation. We now detect >10k dark vessels daily!
*AND*
@CarnegieMellon
folks are organizing multiple workshops at NeurIPS! Check out "ML for Developing Worlds", "ML for Climate Change", "AI for Social Good", "AI for Humanitarian Assistance and Disaster Response", and more!
@mldcmu
Exciting career news: I'll be moving to San Francisco at the end of the week to continue my research at
@cmusv
and
@SEInews
. I will also be taking on additional roles at
@DIU_x
and
@NASA
, especially as we focus more on AI + humanitarian assistance and disaster response.
I'll be joining
@allen_ai
this summer as a Research Fellow working on computer vision for social good with
@anikembhavi
and Favyen Bastani! Looking forward to scaling my work on humanitarian assistance and disaster response with AI2's focus on theoretical advancements.
The call for papers, retrospectives, and demos for the 4th Workshop on AI for Humanitarian Assistance and Disaster Response is now open at . This year, you will have the opportunity to demo your research to New Orleans first responders on a training ground!
I'm leading the state of CA's efforts to map flood inundation and damage to buildings and critical infrastructure after the atmospheric rivers via the automated exploitation of SAR imagery. It's a ton of fun to work with the government in high impact areas!
I'm now a newly minted AI Policy Fellow at Berkeley's Center for Security and Policy in
@GoldmanSchool
! Looking forward to working more with Sec. Janet Napolitano and
@areddie89
on defining policy for AI in humanitarian and disaster response use-cases.
We're using our work on automated damage assessment, xView2, to assess damage after the earthquake impacting Turkey and Syria. I am working with partners at
@WorldBank
and
@ICRC
to turn these outputs into better focused search and rescue efforts.
Yesterday I organized a workshop which brought together remote sensing experts across the disaster response orgs of CA. We are building a unified view of the state's remote sensing assets, unified access for all these sources, and more! Stay tuned.
In high school, we’d go to the library every year for a period and learn how to find, verify, and validate sources. No one would really pay attention and would just go through the motions.
Really coming to bite people in the ass now in the era of disinformation.
Honored to have been invited to the
@WhiteHouse
today to kickstart an initiative on AI for humanitarian assistance and disaster response. Looking forward to the things we can accomplish in the next 60 days!
Future
@SCSatCMU
freshmen? Thomas Jefferson High School's Hour of Code was one of the most impressive events I have been to. It was extremely inspiring to help get high schoolers excited about machine learning and AI and watch their excitement when imagining the possibilities!
Seeing your research be fielded for good is always a rewarding experience. I'm currently in 🇩🇪 helping transition my research for use in aid of Ukraine. Check out this
@politico
feature about how satellite imagery is being used to tip the scales of the war
I'm really excited about the release of Apple Vision Pro! While I was at Apple, I worked on the core frameworks support mixed reality and real-time processing on the headset, and I can't wait to see what people do with it. A whole new wave of computing was just made accessible.
Literally the only reason to get a PhD in ML is for the credentialing. You can learn how to do research and pursue your passions in industry, make more money, and have a real work/life balance.
These days, many people are interested in getting a PhD in ML. I think you should think really hard before committing to a PhD program in ML. Why?
I'm going to summarize some thoughts in this thread:
1/10
Our workshop on AI for Humanitarian Assistance and Disaster Response is kicking off in Room E2
@ICCVConference
now with Nan Buzard from the
@ICRC
! Please join us in person or virtually, link at
@CSProfKGD
Google, Amazon, and any other friends impacted by the recent layoffs: if you’re looking for an impactful place to work, please check out Carnegie Mellon’s Software Engineering Institute
@SEI_CMU_AI
. World class R&D that actually goes to production. Reach out to
@mattgaston
!
Illegal fishing is destroying our world, and we do not have sufficiently advanced algorithms to help stop it in its tracks. If you are at
#wacv2024
, come to the Complex-Valued Deep Learning workshop where we will be announcing the SARFish challenge!
Leopold's recommendations would even bar leading AI researchers (
@ilyasut
,
@jeremyphoward
,
@jovialjoy
, etc.), including himself, from working on AI in America. This talent would move elsewhere, and China would still benefit from global AI advancements. (5/9)
@ftm_guney
Why spend 5 years in a PhD program working extremely long hours for 10% of what you can make in industry? In a place where you actually have a real work-life balance? Academia is nice but money lets me buy a house…
Hey,
@JeffDean
is on Twitter! Throwback to meeting him at the Global Grand Challenges Summit. Had a great time talking to him about the possibilities ML has to health and healthcare.
Innovation does not come from SCIFs—scale happens in SCIFs. Leopold's recommendation to lock AI R&D behind security classifications would be detrimental and add a massive barrier to entry that will make AI inaccessible to the vast majority of the world. (4/9)
Over the last few months we've been building a new effort at Berkeley to pursue fundamental AI research by tackling the most pressing issue of our time: climate change. Today, we're announcing the BAIR Climate Initiative! Join us by following the article:
Our team
@DIU_x
, partnered with
@GlobalFishWatch
and
@NOAA
, just released the xView3 prize challenge for computer vision on synthetic aperture radar imagery to detect illegal, unregulated, and unreported fishing. The prize pool is $150,000. Register here!
I cannot tell you how incredibly demotivating it is to work on humanitarian assistance/disaster response stuff day in and day out just to hear your friend working on ads at Big Tech Co say "I vested $300K in stocks." It's high impact work, but it's underpaid and underappreciated.
TJ has a *ton* of amazing people. Sitting back while kids like me experience racism, though, doesn't help anyone. Everyone needs to support the kids who aren't listened to and are put down by the people who have community influence.
@wjhsd
@TJHSJaguars
8/8
China is building AI to target American naval vessels, but how well does it work? In our latest paper, “Open-Source Assessments of AI Capabilities,” we train a model on a leaked Chinese targeting dataset and provide a new methodology for net assessment.
🤔🎓 Are you feeling a bit lost with your grad school statement of purpose? I've been there, and I've got your back. I wrote a guide for you about how to break the mold of formulaic SOPs and stand out to the committee:
Had a kid from Pitt today tell me they put way more weight to the stuff I said because I worked at Carnegie Mellon. I remember being in her shoes. Nah buddy, I'm a Pitt grad too. Affiliation doesn't matter. Pitt, CMU, wherever, do good work and it won't matter.
In beautiful Singapore today to speak at the Humanitarian Futures Forum hosted by
@NTUsg
on AI for humanitarian assistance and disaster response. Singapore feels the impacts of climate change acutely and is leading the way on many applications of AI in this space!
We're (
@CarnegieMellon
+
@DIU_x
) releasing the xBD dataset in conjunction with the xView 2 challenge being launched soon. Help us create models to assess building damage after natural disasters! Here's a sneak peek of some data from Hurricane Michael.
Check out our new paper with
@OpenAI
on confidence building measures for AI! It was great to get together with partners from different sectors to share our thoughts, resulting in this paper. We hope that it results in new ideas. Thanks to
@SarahShoker
@areddie89
for instigating.
New AI & international security paper just dropped. 🔥
Let's take a look at how confidence-building measures can mitigate some of the international security risks associated with foundation models.
I work in SCIFs for a living and work on the dual-use civil and defense uses of AI. AI is crucial to maintaining US dominance, but confining its development to closed, classified environments would severely hinder our progress. (2/9)
Don't worry about your GPA. Of course, it matters, but what matters more is what you actually learn and retain. Don't just memorize stuff because you need to maximize a number which people will rarely ask for in the future.
Our challenge is getting open AI models into SCIFs, not locking everything into SCIFs from the start. For those unfamiliar with secure, classified spaces, they may seem like magical boxes where generational advantages are built. But true innovation happens in the open. (3/9)
After three and a half years, I just finished my last day at
@CarnegieMellon
@sei_etc
! Looking forward to the future, but I’ll cherish these memories forever.
Our work on damage assessment in Turkey was covered by MIT Tech Review by
@TateRyMo
. This work would not be possible without our partners at Microsoft and Planet. AI for HADR needs deep investment. I hope you'll join me in working on it!
@calebrob6
@BDataScientist
@andrew_zolli
We helped Climate Rights International understand how much deforestation was occurring cumulatively in Indonesia using ML and EO satellite imagery-derived forest cover information. Next step, use
@umbraspace
SAR Open Data coverage in South America to extend this methodology.
The BCI’s
@Ritwik_G
and Annie Miller, together with
@hrcberkeley
, supported
@ClimateRights
in their latest report, “Nickel Unearthed.” The report analyzes the inhumane impacts of the battery industry in Indonesia and steps that can be taken to stop it.
How do AI models evolve, and why should export controls keep up? Dive into the world of AI hardware and software co-design with
@areddie89
and I in our new article on
@techpolicypress
, where metrics and thresholds are ever-changing. 🔄🧠
#ExportRegulations
Throughout my career leading AI development for the US Department of Defense and allied nations, I've seen that impactful AI progress comes from our academic and commercial sectors. We must preserve this open model of development. (7/9)
@jjvincent
I wonder if they’ll also name
@laion_ai
as plaintiffs, since the actual work to curate the dataset was craftily shifted over to this separate entity.
I wholly disagree with this take. Show me something like SAM working on cluttered port scenes with layover and multi-pathing and then let's talk. Until then, keep working on SAR. And if anyone has better labeled then ship detection, then release them
To all the grad students working on yet another SAR ship detection model - I just saw someone in Slack use Meta’s new “Segment Anything” model on a port and it found all the ships, plus segmented the water from land.
Stop now. I repeat, stop now. It’s time to reevaluate.
The discovery of child sexual abuse material in the LAION-5B dataset highlights the ignored impacts of generative AI. In my latest piece, I provide an analysis of impact and recommendations to the AI industry and lawmakers.
@BerkeleyRisk
@GoldmanSchool
Am I the only one who is not excited at all about 5G? It seems like a massive marketing ploy for not-incredible performance gains in real-world, congested settings. Why is everyone going crazy about it?
The US government has largely accepted that model architectures, optimization techniques, and other advancements cannot be controlled. We instead choose to classify specific processes, products, TTPs, and critically, data, instead. (8/9)
This morning
@sat_summit
I’ll be talking about how geospatial “foundation models” are not foundational at all. Given the focus of the conference on foundation models, I expect a fiery Q&A! Come to The Forum @ 10:15 AM.
I've run a lot of hackathons, but
#HackThisHelpKids
was by far the best run and most impactful event I've had the honor to be a part of. Thank you to
@ChildrensPgh
for making me a part of it, and the excellent team that worked for weeks to make it happen ❤️
Looking for a new apartment in Berkeley is making me realize how much I dislike the Bay Area. The tradeoff shouldn’t be “affordable and comfortable place to live” or “high risk of bodily and property harm”. Why is there so much crime here?
TJ Kids: We're trying to build an alumni directory so current and new students can reach out to old ones for help with anything. If you're interested in being a contact, just fill out this form!
@emilymbender
@complingy
@swabhz
Every time I get a query from a high schooler at an "elite" high school, I email my old high school asking them if any students need research opportunities. There must be a better way to even the odds.
@CSProfKGD
Imagine if Google's non-existent moat affects their bottom line to the degree that Google actually enforces this patent. The ensuing legal fight would be incredible.
Are you looking to hire world-class AI talent? Please take a look at some of our recent graduates from Berkeley AI
@berkeley_ai
! Their work has shaped the entire field of AI as we know it today:
For those of you who know me, I love my high school and my community. I try to stay involved in any way I can. This video below, and other recent incidents, have made me extremely ashamed to be from TJ. The district
@wjhsd
does nothing to hold kids accountable for their racism.
videos like this serve as a reminder that racism (casual or not) is constant in tj. i have seen thing like this, things smaller than this, and things much bigger than this happen on countless occasions. change needs to start now.
We're announcing our Call for Papers, Retrospectives, and Challenges for the 3rd Workshop on AI for Humanitarian Assistance and Disaster Response! This year we are opening tracks to enable practitioners to discuss operationalized AI research in the field
@nicksaraev
@BDataScientist
Because artificial neurons don’t even model the “interface level” correctly. Dendritic connections are much more dynamic, and signal propagation is much more complex, then what an artificial neuron simulates.
We have a contract! The strike is over. Thank you to everyone who worked so hard to bargain for a historic contract, as well as everyone who worked day and night to get a “yes” vote ratified ❤️
The point to underline, though, was that none of these kids were being purposefully racist. They simply just did not know better. The community lives in a bubble and is comfortable being in that bubble, and it impacts minorities in ways that haven't been brought to light. 7/?
Our workshop on AI for Humanitarian Assistance and Disaster Response will be returning for a fourth time at NeurIPS this winter! Get ready to learn about how AI has been used to fight the war in Ukraine, respond to COVID, and aid in natural disaster response!
@NeurIPSConf