schwabpa Profile Banner
Patrick Schwab Profile
Patrick Schwab

@schwabpa

Followers
7K
Following
29K
Media
220
Statuses
1K

Senior Director Machine Learning & AI @GSK. Prev: ML @Roche, PhD @ETH. ML for Drug Discovery and Health.

Zurich, Switzerland
Joined July 2013
Don't wanna be here? Send us removal request.
@schwabpa
Patrick Schwab
3 months
A central mistake in biology was to name genes. This over-simplification made reconciling what is happening on the molecular level a mess - it's not rare to find reports of opposite mechanisms in different contexts, claimed involvement in dozens if not hundreds of different
Tweet media one
89
237
1K
@schwabpa
Patrick Schwab
2 months
A long-standing challenge in supervised deep-learning has been to imbue neural networks with mechanistic -rather than associational - understanding. We are excited to present DiffIntersort - a causal order regularizer enabling the differentiable optimization of deep-learning
Tweet media one
8
151
992
@schwabpa
Patrick Schwab
2 years
You couldn't make it to #NeurIPS2022 this year?. Nothing to worry - I curated a summary for you below focussing on key papers, presentations and workshops in the buzzing space of ML in Biology and Healthcare 👇
Tweet media one
23
153
791
@schwabpa
Patrick Schwab
2 years
The Machine Learning for Drug Discovery workshop is back for #iclr2023 ! . Featuring fantastic speakers @CarolineUhler, @mmbronstein, @OkkoClev, @lizbwood, @fabian_theis & @RGBLabMIT. We are calling for papers & are opening a challenge. See you there!.
Tweet media one
4
97
438
@schwabpa
Patrick Schwab
1 year
Could not echo this message more: if you are excited about making a difference at scale, the intersection of engineering and bio/medicine is the place to be. However, do go into it with open eyes:.- be ready (and ideally eager) to spend your whole career in this area. Solutions.
@GeneInvesting
Gene Investing w/Anthony 🧬
1 year
Seems like a consensus is forming amongst many smart people! . This is Jensen Huang, CEO of $NVDA. Basically WATCH OUT for the impending biotech BOOM 💥
14
44
364
@schwabpa
Patrick Schwab
1 year
Unable to keep up with the deluge of amazing work happening in ML for Biology and Health at NeurIPS this year?. We've got you covered with a concise summary of #NeurIPS2023 content focussed at the exciting intersection of Biology, Health and AI!. thread 👇
Tweet media one
5
63
331
@schwabpa
Patrick Schwab
4 months
For all its flaws, I would argue the biotech industry is still *the* single best place to work today with a tech background. 1- Intellectually, you get to work on some of the hardest problems of our time and they won’t be solved anytime soon. 2- The field is undergoing a.
@iskander
alex rubinsteyn
4 months
Why is biotech such a sad industry? . They make medicine, it output feels 10x more important than automation and info-plumbing (aka the tech industry) and requires deeper knowledge/training -- and yet, low salaries, perpetual layoffs, very few founder CEOs, bad vibes all around.
14
43
325
@schwabpa
Patrick Schwab
2 years
Does form follow function in cells?. We recently explored the use of machine learning to associate cell shape with multi-omics using Image2Omics - creating a multi-omics map of macrophage states across genetic perturbations and stimulation conditions. In this process, we found.
Tweet media one
Tweet media two
2
44
267
@schwabpa
Patrick Schwab
4 months
Reality check. - novelty: 0.- creativity: 0.- likelihood to cure all cancer: 0%. Information retrieval does not solve scientific discovery
Tweet media one
@tsarnick
Tsarathustra
4 months
Sam Altman says AI will someday be able to cure cancer in collaboration with humans by suggesting wet lab experiments to do and then thinking about the results
20
24
260
@schwabpa
Patrick Schwab
10 months
The future of AI-driven drug discovery is natural intelligence. Today, we report EVolved Avian Natural Neural Networks (EVA-3N) - a breakthrough single-cell foundation model that unifies RNA, DNA and single cell language in an evolved 2B parameter general AI model 👇
Tweet media one
12
33
237
@schwabpa
Patrick Schwab
2 months
The inevitable journey of any AI in drug discovery practitioner
Tweet media one
@MattyKirsh
Matthew Kirshner
2 months
Super thought-provoking piece by @AndrewE_Dunn on Isomorphic. The whole company is a big middle finger to the almost universally held dogma in TechBio that data is the key bottleneck.
Tweet media one
4
19
210
@schwabpa
Patrick Schwab
3 years
The first "Machine Learning for Drug Discovery"(MLDD) workshop will be held at #ICLR2022. Featuring a stellar lineup of speakers, a functional genetics drug discovery challenge and a call for paper contributions!. More below 👇.
Tweet media one
3
44
189
@schwabpa
Patrick Schwab
1 year
Critical piece out in Nature on AI driven drug discovery that raises some arguments we often hear from external observers - but I think these arguments largely miss the point. The experiment that is being called for - AI vs. non-AI drug discovery - does not and will likely never
Tweet media one
7
48
188
@schwabpa
Patrick Schwab
5 months
If you work in BioAI and you live in constant fear of being scooped, consider that you may be working on the wrong problems. Or, in other words: Drug discovery consists of 1000s of steps, PDB does not answer all of them.
@chaitjo
Chaitanya K. Joshi
5 months
TBH, it has got to be stressful working on AlphaFold 3 reproductions -. We have seen, what, 4 of them come out within days of one-another. But its awesome for the community as we get more open source tools to play with, too :).
6
17
165
@schwabpa
Patrick Schwab
9 months
So much happening in ML for Biology and Health at ICLR & MLDD this year and so little time to catch up?. We've got you covered with a quick summary of #ICLR2024 and MLDD content focused at the buzzing intersection of Bio, Health and AI!. thread👇
Tweet media one
2
32
149
@schwabpa
Patrick Schwab
5 months
A central challenge of AI-driven biotech is that in drug discovery a fully validated medicine is worth a million times more than a million early-stage ideas that only have little validation. This is unfortunately at odds with the AI domain where we almost always attempt to
Tweet media one
4
17
143
@schwabpa
Patrick Schwab
1 year
Feeling like you missed out on all the amazing progress at the intersection of Health & Bio presented at #ICML2023 in Honolulu?. We've got you covered with a curated, whirlwind review of all the exciting science at the emerging interface of ML/AI, health and biology . 👇thread
Tweet media one
3
28
144
@schwabpa
Patrick Schwab
6 years
Our work on learning to diagnose Parkinson's from smartphones has been accepted @RealAAAI. Using mPower cohort (n=1853), we show that we can distinguish between people with and without PD at 0.85 AUC and that attention uncovers the important data segments.
Tweet media one
11
27
121
@schwabpa
Patrick Schwab
6 months
Perhaps controversial (?) take: computational models that faithfully represent biology are guaranteed to be not interpretable. Biology consists of elements that are . - redundant .- non-modular.- probabilistic.- multi-functional.- time-resolved.- multi-scale. None of these.
@NikoMcCarty
Niko McCarty 🧫
6 months
Cells are not black boxes. They are interpretable, because they are made of atoms. With sufficient research (and effort), we can figure out exactly how they work. "Black box" predictive models are useful, insofar as they are accurate. But the goal of the coming decades should
Tweet media one
12
17
131
@schwabpa
Patrick Schwab
8 months
Despite the availability of interventional data in biology, extracting meaningful causal insights remains challenging with few guarantees. Very excited to share recent preprint in which we discovered a new concept for learning from single-intervention datasets that gives rise to
Tweet media one
3
24
129
@schwabpa
Patrick Schwab
1 month
MLDD is returning for 2025!. We're thrilled to announce that the Machine Learning for Drug Discovery (MLDD) Symposium will return in 2025! . Join us for an inspiring day of knowledge sharing, networking, and discussions on the latest trends in applying machine learning to drug
Tweet media one
2
21
124
@schwabpa
Patrick Schwab
6 months
What will the future of AI-assisted biological discovery look like?. As the use of AI in biology and health is gaining momentum, its not hard to imagine a future in which every biological scientist is supported by AI assistants that help synthesise data, design the next
Tweet media one
6
25
116
@schwabpa
Patrick Schwab
11 months
I would not recommend to make the below your mantra for AI in drug discovery. - Metadata is key - no amount or mixture of data without enough information about the context in which the data were generated will give you generalizable insights, nor will you have any hope to.
@maxjaderberg
Max Jaderberg
11 months
From everything I see day to day, deep learning for drug design has exactly the same characteristics as other DL-successful domains: .- dataset design and mixture is key.- scalable and stable architectures and losses trump all.- end-to-end is better, just follow the gradient.
10
15
108
@schwabpa
Patrick Schwab
1 year
Dismissing the growing attention on AI in biotech as hype is short-sighted and misses critical nuance . AI in biotech is in a curious state of Heisenbergian superposition, and is simultaneously over- and underhyped. Overhyped: .Superficial use of AI while addressing traditional.
@kenbwork
Kenny Workman
1 year
ai in biotech is incredibly overhyped. biotech companies live and die by concrete assets generated from carefully selected disease models with rational biological hypotheses. engineering efforts are better spent centralizing and structuring experimental data for basic analysis.
5
11
112
@schwabpa
Patrick Schwab
1 year
Machine Learning for Drug Discovery (MLDD) is coming back! . With outstanding speakers: .@lucycolwell37, @UWproteindesign, @ThoreG, @KrishnaswamyLab, @shantanuXsingh & @Avsecz. We meet on Monday, May 6 (before #iclr2024) in Vienna. See you there! .
Tweet media one
1
16
105
@schwabpa
Patrick Schwab
9 months
Just one week until the Machine Learning for Drug Discovery (MLDD) event in Vienna, Austria!. With a stellar line-up of speakers: .@lucycolwell37, @UWproteindesign, @deboramarks, @ThoreG, @KrishnaswamyLab , @shantanuXsingh & @Avsecz . guiding us through the most exciting
Tweet media one
5
18
103
@schwabpa
Patrick Schwab
3 years
Missed #ICML2022 this year?. Nothing to worry - a brief summary of events (focussed on spotlights, keynotes and orals) from the buzzing ML/health/biology space below 👇
Tweet media one
3
21
88
@schwabpa
Patrick Schwab
1 year
Perhaps a contrarian view but there are some major holes in the "scaled data-generation is all you need" hypothesis too:. 1) observational data without perturbations in general does not enable inference of causal relationships (e.g., if you are generating unperturbed scRNAseq.
@ron_alfa
Ron Alfa
1 year
Another nice AI bio piece by @AndrewE_Dunn, interviewing @demishassabis this time. It is interesting to see a second cycle now of in silico emphasis > data, where the first cycle was shifted to differentiated data approaches. AlphaFold is exciting and I can think of ways.
5
8
87
@schwabpa
Patrick Schwab
11 months
@rbhar90 I concur. I am surprised how even some of our smartest seem to fall victim to the above fallacy - what do you think leads to the pervasive overestimation of capabilities of AI? . (this seems to happen with every step-change in progress; people were making similar claims when RL.
4
4
78
@schwabpa
Patrick Schwab
10 months
Lots of insightful nuggets in the recent @endpts interview with @DaphneKoller:. Few problems in AI in bio are compute-bound today. In contrast to more data-rich AI domains like imaging and language, there are few problems in AI in biology where the active binding constraint is.
5
12
71
@schwabpa
Patrick Schwab
5 years
Happy to announce that I have recently passed my PhD defence at ETH Zurich - big thank you to my doctoral committee, friends and collaborators for their support during the past three years! 🎓
Tweet media one
6
2
67
@schwabpa
Patrick Schwab
3 months
But what's the alternative?. Well, we could just not name them and investigate the underlying complexity at the next level(s). Having a named entity at the gene level makes it "acceptable" to stop your investigation at that level and turn a blind eye to the underlying.
12
1
66
@schwabpa
Patrick Schwab
6 months
Under-appreciated fact: If your main distinction is using AI in drug discovery, your expected probability of success and development time is industry average by definition - because absolutely everyone in drug discovery is using AI today. (AI use today is not transformative, it.
5
7
61
@schwabpa
Patrick Schwab
2 years
We recently evaluated the risk of sharing de-identified open health data, and found little evidence of harm relative to the growing issue of data breaches that affect millions. Great collaboration with Leo Celi and team.@MITCriticalData @GSK @harvardmed.
2
11
57
@schwabpa
Patrick Schwab
3 years
In vitro experiments, using e.g. CRISPR, have become essential in early drug discovery. However, with billions of potential experimental designs, the search space is vast and selecting the right experiment to conduct can be difficult. In #ICLR2022 work we introduce GeneDisco. 👇
Tweet media one
1
10
56
@schwabpa
Patrick Schwab
1 year
Biotech and TechBio
Tweet media one
5
4
56
@schwabpa
Patrick Schwab
3 months
Interesting contrast between former AI lab employees, who appear to uniformly believe it is easy to build another LLM company from scratch, and investors that believe these companies will have an enduring moat. I wouldn’t bet against the people closer to the technology on this.
@Prashant_1722
Prashant
3 months
BREAKING NEWS 🔥 Mira Murati, former OpenAI CTO to raise $100M for new AI startup. The company will train proprietary models to build AI products. Barret Zoph from OpenAI is expected to join the company too.
Tweet media one
6
4
56
@schwabpa
Patrick Schwab
5 months
One of the potential avenues for AI to transformatively impact drug discovery would be for it to improve the quality of candidates that make it through the pipeline - i.e. increase the probability of successful translation to the clinic. Why does this turn out to be incredibly
Tweet media one
2
6
55
@schwabpa
Patrick Schwab
2 months
The preprint on "Efficient Differentiable Discovery of Causal Order" is now available on arXiv at the following link:.
2
4
56
@schwabpa
Patrick Schwab
28 days
Aggregated trial data paints a more differentiated picture - the overwhelming majority of clinical studies are started in the EU/US. - the overall mix appears more or less stable post COVID. - the, likely economically-driven, drop in studies being started since 2021 is *larger*
Tweet media one
@davidycli
David Li
1 month
In biotech, China now ahead in ADCs, bispecific Ab’s, T cell engagers, and traditional small mlc’s . US still slightly ahead on cell and gene therapy, gene editing, and more exotic small molecules (glues, covalents, degraders, etc) . China clinical dev timelines 50-100% faster.
3
7
55
@schwabpa
Patrick Schwab
1 year
Agreed. Very few (if any) biological problems today are in the compute-bound regime where the dominant strategy would be ever-larger compute. Requires large-scale standardized data, a well defined problem definition and scaling laws. Biology is not (yet) NLP.
1
2
49
@schwabpa
Patrick Schwab
1 year
At the excellent @icml_compbio workshop, @mmbronstein (@UniofOxford) gave a captivating talk on the enormous potential of geometric ML for molecules, covering applications from molecular impainting, fragment based molecular design and protein function prediction.
Tweet media one
Tweet media two
Tweet media three
Tweet media four
2
6
48
@schwabpa
Patrick Schwab
6 months
In a world of exponentially expanding data, you can find evidence to the contrary for every idea. In drug discovery - where most ideas fail - this means the consensus will generally be opposed to all unproven ideas. You add value where you have conviction that goes against.
@daphnezohar
Daphne Zohar
6 months
Pharma R&D head to his BD team: “We look at many opportunities and can find a reason to say no to every one of them. If we always say no, we will be right almost all the time but we won’t make any money”.
1
7
49
@schwabpa
Patrick Schwab
2 years
Transcriptome is only poorly predictable from high-content cell imaging (which was known and we replicated) but - interestingly - proteomic abundances are significantly better predictable for significantly more proteins, implying proteome and cell shape are more closely connected
Tweet media one
Tweet media two
1
11
45
@schwabpa
Patrick Schwab
9 months
Looking forward to welcoming you at Machine Learning for Drug Discovery (MLDD) today!. we have a stream set up for those joining us remotely . and we are meeting in person at Marriott Courtyard Messe/Prater - starting at 1pm today local time (CET/Vienna). Link to stream and
Tweet media one
3
1
44
@schwabpa
Patrick Schwab
10 months
A common, recurrent, and very human mistake in drug discovery is to be overly enamored with the latest and most shiny new technology. Organoids, genetics, single cell RNAseq, CRISPR, AI foundation models, serum biomarkers et al - when we first learn about these tools, we often
Tweet media one
3
4
43
@schwabpa
Patrick Schwab
10 months
Amazingly rich insights in the recent interview with @SchreiberStuart (@arenabioworks) and @RLCscienceboss (@endpts):. Many inefficiencies remain to be addressed in going from fundamental research to medicines available in the clinic. Any researcher with an interest in having
Tweet media one
4
4
43
@schwabpa
Patrick Schwab
4 months
This all sounds very cool until you realize absolutely every disease X has been connected with every condition Y in literature. We love to romanticize simple ideas about scientific discovery but this is not a systematically exploitable strategy. Using the example from the.
@hermittoday
hermit the cat
4 months
making scientific discoveries simply by connecting information already existing in the public domain
Tweet media one
6
2
44
@schwabpa
Patrick Schwab
2 months
Imagine the things we could do if we brought this precision mindset to medicine.
@ASMLcompany
ASML
2 months
From early design to volume manufacturing, our computational lithography software enables chipmakers to optimize the chip patterning process. Layer by layer, chip by chip, wafer by wafer, computational lithography is helping push microchip technology to new limits.
3
3
44
@schwabpa
Patrick Schwab
2 years
Creating a map of gene interactions is a fundamental step in drug discovery that generates ideas on what mechanisms may be targeted by future medicines. Today, we announce the CausalBench challenge at and invite you to contribute to this important problem!
Tweet media one
2
10
42
@schwabpa
Patrick Schwab
5 months
AlphaFold3 already reproduced and open sourced (roughly equal PoseBusters performance) -- just 4 months from release to reproduction.
@sokrypton
Sergey Ovchinnikov
5 months
AlphaFold3 reproduced and params/code released. 🤩.
1
2
41
@schwabpa
Patrick Schwab
3 years
Stellar keynote by Aviv Regev on how ML is being used in Drug Discovery @genentech. Covers gems like lab-in-the-loop for mechanistic discovery, small molecules, large molecules and personalised cancer vaccines. A great overview on the field. slides:
Tweet media one
Tweet media two
2
7
39
@schwabpa
Patrick Schwab
9 months
As we hit 20’000+ NeurIPS submissions today, I suspect an under-appreciated reason why almost everyone with ambition is gravitating to the AI/ML field is because the field is radically empiricist - in ML research ‘good’ is what works quantifiably. In contrast to more structured.
1
3
38
@schwabpa
Patrick Schwab
4 months
This is perhaps the most common misunderstanding in working with language models - to assume they "think" like humans. @paulg expects ChatGPT counts occurrences of different questions people raise, and expects an answer based on this information. What actually happens: The.
@paulg
Paul Graham
4 months
I asked ChatGPT what other people ask it about. Sounds a lot like the sections of a newspaper.
Tweet media one
6
3
36
@schwabpa
Patrick Schwab
1 year
The advent of high throughput genetic perturbation screening at single cell resolution (e.g. perturb-seq) holds great promise to potentially help uncover the wiring diagram of cellular biology. However, when we first studied this topic we were surprised to find . 👇
Tweet media one
1
8
33
@schwabpa
Patrick Schwab
1 year
MLDD just got even more exciting!. @deboramarks is joining our exceptional group of speakers!. Ready for a tour of the world of ML for DD - protein design, function & language models, cell imaging, single cell and genomics?. When? Mon May 6 (before ICLR).Where? Vienna Austria
Tweet media one
1
2
32
@schwabpa
Patrick Schwab
3 months
The closest thing to arbitrage in drug discovery is to use tools that have just been figured out on problems where they are clearly applicable. No scientific glory, no potential for fancy publications - hence fewer people looking at it than warranted by the potential.
@owl_posting
owl
3 months
There aren't enough smart people in biology doing something boring. new argument piece . i often meet a lot of founders in biology pursuing really crazy, revolutionary ideas. i love them! but i wish there were more people pursuing the boring ideas. 🧵.
2
1
33
@schwabpa
Patrick Schwab
3 months
A positive side benefit of removing gene names would be that bioinformaticians wouldn't have to spend half of their day normalizing gene names anymore. :-).
@schwabpa
Patrick Schwab
3 months
A central mistake in biology was to name genes. This over-simplification made reconciling what is happening on the molecular level a mess - it's not rare to find reports of opposite mechanisms in different contexts, claimed involvement in dozens if not hundreds of different
Tweet media one
7
5
33
@schwabpa
Patrick Schwab
1 year
A simple litmus test to debunk grande AI over-claims like the below is to ask yourself if the data the models are trained on even contain the information required. Could you possibly build a physical world model from predicting the next frame in a video sequence like the below?.
@DrJimFan
Jim Fan
1 year
If you think OpenAI Sora is a creative toy like DALLE, . think again. Sora is a data-driven physics engine. It is a simulation of many worlds, real or fantastical. The simulator learns intricate rendering, "intuitive" physics, long-horizon reasoning, and semantic grounding, all
10
4
29
@schwabpa
Patrick Schwab
4 months
World-leading cancer experts would've given a much more thoughtful answer that considers the diversity of cancers, the likely multiple mechanisms involved and the difficulty of any single experiment informing sufficiently across them all - whereas LLM just recites the dominant.
3
4
32
@schwabpa
Patrick Schwab
2 years
Giving models an understanding of what they do not know, is for many decision-making applications as important as providing accurate predictions. E Candès @Stanford gave a broad introduction to conformal prediction with quantile regression to filter out low confidence predictions
Tweet media one
Tweet media two
Tweet media three
1
3
29
@schwabpa
Patrick Schwab
9 months
For an AI researcher, it may be shocking to learn that e.g. in the field of medicine we most often simply don’t know what works and what doesn’t. We rarely know what practices systematically lead to better outcomes, how good we are at diagnosing, whether we should be testing.
@schwabpa
Patrick Schwab
9 months
As we hit 20’000+ NeurIPS submissions today, I suspect an under-appreciated reason why almost everyone with ambition is gravitating to the AI/ML field is because the field is radically empiricist - in ML research ‘good’ is what works quantifiably. In contrast to more structured.
0
4
28
@schwabpa
Patrick Schwab
5 months
On second thought, "building platforms before making medicines" is such a fundamental and common mistake in the field that it could be the AI-driven biotech equivalent of "not talking to users" in the software domain.
@schwabpa
Patrick Schwab
5 months
A central challenge of AI-driven biotech is that in drug discovery a fully validated medicine is worth a million times more than a million early-stage ideas that only have little validation. This is unfortunately at odds with the AI domain where we almost always attempt to
Tweet media one
0
4
28
@schwabpa
Patrick Schwab
1 year
Viruses mutating in response to immune pressure is one of the key challenges in effectively responding to pandemics. In recent work Thadani @sarahgurev @NotinPascal et al (@DeboraMarksLab) developed EVEscape to predict viral escape from sequences, biophyiscal and structure. 👇
Tweet media one
1
3
28
@schwabpa
Patrick Schwab
5 months
As a community, we over-index on the same three tasks that have large public databases - all the while bioAI is such a rich field with incredible diversity of hard problems and data types. Monoculture is not the solution.
2
0
27
@schwabpa
Patrick Schwab
6 years
@educationpalmer @Google @Apple @IBM Unsurprising. For a software engineer, a strong github portfolio, for example, is a much stronger signal than any degree.
0
0
23
@schwabpa
Patrick Schwab
2 months
Building on the theory of epsilon-interventional faithfulness introduced in Chevalley et al (2024), we reformulated Intersort using differentiable sorting and ranking. This enables two key advances: .- seamless integration into modern deep learning frameworks as a.
1
0
27
@schwabpa
Patrick Schwab
2 years
Starting off with Keynote presentations: . Back prop has become the workhorse in ML-.@geoffreyhinton challenges the community to rethink learning introducing the Forward-Forward Algorithm that are trained to have high goodness on positive and low goodness on negative samples.
Tweet media one
Tweet media two
Tweet media three
1
6
26
@schwabpa
Patrick Schwab
3 years
Announcing the Research2Clinics workshop at NeurIPS 2021: consider attending if you are interested in bringing machine learning into the clinic! We have a stellar lineup of speakers and will be honouring the best contributions with best paper awards. CFP:
0
6
25
@schwabpa
Patrick Schwab
9 months
It's interesting that the opaque nature of AI frequently misleads even those that develop LLM models themselves to fundamentally misunderstand their nature. A simple mental model may be an antidote:.Assume for the purpose of this exercise an LLM is merely a tool for information.
1
4
24
@schwabpa
Patrick Schwab
5 months
One thing that Jensen Huang and @nvidia do not get enough credit for is just how incredibly prescient they were in betting on the role of GPUs in AI. They noticed the early signs in leading AI research groups starting to use GPUs for machine learning, including its contribution
Tweet media one
2
0
20
@schwabpa
Patrick Schwab
2 years
The Image2Omics preprint with this & more is available at:. Amazing collaboration with @cuong_qnguyen, R Mehrizi, @arashmeh, @MBantscheff, @maryalegro, B Carbone, C Fishwick, H Keles, S Sanford, Yi Zhao and the talented dry and wetlab scientists @GSK!.
1
4
24
@schwabpa
Patrick Schwab
3 years
Announcing the winners of the GeneDisco challenge. The GeneDisco challenge challenge was held at #ICLR2022, and tasked participants with developing novel algorithms that help discover genes that modulate disease-relevant markers. Congratulations!
Tweet media one
Tweet media two
1
2
22
@schwabpa
Patrick Schwab
2 years
In the AI for Science workshop, David Baker @UWproteindesign gives us a whirlwind tour of the exciting progress in de novo protein design with ML incl the first approved de-novo designed medicine, amyloid binding, protein/NA complexes and RFdiffusion for unconditional generation
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
6
22
@schwabpa
Patrick Schwab
7 years
More good news today: Our paper on reducing false alarms in critical care with very few labels got accepted to #icml2018 @icmlconf! Many thanks to our collaborators at @Unispital_USZ @ETH_en @uzh_news_en . Paper link:
Tweet media one
1
6
22
@schwabpa
Patrick Schwab
2 months
Saving 4 hours of sleep per night sounds great. What could possibly go wrong?. Cardiovascular disease (stroke, heart attack, . ) risk +50%. whatever biological relationship we think is simple probably is everything but.
Tweet media one
@byersblake
Blake Byers
2 months
There are people who genetically only need 4-6 hrs of sleep per night. They also "tend to be more optimistic, more energetic and better multitaskers. They also have a higher pain threshold, don’t suffer from jet lag and some researchers believe they may even live longer.". We.
4
1
22
@schwabpa
Patrick Schwab
3 months
Surprisingly, the church of ‘scale is all you need’ still has many acolytes - ‘situational awareness’ is only a few months old. ‘Emergence’ of course doesn’t exist and when you train a model to recapitulate associations in your data, you, naturally, get exactly what you trained.
@fchollet
François Chollet
3 months
People have been rewriting history and saying that "everyone has always believed that LLMs alone wouldn't be AGI and that extensive scaffolding around them would be necessary". No, throughout most of 2023 (the "sparks of AGI" era) the mainstream bay area belief was that LLMs were.
1
6
21
@schwabpa
Patrick Schwab
3 years
𝗔𝗻𝗻𝗼𝘂𝗻𝗰𝗶𝗻𝗴 𝘁𝗵𝗲 𝗚𝗦𝗞.𝗮𝗶 𝗚𝗲𝗻𝗲𝗗𝗶𝘀𝗰𝗼 𝗖𝗵𝗮𝗹𝗹𝗲𝗻𝗴𝗲. The GeneDisco team invites ML community contributions to address the challenging problem of experimental exploration of the vast genetic perturbation space. [1/n] More below👇.
1
7
20
@schwabpa
Patrick Schwab
2 months
We are excited about the potential future applications of this work in imbuing neural networks with causal regularization in biomedicine and beyond! . Huge thank you to the amazing team @GSK AI behind this advance: Mathieu Chevalley and @arashmeh.
1
2
21
@schwabpa
Patrick Schwab
9 months
Exciting news for AI-driven drug discovery - Xaira, another entrant in the $100m+ heavyweight league emerges from stealth with, among others, protein design pioneer David Baker (@UWproteindesign). What they shared below points towards bringing together what emerged over the last.
@AndrewE_Dunn
Andrew Dunn
9 months
Among the head-turning details:. ex-Stanford prez Marc Tessier-Lavigne returns to biotech as CEO. investors include ARCH, Foresite, NEA, F-Prime, Sequoia, Lux. board includes Carolyn Bertozzi, ex- J&J CEO Alex Gorsky, former FDA head Scott Gottlieb.
0
2
21
@schwabpa
Patrick Schwab
1 year
@mo_lotfollahi The community should scrutinise bold claims around "foundation models" more. Some of these models claim to be good at tasks that are well established (e.g. GRN inference, perturbation prediction) but do not compare to existing work on comparable benchmarks.
1
0
19
@schwabpa
Patrick Schwab
10 months
EVA-3N was trained using the largest single-cell atlas with 60M single-cell transcriptomes from 850 studies. We used a novel task that we call "next-UMAP prediction" where EVA-3N predicts the most likely next UMAP based on millions of previously seen single-cell transcriptomes.
Tweet media one
1
1
19
@schwabpa
Patrick Schwab
2 months
DiffIntersort tackles the challenge of deriving causal order from large-scale interventional datasets. Causal discovery is notoriously complex especially at large scale, and understanding these causal links is supremely important in domains such as biology. In biomedicine,.
1
1
20
@schwabpa
Patrick Schwab
3 months
(nothing personal @genenames . ).
1
0
19
@schwabpa
Patrick Schwab
2 months
We empirically evaluated the performance of DiffIntersort compared to the theoretical upper bound and the SORTRANKING heuristic, and found that DiffIntersort consistently outperforms while maintaining strong scalability to large generating networks.
Tweet media one
1
0
19
@schwabpa
Patrick Schwab
2 years
@stefanAbauer @CIFAR_News @KTHuniversity presented a wealth of recent research on real-world uses of causal inference including single-cell gene network inference, learning neural causal models from perturbational data, and optimal experimental design for causal discovery.
Tweet media one
Tweet media two
Tweet media three
1
2
19
@schwabpa
Patrick Schwab
2 months
When added as a constraint into a neural causal discovery method (CausalDisco), we find that constraining the learning using DiffIntersort regularization improves discovery performance in recovery of across a spectrum of intervention fractions (from 25 to 100% of nodes).
Tweet media one
1
0
18
@schwabpa
Patrick Schwab
2 years
Causality in biology leader @CarolineUhler @MIT makes the case for the new methods needed to truly move towards causality in ML and introduces us to an impactful application to cancer immunotherapy for which a $USD 50'000 challenge has been opened:
Tweet media one
Tweet media two
Tweet media three
Tweet media four
2
2
18
@schwabpa
Patrick Schwab
10 months
Claims of progress towards AGI via emergence are greatly exaggerated. LLMs perform web-scale semantic information retrieval. Common benchmarks feign progress because of increasing test-set leakage and manual fine-tuning via RLHF. This represents intelligence only if one.
@rbhar90
Bharath Ramsundar
10 months
My mental model of an LLM is an interpolative vector database. Larger LLMs correspond to bigger databases. The vector embeddings allow for interpolative behavior to generalize to some degree due to rich embeddings. Given this model, I am trying to understand the scientific.
1
0
15
@schwabpa
Patrick Schwab
6 months
bio foundation models - seasoned MD-PhD biotech veteran
Tweet media one
1
0
18
@schwabpa
Patrick Schwab
11 months
@rbhar90 I would actually dare to predict with high confidence that next word prediction would not necessarily be part of a potential future true general intelligent system (in fact any system in which we would classify intelligence not in the sense of information retrieval).
2
0
18
@schwabpa
Patrick Schwab
2 years
Announcing the winners of the CausalBench challenge! . The winners produced diverse, excellent and creative solutions significantly improving the state of the art in inferring causal interactions from single-cell perturbation data over existing methods.
Tweet media one
1
2
17
@schwabpa
Patrick Schwab
2 years
Causality is at the core of key problems in healthcare and is receiving more attn at NeurIPS:. In the causalML for real world impact workshop, causality pioneer Peter Spirtes @CarnegieMellon (of PC algo fame) outlines challenges, limitations and paths forward for causal inference
Tweet media one
Tweet media two
Tweet media three
1
1
17
@schwabpa
Patrick Schwab
2 years
Next, we looked to verify whether this predictability depends on the gene product localisation:. Intriguingly, gene products annotated to localise in plasma membrane are considerably more predictable vs those in vesicles, mitochondria and cytosol in transcriptome and proteome.
Tweet media one
1
1
16
@schwabpa
Patrick Schwab
9 months
After releasing their leading protein language model ProGen last year, @thisismadani and team @ProfluentBio now present a breakthrough in the application of bioLMs to designing CRISPR-like molecules capable of gene editing with high precision. Moreover, they release the result.
@thisismadani
Ali Madani
10 months
Can AI rewrite our human genome? ⌨️🧬. Today, we announce the successful editing of DNA in human cells with gene editors fully designed with AI. Not only that, we've decided to freely release the molecules under the @ProfluentBio OpenCRISPR initiative. Lots to unpack👇
0
3
16
@schwabpa
Patrick Schwab
6 months
A month ago @leopoldasch warned of a coming "Intelligence Explosion" based on projected automation of AI research, and claimed awareness of these scenarios is a matter of international security. But how realistic were the scenarios?. To find out, I used napkin math to calculate
Tweet media one
3
0
16
@schwabpa
Patrick Schwab
2 months
That scaling is ending because "data is not growing" is as catchy as it is wrong. - Scientific publications are exponentially growing.- Websites published are exponentially growing.- Videos published are exponentially growing. In aggregate, I would not be surprised if globally
Tweet media one
Tweet media two
Tweet media three
Tweet media four
4
2
16
@schwabpa
Patrick Schwab
3 months
@DdelAlamo Generally, one should be skeptical when reported errors are lower than the experimental uncertainty. :-).
0
0
16
@schwabpa
Patrick Schwab
5 years
Causal explanation (CXPlain) models that learn to explain any other machine-learning model to be presented at #NeurIPS2019. Includes experiments on MNIST, ImageNet and Twitter sentiment analysis, and we show how to quantify estimation uncertainty. Link:
Tweet media one
Tweet media two
Tweet media three
1
4
14
@schwabpa
Patrick Schwab
2 months
Additionally, we tested the sensitivity of the performance of DiffIntersort to the size of the generating network and find that it maintains comparable performance benefits throughout - demonstrating strong scalability to even large-scale problems (as common in biological
Tweet media one
1
0
16