Antoine Bosselut Profile
Antoine Bosselut

@ABosselut

Followers
3,448
Following
605
Media
41
Statuses
1,007
Explore trending content on Musk Viewer
Pinned Tweet
@ABosselut
Antoine Bosselut
9 months
Check out our Meditron-7B & 70B #LLMs adapted for medicine. Test them, break them, and help us find ways to make them better. AI safety only moves forward with open models and community efforts. Don't use MEDITRON in real world apps without further testing and alignment.
@eric_zemingchen
Zeming Chen
9 months
We present MEDITRON, a set of new open-access #LLMs (70B & 7B) adapted to the medical domain, achieving new SoTA open-source performance on common medical benchmarks, outperforming #GPT -3.5 and Med-PaLM, and coming within 5% of #GPT4 Find out how we did this ⬇️
Tweet media one
25
136
608
4
46
245
@ABosselut
Antoine Bosselut
4 years
I’m excited to announce that I’ll be joining the @ICepfl School at @EPFL_en as an assistant professor in Fall 2021! I’m looking forward to working with the students, faculty, and researchers there, and in the broader #EurNLP community.
30
15
323
@ABosselut
Antoine Bosselut
9 months
The next few years are going to be critical for setting the norms for safe deployment and societal integration of AI. We've launched the #SwissAI initiative to meet this challenge.
Tweet media one
3
39
271
@ABosselut
Antoine Bosselut
4 years
I’ll be building up a new #NLProc group at @ICepfl starting in Fall 2021! Apply to the EDIC PhD program if you’re interested in challenges at the intersection of NLP, commonsense reasoning, and knowledge representations.
@ICepfl
EPFL Computer and Communication Sciences
4 years
Antoine Bosselut ( @ABosselut ) has openings for #PhD students in his group. Find out more about his #research at: , and learn more about our @EPFL #EDIC #computerscience PhD program:
Tweet media one
0
4
26
4
48
235
@ABosselut
Antoine Bosselut
3 years
It’s an honor to have been named to the #ForbesUnder30 Europe list in Science & Healthcare. Looking forward to joining @ICepfl @EPFL in a few months and growing research thrusts in #NLProc , knowledge representations, and reasoning.
21
11
169
@ABosselut
Antoine Bosselut
5 years
(1/n) Can machines make commonsense predictions? ☄️COMET☄️can! (). Check out new work from @uwnlp and @allen_ai with Hannah Rashkin, @MaartenSap , @cmalaviya11 , @real_asli , and @YejinChoinka appearing at @ACL2019_Italy
Tweet media one
3
35
151
@ABosselut
Antoine Bosselut
2 years
NEW PAPER ALERT: Many #NLProc systems integrate external commonsense, but do they retrieve relevant knowledge for this integration? Our #EMNLP2022 Findings paper proposes ComFact, a challenging dataset for linking contextually-relevant commonsense to natural language contexts
Tweet media one
1
21
104
@ABosselut
Antoine Bosselut
3 years
I will be taking on new PhD students next Fall. Apply to the EDIC program if you’re interested in challenges at the intersection of #NLProc , reasoning, and knowledge representation. Come work with me, Deniz, and the @ICepfl NLP lab!
@ICepfl
EPFL Computer and Communication Sciences
3 years
The Natural Language Processing Lab is looking for #PhD students. Find out more about Deniz's #research at , and about our world-leading @EPFL #EDIC #computerscience PhD program: @ABosselut
Tweet media one
0
6
27
1
23
96
@ABosselut
Antoine Bosselut
4 years
🙌 👉 @YejinChoinka changed the trajectory of my PhD -- which changed my life!
0
1
68
@ABosselut
Antoine Bosselut
4 years
Hey folks, I'll be presenting a poster on our work "Dynamic Neuro-Symbolic Knowledge Graph Construction for Zero-shot Commonsense Question Answering" at the AAAI poster session this morning and evening (BC-D4-R2).
4
7
69
@ABosselut
Antoine Bosselut
2 years
NEW SOFTWARE: Have you wanted to use #NLProc knowledge models (like COMET), but don't know how to get started? Well, look no more! Our new python toolkit kogito () provides an intuitive and extensible starting point to interact with knowledge models.
2
24
65
@ABosselut
Antoine Bosselut
5 years
My new favorite game: is it motivational quote or a tip for effective reinforcement learning?
@scottbelsky
scott belsky
5 years
Assigning credit is less about rewards, and more about assigning influence for future decisions. Attribution is crucial, but for different reasons than one might think.
2
36
176
1
8
60
@ABosselut
Antoine Bosselut
11 months
Hey #NLProc folks, we're hosting some guest lectures this Fall and we want YOU to present your work. If you're an early-career researcher (PhD or PostDoc or junior research scientist), we want to invite you to EPFL to share your work with us! 1/
1
18
61
@ABosselut
Antoine Bosselut
2 years
Me on a debate show discussing #ChatGPT sounds like an idea straight from ChatGPT! And yet... what a pleasure to have gone on Infrarouge last night to discuss #ChatGPT and #NLProc with @alexisfavre and my esteemed colleagues on the panel.
4
3
55
@ABosselut
Antoine Bosselut
9 months
Come check out our new #NLProc work on CRAB: a new benchmark for assessing whether #LLMs can understanding the causal relationships between events in real-world text. #LLMs still have a long way to go for understanding actual causality in real-world texts.
Tweet media one
4
8
51
@ABosselut
Antoine Bosselut
2 years
Great talk by @gregd_nlp at the #ACL2022 @csrr_workshop highlighting how explicit commonsense explanations produced by language models often end up contradicting themselves
Tweet media one
0
5
50
@ABosselut
Antoine Bosselut
4 years
Hey folks, join us for our AAAI '21 tutorial on Commonsense Knowledge Acquisition and Representation starting now:
2
4
49
@ABosselut
Antoine Bosselut
6 years
Super excited that our workshop on Methods for Optimizing and Evaluating NLG will be hosted at @NAACLHLT 2019. Reviewers were excited about our invited speakers so make sure to come find out why! See you in Minneapolis! #nlg #neuralgen2019 #nlproc
1
12
47
@ABosselut
Antoine Bosselut
6 years
We're putting together a workshop on finding better ways to evaluate, generalize and train NLG! We've got an awesome lineup of agreed speakers (), so if you find it interesting, vote for us in the workshop survey! (check your inbox) #nlproc #neuralgen2019
@uwnlp
UW NLP
6 years
It's workshop survey time! Make sure to check out these workshops being organized by UW NLP this year at ACL/NAACL/EMNLP!
Tweet media one
0
13
26
2
21
47
@ABosselut
Antoine Bosselut
4 years
Not satisfied with his appearance as an extra at my ACL tutorial, Theo (my cat) decided he deserved a full-on cameo this time at AAAI. Maybe he'll improvise some lines next time.
3
0
45
@ABosselut
Antoine Bosselut
3 years
Super excited about this work! A reasoning module with richer interactions between KGs and language representations. Shifted my thinking on commonsense in #NLProc !
@michiyasunaga
Michi Yasunaga
3 years
Excited to share our #NAACL2021 paper "QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering"! Joint work with @ren_hongyu @ABosselut @percyliang @jure @StanfordAILab Paper: Github: Thread below [1/6]
Tweet media one
1
48
187
0
8
46
@ABosselut
Antoine Bosselut
9 months
I'm at #NeurIPS this week to present RECKONING (), our new method for reasoning as meta-learning. Come chat with me about reasoning, #LLMs , Swiss AI (), or becoming a PhD, Postdoc, or Engineer in Switzerland. We're hiring!
1
7
45
@ABosselut
Antoine Bosselut
6 years
First paper in collaboration with @allen_ai accepted to #emnlp2018 : Process Paragraph Comprehension using World Knowledge. Big thanks to Niket Tandon, Bhavana Dalvi, @joelgrus , @scottyih and Peter Clark!
2
3
45
@ABosselut
Antoine Bosselut
5 years
The video for the talk I gave at @WeCNLP 2019 on COMET, a training framework for adapting pretrained language models for knowledge graph construction, is now available: w/ @hjrashkin @MaartenSap @cmalaviya11 @real_asli @YejinChoinka @allen_ai @uwcse
1
6
42
@ABosselut
Antoine Bosselut
10 months
Super excited about @mismayilsoy 's new benchmark CRoW, which measures commonsense reasoning ability in real-world #NLProc tasks (e.g., MT, summarisation, dialogue, etc.). In case you're wondering, #GPT4 scores far lower than humans!
Tweet media one
@mismayilsoy
Mete
10 months
Does your NLP system use commonsense when it matters? Hard to say when we use benchmarks that test models in artificial QA scenarios. We built CRoW🐦‍⬛, a new benchmark that evaluates model commonsense reasoning in real-world tasks where we actually use it 🧵
Tweet media one
1
14
67
1
12
44
@ABosselut
Antoine Bosselut
3 years
Hey folks, I’ll be hosting a #NAACL2021 birds of a feather session on sentence-level semantics and textual inference tomorrow at 6 PT/ 9 ET. Come join us to discuss (and explore collaborations on) sentence representations, compositionality, commonsense, and reasoning!
1
5
39
@ABosselut
Antoine Bosselut
5 years
It's incredible to me how many #NLProc reviews I see giving lower scores to papers because there's "no modeling contribution." Why do we have such a bias for this? Most models end up having little impact on the development of the field in general.
2
4
38
@ABosselut
Antoine Bosselut
9 months
shameless plug for what reasoning in representation space could look like:
@ylecun
Yann LeCun
9 months
Auto-Regressive LLMs have a role to play: turning abstract ideas into token sequences (words, actions, code...). But abstract ideas should be elaborated through planning/reasoning in representation space. AR-LLMs go directly from prompt to answer, skipping the step of reasoning
56
110
970
2
1
36
@ABosselut
Antoine Bosselut
5 years
@gneubig Dangers of sampling!
Tweet media one
5
6
35
@ABosselut
Antoine Bosselut
9 months
What makes #SwissAI special ? We've built up a consortium of 70 PIs across Switzerland, and are partnering with the Swiss Supercomputing Center to use the new Alps cluster with 10k H100s to develop and research AI at scale.
Tweet media one
2
8
32
@ABosselut
Antoine Bosselut
2 years
Proud of the way @EPFL take cares of its students and postdocs! If you're doing #NLProc , come join our lab () if you're interested in doing great research in an amazing place! Still have a week to submit app by Dec 15th!
@TrackingActions
Mackenzie Mathis, PhD
2 years
@kaymtye Update! ETH board and EPFL up the salaries for 2023! 🎉
Tweet media one
1
2
27
0
3
32
@ABosselut
Antoine Bosselut
8 months
If you're teaching an #AI / #NLP / #ML class this winter and need a course project, check out the competition on persona-grounded dialogue that @Sony is running on AICrowd. Your students would develop dialogue / classification models and compete for prizes totaling 35k !
1
2
31
@ABosselut
Antoine Bosselut
1 year
Super pumped about this work from @ZemingChen5 ! A few years back I saw a talk by Hinton distinguishing updates to model activations and model weights as fast vs. slow computations. In that case, maybe model weights could be the engines of System 2 reasoning! Spoiler: they can!
@eric_zemingchen
Zeming Chen
1 year
When reasoning, how should models disentangle useful information from noise? How about mixing it with other memories and seeing what sticks! Our bi-level learning algo, RECKONING, teaches models to reason by encoding context into model weights at inference time.
Tweet media one
2
19
72
1
5
31
@ABosselut
Antoine Bosselut
1 year
Come check out the poster for our #ACL2023 Outstanding Paper, PeaCoK: Persona Commonsense Knowledge for Consistent and Engaging Narratives, presented by @obiwit this morning at 11 AM in the Frontenac Ballroom! Paper:
1
4
29
@ABosselut
Antoine Bosselut
1 year
Learn more about 🦚PeaCoK, our new commonsense knowledge resource that explores interests, traits, and shared experiences of personas! Our resource leads to major improvements on dialogue modeling when shared personas can be identified between speakers and listeners!
@silin_gao
Silin Gao
1 year
NEW PAPER ALERT: Persona interactions are key components in narratives, but do #NLProc systems learn how personas connect with one another? Our #ACL2023 paper proposes PeaCoK, a persona-grounded commonsense knowledge graph that represents world-level persona networks at scale.
Tweet media one
1
14
43
0
8
28
@ABosselut
Antoine Bosselut
1 year
Absolutely thrilled that @silin_gao @obiwit @denizbayazit 's paper: "PeaCoK: Persona Commonsense Knowledge for Consistent and Engaging Narratives" received an Outstanding Paper Award at @aclmeeting #ACL2023NLP
@silin_gao
Silin Gao
1 year
NEWS ALERT: Our paper “PeaCoK: Persona Commonsense Knowledge for Consistent and Engaging Narratives” was selected by #ACL2023 best paper committee for the outstanding paper award! Welcome to see and chat at our two poster sessions during the conference (detailed info below)!
2
5
40
1
6
28
@ABosselut
Antoine Bosselut
4 years
Hey folks, @real_asli and I had a great first QA session for our #EMNLP2020 NLG tutorial! Join us later today with @yangfeng_ji at 5 PM PT for session #2 . Looking forward to your questions!
1
4
25
@ABosselut
Antoine Bosselut
9 months
I'll be giving a talk @BlackboxNLP tomorrow afternoon titled "From Mechanistic Interpretability to Mechanistic Reasoning". Come find out how we can discover and manipulate subnetworks (circuits ?) in #LLMs to modify model behavior.
@BlackboxNLP
BlackboxNLP
9 months
Only 2 more days until BlackboxNLP gets started! Have a look at the schedule, it's filled to the brim with exciting interpretability research🤩
Tweet media one
0
5
26
0
1
26
@ABosselut
Antoine Bosselut
9 months
Thanks for highlighting our #NLProc + #LLM + #neuroscience work! @bkhmsi will be @NeurIPSConf #NeurIPS2023 presenting this work in the @itif_workshop & UniReps workshops. Also, 1st author @Khai_Loong_Aw is looking for PhD programs this winter. Snatch him up while you can!
@_akhaliq
AK
9 months
Instruction-tuning Aligns LLMs to the Human Brain paper page: Instruction-tuning is a widely adopted method of finetuning that enables large language models (LLMs) to generate output that more closely resembles human responses to natural language
Tweet media one
3
45
219
0
2
23
@ABosselut
Antoine Bosselut
9 months
Check out our #NLProc paper on whether multilingual #LLMs can solve reasoning problems when information is provided in multiple languages. Super important for democratising NLP globally! Published in Findings and to be presented at #EMNLP2023 .
@negarforoutan
Negar Foroutan
9 months
Do multilingual language models (MultiLMs) have what it takes to reason across languages? Our #EMNLP2023 #NLProc paper proposes a new attention mechanism that considerably improves the cross-lingual generalization of MultiLMs!
Tweet media one
3
23
142
0
1
24
@ABosselut
Antoine Bosselut
3 years
Looking forward to giving a talk and discussing new ways of integrating structured knowledge into neural networks at #kinn2021 #cikm2021 this Fall! #NLProc
@sandyasm
sandya mannarswamy
3 years
0
7
26
0
2
23
@ABosselut
Antoine Bosselut
3 years
just searched for a document safe on galaxus (swiss amazon) and got a bunch of paper shredders as return results. I'm not sure whether this is too little or too much commonsense
0
0
23
@ABosselut
Antoine Bosselut
2 years
The EPFL #NLProc lab is hiring a postdoc in the areas of multimodal language and vision systems and open domain QA. Apply here: Preferred start date: Aug 1st
0
10
22
@ABosselut
Antoine Bosselut
9 months
If you want to do #NLProc #LLMs and #AI research at scale, come join us in Switzerland! We've got great resources, lots of compute, high salaries, and beautiful mountains! Perfect place to do a PhD, postdoc, or whatever else your next chapter is!
1
4
19
@ABosselut
Antoine Bosselut
3 years
Check out our tutorial at #AAAI2022 on neuro-symbolic methods for #NLProc and computer vision. I'll be talking for ~50 minutes on aligning knowledge graphs with neural NLP systems!
@hmd_palangi
Hamid Palangi
3 years
We will be presenting a tutorial at AAAI 2022 about Neuro-Symbolic Methods for Language and Vision on Feb. 23 from 9 AM - 12 PM (PST), if you are attending AAAI please stop by: @ABosselut @pdasigi
1
2
15
1
3
21
@ABosselut
Antoine Bosselut
2 years
Join us at the #acl2022nlp Commonsense Representation and Reasoning Workshop. We'll be starting at 9 AM with a talk by @megamor2 on "Debugging Transformer Language Models Inside Out" #NLProc #CSRR
0
2
21
@ABosselut
Antoine Bosselut
1 year
Hey #NLProc folks, we still need some emergency reviewers for the #EMNLP2023 Commonsense reasoning track. Reach out if you'd be interested in being an emergency reviewer for papers in the track. Thanks!
4
11
20
@ABosselut
Antoine Bosselut
9 months
That's right folks -- back in action for one night only! Come hear me talk about #LLM reasoning through parameter updates.
@eric_zemingchen
Zeming Chen
9 months
Check out our #NeurIPS2023 paper, RECKONING, on reasoning as meta-learning. I am unable to attend due to visa issues, but my amazing advisor @ABosselut will present the poster! Time: Wed 13 Dec 5 p.m. CST — 7 p.m. CST Location: Great Hall & Hall B1+B2 (level 1)
1
3
21
0
3
19
@ABosselut
Antoine Bosselut
1 year
Also #NLProc folks, if you're late with your reviews, TELL YOUR ACs! There's a HUGE difference between having a late review... and not completing it. Might feel awkward to tell them, but they'll be so much happier than to have to recruit emergency reviewers for your papers!
0
8
33
@ABosselut
Antoine Bosselut
4 years
I’ll be at @emnlp2020 virtually in a week so feel free to shoot me a message if you’re interested in learning more about the program! I encourage EVERYONE to apply, particularly if you come from a non-traditional background!
0
1
18
@ABosselut
Antoine Bosselut
3 years
Our @EPFL #NLProc lab is hiring a joint postdoctoral researcher with Prof. Tanja Käser of the @ICepfl ML4Education Lab in the areas of NLP, IE, KGs, and digital economics. Check out our job posting here: Please share and RT!
0
3
17
@ABosselut
Antoine Bosselut
9 months
Check out our: Paper: Code: Distributed trainer: Huggingface hub:
0
2
17
@ABosselut
Antoine Bosselut
4 years
Starting back up again for round 2! Also, Theo will be presenting!
Tweet media one
@ABosselut
Antoine Bosselut
4 years
Hey folks, I'll be presenting a poster on our work "Dynamic Neuro-Symbolic Knowledge Graph Construction for Zero-shot Commonsense Question Answering" at the AAAI poster session this morning and evening (BC-D4-R2).
4
7
69
0
1
17
@ABosselut
Antoine Bosselut
1 year
Super excited about @obiwit 's #NLProc opinion piece on unifying feedback for LLMs like #ChatGPT and #GPT4 with the rich literature on feedback from the learning sciences. Joint work with Tanja Kaeser ( @ICepfl ) and Niket Tandon ( @allen_ai @ai2_aristo )
@obiwit
Beatriz Borges
1 year
What makes good natural language feedback for #LLMs like #chatgpt ? Maybe the same things as for humans! In this paper, we systematize the textual feedback space, by grounding it on human learning and then adapting it for NLP. #NLProc #rlhf
Tweet media one
1
10
64
0
5
17
@ABosselut
Antoine Bosselut
5 years
Check out our new #emnlp paper on counterfactual reasoning in narrative generation! New dataset for testing whether models understand how counterfactual situations alter future events in a story! Joint work between @allen_ai and @uwnlp
@Lianhuiq
Lianhui Qin
5 years
What if Harry Potter had been a Vampire? Our @emnlp2019 paper, “Counterfactual Story Reasoning and Generation”, presents the TimeTravel dataset that tests causal reasoning capabilities over natural language narratives.1/2 Paper: from @uwcse and @allen_ai
Tweet media one
2
36
117
0
3
16
@ABosselut
Antoine Bosselut
3 years
I'll be giving a talk today at the Stanford Graph Learning Workshop on NLP applications. Come learn how knowledge graphs can be used to scaffold commonsense representation and reasoning. #NLProc Livestream: Program:
1
3
16
@ABosselut
Antoine Bosselut
4 years
I’ll be hiring PhD students, so If you’re interested in the intersection of #NLProc and knowledge representations, apply to @ICepfl this Fall to work with me!
2
2
16
@ABosselut
Antoine Bosselut
3 years
Thrilled to be launching this collaboration with @devistuia on using #NLProc to generate knowledge-guided explanations for earth observation imagery! If you're interested in multimodal, open book NLP, reach out! We'll be hiring in these exciting areas!
@devistuia
devistuia
3 years
Happy to start a fantastic project at the interface of #EarthObservation and #NLP together with the great @ABosselut !
1
3
20
0
4
14
@ABosselut
Antoine Bosselut
6 years
Check out our workshop at co-located with NAACL 2019! Great speakers, great topics, great OC/SC ( @ukhndlwl @gh_marjan @sriniiyer88 @real_asli @Thom_Wolf Hannah Rashkin @dilekhakkanitur @YejinChoinka @jurafsky @harvardnlp ). Look forward to seeing you there!
@Thom_Wolf
Thomas Wolf
6 years
A workshop on novel methods for training & evaluating language generation models 📣First Call for Papers Submission deadline: 11 March 2019 Even if you can't submit you'll probably want to come enjoy our amazing panel of speakers (to be confirmed soon)👇
Tweet media one
1
22
68
0
5
15
@ABosselut
Antoine Bosselut
3 years
Super exciting to see these lectures be made publicly available! It was a lot of fun to teach the NLG lecture last winter. #NLProc
@stanfordnlp
Stanford NLP Group
3 years
Looking for a series to binge-watch with more depth? We are delighted to make available the latest CS224N: Natural Language Processing with Deep Learning. New content on transformers, pre-trained models, NLG, knowledge, and ethical considerations. #NLProc
Tweet media one
1
42
182
0
1
15
@ABosselut
Antoine Bosselut
9 months
Come check out @bkhmsi & @Khai_Loong_Aw 's poster: "Instruction-tuning Aligns LLMs to the Human Brain" at the: - Instruction Tuning Workshop @ 1 PM - UniReps Workshop @ 3 PM
Tweet media one
1
0
15
@ABosselut
Antoine Bosselut
1 year
#ICML2023 is over, so join us @EPFL for the biggest event on #GenAI this summer! We brought together @ev_fedorenko @egrefen @jefrankle @kchonyc Angela Fan @danielrock @drnigam @EPFL_CREATE @IoanDragosT & more for two days of talks on the outlook of GenAI!
@ICepfl
EPFL Computer and Communication Sciences
1 year
AMLD is back this summer with a hot topic: Generative AI! Join us for an exclusive event and the opportunity to meet with high profile experts at this pivotal moment of the AI Generative wave. Get your tickets now!
Tweet media one
0
15
25
0
4
15
@ABosselut
Antoine Bosselut
6 years
Noam Shazeer telling me things I've always known about myself.
Tweet media one
0
0
14
@ABosselut
Antoine Bosselut
2 years
The #ACL2022 #CSRR workshop is coming back from the break with a second talk by Marie-Francine Moens of KU Leuven on "Can We Build a Machine That Has a Commonsense Memory?"
1
0
14
@ABosselut
Antoine Bosselut
2 years
Come check out @negarforoutan 's poster today at 11 AM ! #NLProc #EMNLP22
@negarforoutan
Negar Foroutan
2 years
Do multilingual language models (MultiLMs) learn different languages using the same subset of parameters? In our #EMNLP2022 #NLProc paper, we show that MultiLMs are composed of language-neutral representations that jointly encode multiple languages.
Tweet media one
1
13
85
0
1
14
@ABosselut
Antoine Bosselut
4 years
Until then, I'm thrilled to be spending a year working with @chrmanning and @jure , and the @stanfordnlp and SNAP groups.
0
0
13
@ABosselut
Antoine Bosselut
2 years
Hey #NLProc folks, EPFL has an open call for faculty positions this year! It's not too late to apply, so come join us in Switzerland! If you're at EMNLP next week and want to learn more, come find me!
0
2
11
@ABosselut
Antoine Bosselut
6 years
and once you get it to work, you find out your rewards weren't correlated enough with the behavior you actually wanted to encourage, so the model's just learned to gather it without doing anything better... #RL
@haldaume3
Hal Daumé III
6 years
hah, Sergey Levine, after teaching Reinforce, ended w sth like "if u try this algorithm as is, it probably won't work on anything, even grid world." oh how i wish someone'd told me that ~2010 when we wasted so much time cuz this was not obvious from literature :( #dlrl2018
1
27
204
1
3
11
@ABosselut
Antoine Bosselut
3 years
Our application review will begin next week! Apply soon:
@ABosselut
Antoine Bosselut
3 years
Our @EPFL #NLProc lab is hiring a joint postdoctoral researcher with Prof. Tanja Käser of the @ICepfl ML4Education Lab in the areas of NLP, IE, KGs, and digital economics. Check out our job posting here: Please share and RT!
0
3
17
0
9
12
@ABosselut
Antoine Bosselut
3 years
Really excited to organize this a second time around! We've got great speakers lined up from psychology, neuroscience, and of course, #NLProc ! Survey is long, but if you're just trying to express interest in our workshop, all you gotta do is scroll down to the bottom.
@VeredShwartz
Vered Shwartz
3 years
After a successful CSKB earlier this month (), we submitted a proposal for a second iteration during one of the 2022 *CL conferences. If you'd be interested in attending our commonsense workshop, please indicate that in this survey:
0
7
38
0
0
11
@ABosselut
Antoine Bosselut
2 years
Come join the #NLProc lab at @ICepfl () to work on developing natural language agents that understand world knowledge!
@ICepfl
EPFL Computer and Communication Sciences
2 years
Antoine Bosselut is looking for #PhD students. Find out more about @ABosselut 's #research at and our world-leading @EPFL #EDIC #computerscience PhD program:
Tweet media one
0
1
27
0
3
11
@ABosselut
Antoine Bosselut
3 years
Missed opportunity for the YODA model name!
@arankomatsuzaki
Aran Komatsuzaki
3 years
Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little MLMs pretrained on sentences with randomly shuffled word order surprisingly achieves high accuracy after fine-tuning on many downstream tasks.
Tweet media one
10
46
298
1
0
11
@ABosselut
Antoine Bosselut
3 years
Just saw some papers in the AAAI Fast Track that I bid on as an ICLR AC earlier this week. Please don't do this. Both conferences have clear dual submission policies and reviewing is already overloaded.
2
0
10
@ABosselut
Antoine Bosselut
2 years
Thanks to my amazing student @silin_gao for leading this project, collaborators @JenaHwang2 @allen_ai and Saya Kanno, Hiromi Wakaki & @mittu1204 @Sony R&D for their support! Paper: Code&Models: EPFL NLP Lab:
0
1
10
@ABosselut
Antoine Bosselut
5 years
@gneubig not a bad distillation of a cat!
1
0
9
@ABosselut
Antoine Bosselut
5 years
(3/n) In our paper “COMET☄️: Commonsense Transformers for Automatic Knowledge Graph Construction”, we cast this problem as KG construction and propose a framework that uses transformer language models to generate high quality novel KG nodes given a seed node and a relation to it
Tweet media one
Tweet media two
1
3
9
@ABosselut
Antoine Bosselut
3 years
@nlpnoah "never let the truth get in the way of a good model name" -- mark twain
0
0
9
@ABosselut
Antoine Bosselut
3 years
Check out @dallascard if you're applying to PhD programs for #NLProc / ML! I shared an office with him for three years ( #thefunoffice ), so I'm a bit biased, but he's the advisor you'll want on both the good and bad days.
@dallascard
Dallas Card
3 years
I'm really looking forward to reading PhD applications for @umsi ! If you're interested in historical or political text, the cultures and practices of science, or the societal impacts of machine learning, please consider applying by December 1st!
3
30
132
0
3
9
@ABosselut
Antoine Bosselut
5 years
(11/n) Conclusion: Large language models learn implicit relationships between concepts when pretrained on large scale corpora. Train the model on a seed knowledge graph and it can adapt to produce knowledge with the explicit relations and structure you want!
1
2
9
@ABosselut
Antoine Bosselut
5 years
Naming your model MAGiC is one of the funnier things you can do when giving a ML talk "We use Magic to..." "Magic can..." so many more great moments...
2
0
9
@ABosselut
Antoine Bosselut
3 years
Mentor-mentee matches for the ACL 2021 ( @aclmeeting ) Review Mentoring program have been sent out. Mentees should have received an e-mail (from me) introducing you to your mentor. *Make sure to check your spam folders!*
1
0
9
@ABosselut
Antoine Bosselut
4 years
If you've been wanting to experiment with GNNs in your research, @youjiaxuan has created a new library that lets you deploy and test quickly!
@youjiaxuan
Jiaxuan You
4 years
We are excited to release #GraphGym , a platform for designing and evaluating #GraphNeuralNetworks . It provides a modularized pipeline, a system for launching thousands of experiments, and more! Code: Paper: #NeurIPS2020 Spotlight
4
50
232
1
0
8
@ABosselut
Antoine Bosselut
6 years
Cool result! But we're in an arms race for AI model names. No one gets to claim "BigBird" for fine-tuning BERT on a new task! #NotBigBird #JustBERT
@etzioni
Oren Etzioni
6 years
BigBird (built on BERT) gets 93.84% on @allen_ai 's #SciTail dataset. See: You can't make this stuff up... #SeasmeStreet
2
32
101
2
0
8
@ABosselut
Antoine Bosselut
2 years
How do we build ComFact? We sample natural language contexts from four diverse corpora and crowdsource ~293K contextual relevance annotations on fact candidates sampled from a commonsense KG
Tweet media one
1
1
7
@ABosselut
Antoine Bosselut
5 years
@emilymbender I don't think "most sheep are black" is mentioned in the paper, but the reporting bias citation I usually use is: Gordon, J., & Van Durme, B. (2013). Reporting bias and knowledge acquisition. In Proceedings of the 2013 workshop on Automated knowledge base construction. ACM.
1
0
7
@ABosselut
Antoine Bosselut
5 years
(4/n) The key idea is that transformer language models learn commonsense knowledge when trained on large-scale corpora. By finetuning on a seed set of knowledge tuples, the knowledge is extractable in the right structure for downstream application or representation
1
1
7
@ABosselut
Antoine Bosselut
9 months
Come check out @agromanou 's #EMNLP2023 poster tomorrow (12/9) at 9 am !
@agromanou
Angelika Romanou
9 months
Do LLMs understand causality between real-world events? In our #EMNLP2023 #NLProc work, we create 🦀 CRAB, a challenging benchmark to assess LLMs causal reasoning abilities. Join the poster session tomorrow, 09 Dec @ 9:00, to find out more! 🚨 SPOILER ALERT: they don't do well
Tweet media one
0
14
31
0
0
7
@ABosselut
Antoine Bosselut
2 years
And we're back at the #ACL2022 #CSRR workshop for our afternoon session. Ev Fedorenko ( @ev_fedorenko ) is here to tell us about "The language system in the human brain"
0
0
7
@ABosselut
Antoine Bosselut
11 months
Possible (though not comprehensive topics): data understanding, training at scale, ethics in NLP, retrieval & tool augmentation, interpretability & alignment, and many more Fill out the following form until October 1st: 2/ Please share!
1
0
6
@ABosselut
Antoine Bosselut
11 months
@PanLiangming Cool work! We showed something quite similar for fact-checking a while back:
@yibingdu
Yibing Du
2 years
Do automated fact-checking systems for combatting online misinformation have critical vulnerabilities? Check out our #AAAI2022 paper: Synthetic Disinformation Attacks on Automated Fact Verification Systems (). Work with @ABosselut @chrmanning @stanfordnlp
Tweet media one
3
13
66
1
0
6
@ABosselut
Antoine Bosselut
5 years
@sleepinyourhat whichever one my family prefers to vacation in for a week after
0
0
6
@ABosselut
Antoine Bosselut
5 years
Check out the paper () for more details and more results, and play with the code at 9/
1
2
6
@ABosselut
Antoine Bosselut
5 years
And if the advancements of the last year (ELMo, GPT, BERT, etc.) taught us anything, it's that task-specific models are very easy to overtake by task-agnostic generalizable approaches. So why do we insist on having these as contributions come review time?
1
0
6