David Picard
@david_picard
Followers
3,169
Following
331
Media
713
Statuses
9,713
Computer Vision/Machine Learning research @ImagineEnpc / LIGM, École nationale des Ponts et Chaussées. Music & overall happiness 🌳🪻 Born well below 350ppm
Joined November 2009
Don't wanna be here?
Send us removal request.
Explore trending content on Musk Viewer
Flamengo
• 273084 Tweets
Beyoncé
• 265560 Tweets
sabrina
• 153176 Tweets
#DNC2024
• 150926 Tweets
Cruzeiro
• 121122 Tweets
京都国際
• 111952 Tweets
#DNCConvention2024
• 110707 Tweets
#NCTDREAM_RainsinHeaven
• 92328 Tweets
Román
• 85861 Tweets
Rossi
• 70646 Tweets
#ShortNSweet
• 61942 Tweets
Adam Kinzinger
• 55676 Tweets
7DREAM ENGLISH SINGLE OUT NOW
• 52147 Tweets
Advincula
• 47089 Tweets
Yachty
• 46873 Tweets
甲子園決勝
• 43080 Tweets
Riquelme
• 42924 Tweets
関東第一
• 42500 Tweets
renjun
• 39561 Tweets
#KamalaHarris
• 39445 Tweets
Romero
• 35224 Tweets
Merentiel
• 34550 Tweets
ラストマイル
• 32382 Tweets
タイブレーク
• 27103 Tweets
Kemp
• 23704 Tweets
교토국제고
• 21570 Tweets
夏の甲子園
• 20777 Tweets
Figal
• 20481 Tweets
Ayrton Lucas
• 20024 Tweets
Vignolo
• 18490 Tweets
Cassio
• 17683 Tweets
Carlinhos
• 16815 Tweets
Leon Panetta
• 14785 Tweets
Gerson
• 14661 Tweets
ハングル校歌
• 13905 Tweets
関東一高
• 13882 Tweets
韓国語の校歌
• 12664 Tweets
Big Gretch
• 10566 Tweets
Pinned Tweet
🎨We updated the demo, you can try your favorite text2image prompts:
Be gentle: it's a tiny model by image generation standards (300M params) trained from scratch on a ridiculously small dataset (20M img+txt pairs), so it doesn't have high def capabilities
🚨Don’t drop your samples! Coherence-aware training benefits Conditional diffusion
@CVPR
2024 Highlight with
@nico_dufour
@victorbesnier1
and
@VickyKalogeiton
📜
📄
🤖
Demo&models coming soon!
detailed🧵👇
1
12
59
2
6
16
Research in computer vision at the moment is crazy fast. You discuss a problem with your colleagues, find shortcomings in the literature and a way to address them, flesh out a plan, and 5 days later there are already 2 papers appearing on arxiv that do exactly what you wanted.
11
34
531
"torch.manual_seed(3407) is all you need"!
draft 📜:
Sorry for the title. I promise it's not (entirely) just for trolling. It's my little spare time project of this summer to investigate unaccounted randomness in
#ComputerVision
and
#DeepLearning
.
🧵👇 1/n
7
83
407
Please
@OpenAI
change your name ASAP. It's an insult to our intelligence to call yourself "open" and release that kind of "technical report" that contains no technical information whatsoever.
11
36
378
Folks, I'm furious🤬and need to vent. I have this paper that has been in rejection hell for a year and it needs some love🥰
If you're in retail/image search, it could have major impact on your business.
I'll explain it👇and then rant on bad reviews.
📜:
14
41
378
@TaliaRinger
Says a lot about training data leaks. And to think of all the personal information that people are feeding to online chatbots for free...
1
0
235
Grad student presenting a new research project vs full prof presenting a new research project...
3
9
188
Just put online my
#MachineLearning
course at
@EcoledesPonts
!
It's not very different from the bazillion that already exist, but it's mine! 🥰
Also, it's all python notebooks cause I want to show actual implementations and not just fancy figures. 🤖
2
26
159
Wow! Looking at other reviews, I'm impressed by the nastiness of my fellow reviewers for
#ICCV2021
. So many "strong rejects" that are "very confident" and particularly aggressive. Chill out, it's not the end of the world if you don't like that paper!
6
2
156
Wondering how to detect when your neural network is about to predict pure non-sense in a safety critical scenario?
We answer your questions in our
#ICCV2021
@ICCV_2021
paper!
Thursday 1am (CET) or Friday 6pm (CET), Session 12, ID: 3734
📜
Thread 🧵👇
1
19
116
Mark this day in your journal, this is one that will be still taught in history books a 100 years from now...
#OilCrash
2
34
95
@MetaAI
Impressive work! Is it able to lose friends at the same rate humans do while playing the game? 😁
2
0
98
Stop believing that research is about coming up with the most convoluted system. It's not.
Research is about asking and answering questions. Practical or theoretical questions.
Go back to your local science fair to present your Frankenstein engineering shit, and stop reviewing.
3
7
97
Let's make sure we have some space reserved for some rich people's kids. That's an important demographic that really needs some help.
NeurIPS 2024 will have a track for papers from high schoolers.
79
90
598
0
5
94
So happy to finally be able to talk about this paper "Unveiling the Latent Space Geometry of Push-Forward Generative Models" with
@TIssenhuth
,
@ugotanielian
and
@JeremieMary
To me, it's an important paper, because we show that analysis and synthesis are linked.
🧵⬇️ (ICML'23)
1
24
93
Imagine you want to compare to a SotA method published at the latest major computer vision conference, but there is not implementation of their code. So you email the authors for tips to reproduce their results and they answer "Read the paper carefully".
What do you do? 🤬
26
1
85
@ykilcher
It's not a even a paper. It doesn't describe the model, it doesn't describe de data, it doesn't even mention the compute used...
What knowledge do researchers even gain from this? Nothing. It's super frustrating.
3
2
83
"7.7M GPU hours of computation on hardware of type H100-80GB (TDP of 700W)"
That's 5.4GWh. That's 6 hours of an entire nuclear reactor. AN ENTIRE NUCLEAR REACTOR.
And you know what, this is just the beginning. So long for frugality...
10
15
82
What's annoying with CVPR rejects, is that you're guaranteed to find a dozen accepted papers on the same subject that are just really uninteresting at all, with nothing exciting, limited results and mediocre intellectual qualities. But hey, the viz are nice and the names famous!
4
2
77
Long overdue extension of our ICCV'21 paper on out-of-distribution detection for semantic segmentation to objects. Work by
@victorbesnier1
with
@abursuc
.
We extend OOD to panoptic segmentation!
📜
mini 🧵1/4
1
12
66
Few bits of advice if it's your first time in Paris for
#ICCV2023
:
1. Take the metro, it's the fastest transport mode and the weekly card is cheap. How far is it? Count the number of stations, multiply by ~1.5-2, that's the number of minutes it will take.
2
15
67
architecture nobody did before, you're not doing research, you're doing shitty-ass undergrad engineering.
Research is about gaining knowledge, not frankenstein-ing whatever combination of hot tools that nobody has done before and tinkering with is until is gains 1% by pure luck.
1
2
65
So you see, this is exactly what computer vision research WAS NOT INTENDED FOR.
Please make cool apps instead of lousy money grab dystopian crap.
This coffee shop uses AI to track the productivity of baristas and how much time customers are spending in the shop.
The NeuroSpot Barista Staff Control and Customer Monitoring Video Analytics Module, are tools designed to enhance the efficiency and
1K
937
5K
5
8
66
How is it that nobody is interested in out-of-distribution detection for semantic segmentation?
- It has important practical applications
- The SotA is kinda low
Come on folks! It's a low hanging fruit. Download our code and beat us, it's easy:
#CVPR2022
3
6
63
Today is SVM and Kernels lecture day, one of my favorite days!
Kernels don't get enough love, they deserve much more. Even if you don't use them, they give excellent insights to the properties of any learning machine.
Just put online my
#MachineLearning
course at
@EcoledesPonts
!
It's not very different from the bazillion that already exist, but it's mine! 🥰
Also, it's all python notebooks cause I want to show actual implementations and not just fancy figures. 🤖
2
26
159
1
8
59
🚨Don’t drop your samples! Coherence-aware training benefits Conditional diffusion
@CVPR
2024 Highlight with
@nico_dufour
@victorbesnier1
and
@VickyKalogeiton
📜
📄
🤖
Demo&models coming soon!
detailed🧵👇
1
12
59
So the Gemini paper () has 941 authors.
We are now well into the "CERN era" of AI development. Labs from public universities will need to either organize big networks, or focus on tabletop experiments...
8
4
57
Please stop with AGI. It's nowhere near a threat as big as climate change.
6
5
57
Let's do a "collaborative science experiment" for
@icmlconf
!
I have a project replacing MHA with high order moments:
I'm training a ViT-like (⬇️), but I want to do more than that.
Who wants to help turn it into an ICML sub? (DM, gh issues, email and RT🙏)
9
13
56
@skdh
The real question is how high can we go with the currently known fossil fuel reserves. Might be an interesting video.
15
0
55
@mtutek
Well, and I kid you not, I ran into this sort of code while reviewing a paper that had provided source code in the supplementary to reproduce the results.
To be fair, it did reproduce the scores written in the paper 🤣🙄
1
0
52
🚨Early preprint worth sharing!
If you're using diffusion models with classifier free guidance, we have a 1 line modification to improve your results
📜:
🤖: No git yet, but It's 1 line. I expect someone will add it to
@huggingface
diffusers at some point
Classifier-free guidance has been crucial in recent advancements in content generation, trading diversity for fidelity. However, can you get a better deal in this trade-off?
With a simple modification, you can get more diversity while keeping a higher level of details!
3
30
120
0
5
51
So apparently, I'm an outstanding reviewer for
#NeurIPS2021
which I should be happy and proud about, but I'm a bit worried too. I couldn't put in the effort I think they require (burnt out probably) and had I received such reviews myself, I would have thought "OK, but not great".
4
2
50
This work has seen 15 reviewers in a year, and 90% of them rejected the paper for the same reason: lack of novelty.
"BuT YoU hAvE OnLY a SimPLe ViT wiTh ConTrAsTiVE LeArNinG!"
Guys, you are just stupid, and toxic. If you think research is coming up with a complex ...
11
1
49
🎉Super happy for "Triggering Failures: Out-Of-Distribution detection by learning from local adversarial attacks in Semantic Segmentation" with Victor Besnier and
@abursuc
to be accepted
@ICCV_2021
! One step towards safer autonomous driving 🤖🚗 More details/ paper/code soon! 😎
2
12
48
Hot take: Constrained scientific writing (like a 1 page rebuttal) introduces a massive disadvantage for non-native English speakers - unfair IMHO. LLMs like ChatGPT are finally getting rid of that and put everybody on the same level w.r.t. writing skills.
5
7
45
Bonjour
@Interieur_Gouv
, notre système de visa marche tellement bien qu'une scientifique en IA de renommée internationale, récemment primée par l'ERC, ne peut même pas venir 10 jours pour présenter ses travaux à une conférence prestigieuse.
Une idée pour améliorer notre image ?
I still don’t have a visa for ICCV. let’s keep telling ourselves how inclusive we are.
the summer I got 3 papers and an ERC and still wasn’t allowed in Europe.
if you read this and think I deserve this because I want to live in the same country as my family, just unfollow me.
5
28
406
1
12
44
Can we do the same for CV? Authors of TPAMI papers get to present their work at CVPR/ICCV and authors of IJCV papers get spots at ECCV?
What can I do to make that happen? I'm volunteering to put this system in place.
We (
@BeEngelhardt
,
@NailaMurray
and I) are proud to announce the creation of a Journal-to-Conference track, in collaboration with JMLR and conferences NeurIPS 2022, ICLR 2023 and ICML 2023!
18
210
1K
3
3
48
Tomorrow is the last day at
#ICCV2023
, if you're looking for opportunities in France with me or with the amazing people of my lab - PhD level, postdoc, young researcher - try to catch me and I'll find time to discuss.
I'm easy to recognize, if you can find a recent enough photo.
2
12
47
🚨 We've released a large number (15+ 😲) of pretrained models for this paper! Both for creating the dataset and for whole-body 3D pose estimation.
Just in time for your
@CVPR
#CVPR2024
submission! Boost your results with 3D whole-body!
Links on github:
🚨What about doing 3D pose estimation, but with the 133 keypoints of the COCO whole-body layout?
We have a cool poster with Yue Zhu and
@nemka_
Friday PM at N018. I'll show the many good tricks in the long 🧵 below.
💻
📜
1/12
1
3
29
0
7
45
More stunning views! If you're looking for a place to do graduate studies in computer science, you should definitely add Grenoble on your map. The research environment is excellent, and I can recommend you many advisors who will give you the best experience you can ever hope for.
4
4
46
3 times as many authors as there are reviewers. This is obviously a problem, but how do we solve it?
#ICCV
13
2
44
The idea is simple: after years of reviewing deep learning stuff, I am frustrated of never seeing a paragraph that shows how robust the results are w.r.t the randomness (initial weights, batch composition, etc). 2/n
1
2
45
@BertozziRoger
@colinlebedev
Tout le monde a le droit d'exprimer son avis, aussi crétin soit-il. Ce qui est pénible, c'est l'utilisation de l'étiquette "universitaires et chercheurs" pour donner un argument d'autorité. C'est d'autant plus pénible quand on est soit-même chercheur. C'est une mauvaise pratique.
1
1
44
@ykilcher
"Grassroots acceptance of a paper by the community" means "the one with the biggest marketing budget takes all" like in art. Science != popularity. Making something that appeal to a lot of people doesn't make it true or even relevant, or we would all still be studying the aether.
4
0
43
1
4
43
This session was the worst I have ever experienced both as an author and as a reviewer. I got 144 notifications from openreview in 15 days. 144. In the middle of August.
3
2
41
Reviewing currency idea:
- New accounts get 3 tokens
- Any submission requires 3 tokens (all authors can contribute any amount)
- Reviewing 1 paper earns 1 token, subject to quality approval from the AC
If you want to submit past your 1st, you have to produce quality reviews.
2
4
41
Things I discovered on Monday
@CVPR
: Now I really want David Forsyth to narrate my life with the voice-over of God coming from everywhere at the same time, as I do my daily activities. With the echo of course.
2
3
40
@jbhuang0604
Here is my only advice to early career researcher and students: Do something you like a lot with people you like a lot, and nothing else. Your chances of having a good career by doing something you don't like with people you don't like are tiny to the point of being negligible.
1
2
40
Please don't do that. I know you're excited, and I'm excited for you too. But this is something you can enjoy without screaming and annoying everybody. Instead, just raise your glass and press F for all the fallen brothers and sisters.
1
0
40
Everybody complains about deep neural networks being over-confident at rejecting good samples, but have you read
#NeurIPS2023
reviews made by humans?
Joke aside, I sense a strong correlation for reviews with a confidence of 5 being total garbage.
2
0
40
From now on, I'm going to strong reject any paper that doesn't have a clear scientific agenda (question, hypothesis, method, experimental validation), and I don't care if you gain X% compared to SOTA. It's made up by grinding your luck anyway.
I've been way to lenient on that.
4
0
38
If you think a CVPR publication is highly valuable because the acceptance rate is low*, think about this: there are only ~250 outstanding reviewers out of more than 7000 reviewers. It requires way more skills to be a excellent reviewer than an author.
* You shouldn't, btw.
2
3
37
@CSProfKGD
This year's ICLR has so much drama. This one is special because the review contains nothing about the content of the paper (whether it's correct, novel or impactful), but only cares about the paper containing the word "byzantine". I think it's a first?
0
0
38
R1: "The paper is well structured and easy to follow."
R2: "The paper is poorly written and organized."
🤷♂️
What's your opinion, R3? Speak now or (we) forever hold your piece!
3
1
37
Folks, this is the project you want to contribute to! It's 🔥
Simple: you fork, add you stuff (models, training and evaluation scripts, notebook, whatever), send a PR and I merge.
And we all do good collaborative open science!
github:
First contrib merged! Thanks
@krasul
!
It's tackling probabilistic time series forecasting, and it seems initial results are not bad at all.
1
1
3
3
13
36
Here is a nice sunflower from the garden while waiting for ICCV.
2
0
37
@LBantigny
En Saxe? Sachsen? Pas les autres saxes, hein? Parce-que le résultat des élections européennes en Saxe ne me donnait pas exactement l'impression d'une baisse de l'extrême droite.
5
0
36
@fhuszar
Here's an ablation performed by on of my PhD student (N. Luka) about 2 years ago, unpublished, but gives you an idea about what components matter or not. Bottom line: the attention has to sum to one, and that's all.
5
4
35
@CSProfKGD
It's just allocating resources to rich kids. If the goal is a social one, we ought to do better. Past CV conferences had high schoolers visit the conference and that was great. Having a dedicated track is just giving a trophy that reinforces inequalities.
1
1
36
This guy is the absolute best. Not all is hopeless with humanity when you see this.
#Communiqu
é 🗞️ L’Académie norvégienne des sciences et des lettres attribue le
#AbelPrize2024
au Français Michel Talagrand, qui a effectué sa carrière de chercheur au
@CNRS
. 👏
👉
#AbelPrize
#TalentsCNRS
🏆
@abel_prize
@CNRS_INSMI
12
226
562
0
2
34
@jbhuang0604
Just like A+ conferences have a 99% acceptance rate and everybody moves to a big company with a 6 figures salary.
Isn't that a perfect world?
1
1
35
Here's a conjecture of mine: "If a deep neural model has a high enough number of parameters, it tends to memorize the training set, but for large training sets, memorization is very effective at solving the task."
Every day of work makes me a bit more convinced this is true.
4
4
34
I don't buy the "brains are more energy efficient than silicon computers, they only use 20W!!1!"
How many joules does a brain need to compute the SVD of a 4000x4000 matrix? Pretty confident it's way more than a computer.
They're different tools optimized for different purposes.
In this week's science news: computers made of human brain cells, galaxies that are too big to exist, what the Milky Way’s black hole is having for dinner, Google’s second milestone on the way to quantum computing, and more
15
30
162
5
3
34
👏 These are real heroes of the conference! If you see any on the job market, close your eyes, relax, and make an offer. These reviewer awards are a much less noisy signal then any publication track record.
Well done and congrats to this year's awardees!🥂
1
1
35
@ylecun
Ah! I really love this old '88 paper about the Lagrangian view of backprop. I've used its ideas many time for the final exam of my ML course, which most of the students find (surprisingly) easy (and hopefully insightful too). Great paper, underrated I think!
2
2
35
@MonniauxD
Le chauffage, si l'uniforme est constitué d'une doudoune en plume et un pantalon fuseau en polaire...
2
0
34
🚨Don’t drop your samples! Coherence-aware training benefits Conditional diffusion
@CVPR
2024 Highlight with
@nico_dufour
@victorbesnier1
and
@VickyKalogeiton
📜
📄
🤖
Demo&models coming soon!
detailed🧵👇
1
12
59
0
6
34
I strongly disagree with this analysis. My take: Science is progressing faster now, but progress is shared among a larger base of contributors. People complaining just don't like the idea there are no genius, and the scientists of the past were just bourgeois winning the lottery.
We see constant progress in the world every day, from better cars to faster phones to virtual reality and the internet of things. However, despite all the technological and engineering advances, science seems to be slowing down.
83
35
218
3
0
34
Rainy departure for the
#CVPR2024
plane from Paris
(There has to be at least one CVPR participant per row in this plane 😅)
2
0
33
@jbhuang0604
Latent feature representation embedding space?
Why settle for less when you can have more!
3
2
34
Honestly, having to write rebuttals longer than the original papers was not how I had envisioned spending my free time in August...
3
0
33
Memory is all you need.
I know I sound like a broken record, but k-NN *is* a valid generalization strategy. So far, nothing tells us that extra-big neural networks aren't just learning a clever hash function and memorizing their training set.
New paper out today, asking: What books has ChatGPT/GPT-4 *memorized*? A LOT. Harry Potter, Pride & Prejudice, 1984, LotR, Hunger Games, GoT, 50 Shades of Grey, Dune. Memorization is linked to web popularity--lots of old classics + new sci-fi/fantasy. 1/6
11
168
778
3
2
32
Question for diffusion models people: To me, it looks like a DM is an iterated function system that is trained such that the training set is its attractor. What exactly prevents it from just memorizing the training set and output trajectories that land on training samples?
11
1
33
@francoisfleuret
I think if you answer no to this question, you should probably look for another job. If there is no hunch to discover or to understand, then you'd probably be happier doing something less uncertain, like engineering.
4
0
34
If you're using k-means for anything else than compression, you may be interested in my JAX implementation.
It's reasonably fast and features codeword shifting to make sure no cluster is super bad. Works very well for building visual dictionaries!
💻:
0
4
33
@roydanroy
I'm going to release a vision model that does 100% accuracy on ImageNet, but I won't tell you what was in the training set...
0
1
31
I can craft a random table where you throw a 20-sided dice 3 times, and get your next paper: "Neural ODE on the Grassmann manifold for open-set recognition".
Is this a research project? Hell no. It's a random-ass combination of stuff.
There's no research question, no logic to it.
1
0
31
The distribution of accuracy of as follows. It's pointy, but has outliers nonetheless. The diff between min/max is just below 2%, which is huge for computer vision! 6/n
2
2
31
Given my latest experimental results, I'm considering converting to a career in abstract art. What do you think?
8
0
30
@m_j_kremer
It won't change the situation, but you can think of Michael Jordan, the great professor of machine learning at Berkeley, every time he is invited to do a keynote at a prestigious conference, as he checks in the five star hotel just to see the disappointed face of the attendant.
1
0
31
Une anecdote qui m'a profondément énervé: Un de mes anciens doctorants, chinois, a fait prépa en France, l'X, thèse aux Ponts. Son visa a été prolongé jusqu'au jour de la soutenance, pas 1 de +, avec l'argument "vous soutenez le matin, vous pouvez prendre l'avion l'après-midi".🤬
5
1
31
"an optimal parenthesis problem"?
I now understand why the first differentiation engines were written in lisp...🤪
The optimal computation of gradients for the composition of functions is an optimal parenthesis problem. Forward and backward (backpropagation) are two extreme cases. Backward is optimal for scalar-valued functions.
9
260
2K
0
3
30
Our paper "Learning Uncertainty for Safety-Oriented Semantic Segmentation in Autonomous Driving" was presented this week at
#ICIP2021
with V. Besnier and A. Briot.
(the pdf is free for limited time so download it now)
A thread 🧵👇 1/6
1
4
30