Sebastian Seung
@SebastianSeung
Followers
16K
Following
2K
Media
260
Statuses
4K
@FlyWireNews https://t.co/ZUXm93WUll @eye_wire. Read https://t.co/meh9OZPrQk @WSJ Top 10 Nonfiction 2012. @PrincetonNeuro @PrincetonCS
Princeton, New Jersey
Joined March 2010
A historic milestone for neuroscience! It's been a fantastic journey for the #FlyWire Consortium. This special edition of Nature showcases the power of open science, with nine papers that not only describe the fly connectome, but also make discoveries using it.
Big news! The fly connectome is featured on the cover of a special edition of Nature. This is all possible thanks to the collaboration of 292 members of The FlyWire Consortium!.Check out the thread for an overview of the 9 #flywire papers published today
5
93
373
🧵on Japan's underrated contributions to neural nets. Shun-ichi Amari @UTokyo_News_en @riken_en is another one of my heroes. His 1972 paper on associative memory models modeled Hebbian plasticity using an outer product weight matrix.
5
181
669
Wow. @Google is cleaning up at the Nobels this year. Yesterday's prize recognized the old Google Brain and today's goes to @GoogleDeepMind! The torch has been passed from @BellLabs.
BREAKING NEWS.The Royal Swedish Academy of Sciences has decided to award the 2024 #NobelPrize in Chemistry with one half to David Baker “for computational protein design” and the other half jointly to Demis Hassabis and John M. Jumper “for protein structure prediction.”
12
78
651
We're done! A historic milestone for neuroscience brought to you by the @FlyWireNews Consortium. Don't take my word for it. See the glory of the fly brain for yourself at
We are releasing a whole-brain connectome of the fruit fly, including ~130k annotated neurons and tens of millions of typed synapses!. Explore the connectome: Reconstruction paper: Annotation paper: 1/6
9
105
412
Wow. Hopfield model and Boltzmann machine.
BREAKING NEWS.The Royal Swedish Academy of Sciences has decided to award the 2024 #NobelPrize in Physics to John J. Hopfield and Geoffrey E. Hinton “for foundational discoveries and inventions that enable machine learning with artificial neural networks.”
8
66
412
I'm reminded today that the world of science is what I wish the entire world could be: people of different nations, races, creeds, and opinions working together to achieve great things. #sfn2024.
15
47
343
Another shout-out to an unsung hero of the #FlyWire connectome. Ten years ago, Rick Fetter cut a fly brain into 7000 slices, each 1000x thinner than a hair.
2
23
243
Our “surprisingly popular” algorithm for finding truth even when the majority is wrong. Cover of @nature this week.
3
69
217
@siwonchoi Thanks @siwonchoi of #SUPERJUNIOR!!! Music has been most famous export from S Korea. Now it's time to export public health. With music and health, we can all be happy 🎶⚕️⚕️.
1
81
214
70 years ago my late father stepped out of this station to begin life in the U.S. @Yale had taken a chance by awarding a full scholarship to this refugee from N Korea. He returned the favor by graduating summa cum laude. God Bless America, and God Bless Yale! #AmericanDream
5
8
203
2/ S Korea widely regarded as a role model for fighting #Covid19. The world needs to learn from their success, but most people can’t read Korean. Let’s make the life-saving information in this playbook accessible to people everywhere.
3
68
187
Titan of theoretical physics/neuroscience John Hopfield has won @TheFranklin Medal in Physics!
2
56
159
Murray Hill NJ 1951 Claude Shannon posed the problem of predicting the next word which turned out to be the seed of today's LLMs.
@SebastianSeung @Hamptonism Good stuff from Murray Hill, Florham Park, and Princeton, too 😉.
4
20
129
About to celebrate delivery to @IARPAnews of visual cortex reconstruction from a petascale EM dataset acquired by @AllenInstitute . the climax of Phase 2 of the MICrONS program!
5
12
104
Indeed Marr cites Chomsky as a "true computational theory." But the MIT school of language turned out to be as ineffective as the MIT school of vision. Language is described today by collecting a vast amount of linguistic output, not by a computational theory.
@TonyZador @SebastianSeung Marr was making a strong methodological claim with his levels - that an understanding of the computational level was necessary before proceeding to the algorithmic and then to the implementational level. The first step was the key for him - Chomsky's theory of transformational.
10
10
108
Insightful comment. Largest fly neurons have fan-in/out of O(10^3), much greater than typical value. Why? Electrical signals don't spread far inside some super neurons. The neuron therefore behaves as multiple functional units, each with small fan-in/out.
@SebastianSeung That's a huge fan-in.
7
10
98
@pwlot @alexisgallagher @RoboTeddy The fly connectome comes with predictions of neurotransmitter identity (acetylcholine, GABA, etc) based on the EM images, courtesy @BobQubit @janfunkey
1
4
96
@dribnet @RogerGrosse @hardmaru @NipsConference I'd like to see a historian figure out why MIT became so anti-neural nets. I always chalked it up to Minsky and Chomsky, towering geniuses who cast long shadows. Another theory is that the neural nets people (Pitts, Wiener) self-destructed.
5
28
92
neurons, beautiful neurons.
Since the '50 largest neurons' #connectome render with @amyneurons @FlyWireNews has made it's way around the world, I'm sharing an animated version. Including:.Information flow from the ocelli, .50 largest #neurons, .and a LOT of #synapses on one MASSIVE neuron. #neuroscience
3
10
91
Memories. With @srinituraga at #SfN 2007, waiting to deliver my Presidential Special Lecture, "The Once and Future Science of Neural Networks." Pinstripe suit with hot pink trim by Moschino and I really needed a haircut.
3
5
87
Central brain is done! Optic lobes well underway. The fly connectome is nearing completion.
The fly central brain synthesizes sensory stimuli into decisions and actions. For the first time, ALL 46,944 branched and far-reaching neurons of both hemispheres of the central brain have been reconstructed and are available via FlyWire.
6
18
83
@schoppik SOM is the seat of the soul. The axon of the SOM cell (green) ascends toward the Holy Dura Mater in Paradise. SOM struggles to contain the sordid impulses of pyramidal cells (red), studded with thorns and sending axons down to Inferno.
1
32
85
I dedicate this video to the fly that gave her life for science, but will live forever in silico. She has supercharged the discoveries of the #FlyWire Consortium, and propels us into the digital transformation of neuroscience. Protip: watch with audio on.
7
19
87
Look carefully. only in Princeton is a fire alarm answered by the "plasma physics department"! @PPPLab
2
6
81
Shout out to @element_ai for the warm airport welcome! Advice to AI companies: station your recruiters at Montreal airport starting now. Early bird gets the deep learner.
1
13
86
This is a beautiful exception to the rule that a neuron is a functional unit. Electrical signals have been shown to spread very little inside this cell. This is because neurites loop like crazy, lengthening the path >10x.
#pictureofthemonth: The CT1 large-field neuron operates like 1400 individual cells and forms a microcircuit, which turns excitatory into inhibitory signals. Discovered by the Borst department, this microcircuit is one important puzzle piece in decoding motion vision in fruit
1
17
77
7/ “The first cases of #Covid19 were reported in the United States and South Korea on the same day.” True! Fact-checked by Snopes.
1
36
76
This video shows the "cartridges" of chandelier cells (colors) making synapses onto axon initial segments of pyramidal cells (gray). The cartridges resemble candlesticks; hence the name chandelier.
Different cell types in the brain have their own connectivity rules and patterns. In a recently published study, our #neuroscience researchers took a deep dive into the connectomics of an important but enigmatic cell type, the chandelier cell. 🧵1. 📄
3
10
73
Some people have gotten the impression that I hate backprop. Let's be real. I love backprop. The fly connectome was enabled by an AI system containing an arsenal of convolutional nets trained by backprop.
@GaryMarcus @tdietterich @MurthyLab @sapinker @Ozel_MN @DesplanLab More shocking to AI enthusiasts, backprop seems irrelevant. How do I know that? Because *learning* seems irrelevant. If you rear a fly in total darkness, the visual system seems unaffected to a first approximation.
5
3
73
The @COVID_Translate Project has launched! 75 pages from a whirlwind of volunteer activity over the past 3 days.
Thanks to our amazing volunteers, the COVID19 Response Guidelines by @KoreaCDC are now available in English:
4
23
66
Our new preprint on cortical connectomics.
Our newest preprint! EM and neural activity images from three million cubic microns of mouse visual cortex. Four scientific vignettes from organelles to synapses to circuit structure and function @BCMHouston @PrincetonNeuro @AllenInstitute @IARPAnews 1/20
0
23
68
Excitement and nerve-wracking tension no doubt. They're shooting to cut 25,000 slices. each one 40 nanometers thin. That's right---nanometers.
Excitement is in the air #HereAtAllen as our Electron Microscopy team begins sectioning brain samples for the largest #electronmicroscopy dataset ever recorded! 🙌 This is part of a collaborative effort to map nearly a billion synaptic connections in 1mm³ of brain tissue.
0
24
65
The theoretical physics approach to neural nets was launched by @HopfieldJohn in this classic 1982 paper that introduced the "energy function" to associative memory models.
2
22
67
13/ Jung Eun-kyeong, now legendary @KoreaCDC head. A ‘reporter asked. about. a rumor. that she sleeps less than an hour each night. “More than an hour,” she corrected him, before moving on to the next question.’ /end.
1
29
61
11/ “Mike Ryan, the @WHO’s emergencies head, warned on Sunday that lockdowns wouldn’t be enough to control the pandemic and urged governments to focus on identifying and isolating infected people and their contacts.”.
1
25
60
DeepMath 2020 ( is now accepting abstract submissions on mathematical.theory of deep neural networks! This year's amazing speakers include @GittaKutyniok @rbaraniuk, Demba Ba, Rene Vidal, Stefanie Jegelka, Eero Simoncelli & more!.
1
18
63
A special shout-out to Krzysztof Kruk, an amateur scientist from Poland and veteran of @eye_wire. He singlehandedly annotated the majority of neurons in the #FlyWire optic lobe, and wrote software that aided others doing the annotation. What a hero!.
Volunteers played a key part in validating a gigantic neuroscience study mapping the fruit-fly brain. It shows what can be achieved through crowdsourcing research.
1
9
56
@pwlot @alexisgallagher @RoboTeddy @BobQubit @janfunkey These predictions can be cross-checked against transcriptomic maps made by people like @YerbolZK @yoojuyoun
0
2
60
@TheFranklin His 1982 and 1984 PNAS papers launched a generation of theoretical physicists (eventually including me) into neural net research. Well worth reading for style as well as content.
1
9
56
Don't miss the symposium "Connectomics: a new era of dissemination and discovery," chaired by yrs truly! An all-star cast of speakers on how connectomic resources are enabling new insights into the brain. 7-9pm ET Oct 29 @neuromatch Register at
2
15
56
TL;DR New preprint with discovery: many interneuron types in the fly visual system function as highly specific normalizers.
My new preprint attempts to explain the function of interneuron diversity in the fly visual system. The answer (or at least the beginning of it) falls in your lap once you have the connectome.
3
6
55
I'm delighted to announce that I will be serving as Chief Research Scientist @Samsung while also continuing my research and teaching @PrincetonNeuro & @PrincetonCS
1
11
51
@GaryMarcus @tdietterich @MurthyLab @sapinker @Ozel_MN @DesplanLab More shocking to AI enthusiasts, backprop seems irrelevant. How do I know that? Because *learning* seems irrelevant. If you rear a fly in total darkness, the visual system seems unaffected to a first approximation.
9
4
51
I am continuing to manage my @Princeton lab remotely, and more tweets about our advances in connectomics are coming soon. @ylecun has written about how the “dual affiliation model” is benefiting both industry and academia.
2
4
51
Calling all GUI wizards and Raspberry Pi gurus! Volunteer to write code that SAVES LIVES by joining @DJCohenEtAl @Princeton MAE team building critical care ventilator for COVID-19 patients. Please spread the word! cc @covidbrains 1/
5
35
50
Reconstructing a whole brain means you can map sensation to cognition #FlyWire.
Beautiful work from @UCSB: researchers have mapped the fly’s visual brain systems & how they connect to the fly brain’s navigation center. #NEIfunded @SungSoo_111 @MurthyLab @SebastianSeung @FU_Berlin @HHMINEWS. @Nature:
1
7
49
Kunihiko Fukushima @nhk_strl created the Cognitron (1975) and Neocognitron (1980), the forerunners of today's convolutional nets.
1
10
46
Kaoru Nakano was also @UTokyo_News_en. His Associatron (1972) quantized the weights, and was used for heteroassociation.
2
8
45
@doristsao reminded me of that day at the White House. ages and ages ago it seems. Now it's my turn. what have *I* learned from the BRAIN Initiative?
2
5
45
@ylecun is saying those who don't know history are doomed to repeat it. Can any of his critics point to the best recent papers showing that generative models find representations that are helpful for visual recognition and understanding?.
Modeling the world for action by generating pixel is as wasteful and doomed to failure as the largely-abandoned idea of "analysis by synthesis". Decades ago, there was a big debate in ML about the relative advantages of generative methods vs discriminative methods for.
9
4
43
President Eisgruber @Princeton calls for round of applause to honor @HopfieldJohn joining press conference by Zoom!
2
2
44
Congrats @sdorkenw for winning the Larry Katz Prize! A great honor for Sven and a tribute to a brilliant neuroscientist who did so much to advance our knowledge of neural circuits.
0
6
38