Vincent Weisser
@vincentweisser
Followers
18K
Following
259K
Media
574
Statuses
9K
cofounder/ceo @primeintellect π€ decentralized agi + science π¬ co-initiator @bioprotocol @vita_dao / lets solve death
sf π
Joined December 2011
Today, we release TOPLOC:. A hashing scheme for verifiable inference that detects modifications, works across setups, validates 100Γ faster, and cuts proof memory by 1000Γ. Building the foundations for peer to peer compute + superintelligence.
Today, we release TOPLOC: A Locality Sensitive Hashing Scheme for Verifiable Inference. - Detects modifications to models, prompts, or precision.- Robust across GPU types, tensor parallel configurations and attention kernels.- Up to 100Γ faster validation than generation.-
6
11
83
.@ilyasut full talk at neurips 2024 "pre-training as we know it will end" and what comes next is superintelligence: agentic, reasons, understands and is self aware
84
780
3K
We've completed the first decentralized training of a 10B model!! . Trained across the US, Europe, and Asia π. Full release coming in a week including base model, checkpoints, post-trained model and data.
We did it β the first decentralized training of a 10B model is complete!. Trained across the US, Europe, and Asia π. Post-training with @arcee_ai is underway, and a full open-source release is coming in ~1 week, including: base model, checkpoints, post-trained model and data.
35
37
450
We are open-sourcing INTELLECT-1, the first decentralized trained 10B model. Including base model, checkpoints, post-trained model, data, technical report and our decentralized training framework.
Releasing INTELLECT-1: Weβre open-sourcing the first decentralized trained 10B model:. - INTELLECT-1 base model & intermediate checkpoints.- Pre-training dataset.- Post-trained instruct models by @arcee_ai.- PRIME training framework.- Technical paper with all details
15
38
351
Got my O1 visa stamped! πΊπΈ . Huge thanks to @plymouthstreet, @lisawehden, and everyone who wrote recommendation letters for me. See you all in SF soon! π«‘
53
4
332
Decentralized science summarized by @balajis. - on-chain citation path.- meta-data of every experiment for accuracy (stored on-chain, enables reproducibility) eg. @lab_dao.- truly open access, permanent decentralized storage.- funding eg. @Molecule_dao.
12
61
323
@MichaelTrazzi what concretely lies ahead? imo most likely outcome is that compounding capital will be highly relevant post agi/asi.
1
1
262
Decentralized science is now represented on thanks to @samonchain proposing and helping on this. Feel free to make a pull request and lets improve this page together:
10
60
225
Exciting milestone with @vita_dao to have $4m+ more to fund more longevity research! π§¬. Getting @pfizer ventures, @balajis, @ShineCapitalNYC, @L1Digital_, @beakerdao, @SpaceshipDAO, @bettslacroix and many more onboard! π§βπ¬
π€© We are excited to announce that we've closed a $4.1m fundraising roundπ± from strategic members including:. β’ @pfizer Ventures.β’ @ShineCapitalNYC.β’ @L1Digital_.β’ @beakerdao.β’ @SpaceshipDAO.β’ @balajis.β’ @bettslacroix.and many more. π§΅.
16
19
222
A big day for decentralized science! After over two years of building infrastructure for permissionless research, @bioprotocol launches today. Bio accelerates science by empowering communities to collectively fund, develop, incubate, and own scientific research. It began with.
32
29
216
Today, @johannes_hage and I are excited to introduce @primeintellect β democratizing AI development at scale, from compute to intelligence. Weβve raised $5.5m, led by @DistributedG @Coinfund_io @CompoundVC, @Collab_Currency @ProtocolLabs @ClementDelangue @dylan522p and others.
Introducing Prime Intellect β democratizing AI development at scale, from compute to intelligence. We're excited to announce our $5.5M raise from @DistributedG @coinfund_io @CompoundVC @Collab_Currency @protocollabs @ClementDelangue @dylan522p and others
29
20
203
.@ilyasut full talk at neurips 2024 "pre-training as we know it will end" and what comes next is superintelligence: agentic, reasons, understands and is self aware
0
9
199
entering the intelligence age of planetary-scale computation
We did it β the first decentralized training of a 10B model is complete!. Trained across the US, Europe, and Asia π. Post-training with @arcee_ai is underway, and a full open-source release is coming in ~1 week, including: base model, checkpoints, post-trained model and data.
8
20
197
AGI is progressing. Next major milestone may be long-horizon autonomous agentsβincluding AI scientistsβcapable of independent, extended decision-making and research.
We announced @OpenAI o1 just 3 months ago. Today, we announced o3. We have every reason to believe this trajectory will continue.
6
23
196
We released a metagenomic foundation model to help detect and prevent the next pandemic early! π«‘. Open-source, decentralized AI can help differentially accelerate scientific progress to safeguard against risks like pandemics while deepening our understanding of nature.
Releasing METAGENE-1: In collaboration with researchers from USC, we're open-sourcing a state-of-the-art 7B parameter Metagenomic Foundation Model. Enabling planetary-scale pathogen detection and reducing the risk of pandemics in the age of exponential biology.
17
22
198
.@VitalikButerin sharing his ideas on decentralized science, longevity, public goods funding, ai and scientific progress broadly.
4
42
190
If you want to learn more about decentralized science, a few great starting points:. Excellent explainer by @juanbenet .
9
41
159
.@bioprotocol is building the foundation for citizen science β empowering individuals to incubate, fund and commercialize biotech research. From longevity and neuro to cryopreservation, psychedelics, synbio, women's health, rare diseases, hair loss, long COVID, quantum bio, and.
So what is BIO?. BIO is a launchpad and liquidity protocol for BioDAOs. Financial rails for the next generation of citizen science, allowing biotech to be funded and commercialized by individuals instead of institutions. > 8 BioDAOs launched to date.> $40m+ in tokenized IP.>
7
27
152
We've successfully closed ~$2.8M (1,108 ETH) for cryopreservation research together with @kaimicahmills, @emilkendziorra, @elimohamad and a fantastic community of scientists and cryo enthusiasts.
What a ride! π₯Ά. CryoDAO has successfully closed a monumental ~$2.8M fundraise (1,108 ETH) on Juicebox!. CryoDAO's goal is to solve death by funding, incubating and advancing cryopreservation research π
8
14
142
Looking to hire a Chief of Staff + COO at @primeintellect interested to work on decentralized AI β smart, hungry, AI-native. Ideally with prior startup ops and AI experience + SF based. Message me or apply here.
7
19
144
Decentralized Science is happening π§βπ¬π§ͺ. Thanks so much for the @Molecule_dao @vita_dao @PsyDAO_ shoutout @pierskicks @RaoulGMI!! π. Big fan of @RealVision!
11
22
136
Jensen bullish on decentralized training "Distributed training will have to work . distributed computing will be invented . some some form of federated learning . async distributed computing is going to be discovered, and I am every enthusiastic and optimistic about that".
BG2. Ep 17. Double $NVDA! System Level Comp Moat, βInsane Demandβ, Inference Explosion 1 B x, Memphis Supercluster, OpenAI, & more. @altcap @_clarktang @bgurley. (00:00) Intro. (1:50) The Evolution of AGI and Personal Assistants. (06:03) NVIDIA's
11
22
137
Incredibly excited for the next chapter of @Molecule_dao enabled by our $12.7m seed round led by @npv_vc!. is an open platform that links bio-medical researchers to funding in order to enable more therapeutics to reach patients.
16
17
127
Love @balajis idea of a dashboard showing potential network states like @PraxisSociety @CityDAO (other promising ones?) aggregating the cryptographically audited censuses: number of community members, acreage of real estate, communityβs on-chain income etc. Anyone building this?
9
17
126
Looking forward to interviewing Vitalik about his thoughts on decentralized science and science in general. What questions would you like to ask him?.
π¨CALLING THE DESCI ECOSYSTEMπ¨. @VitalikButerin will be joining us via zoom for DeSci London to share his thoughts on #DeSci, what questions would you like to ask him?. Comment below π
23
11
129
Great introduction to d/acc (defensive / decentralization / democracy / differential acc) by @VitalikButerin
Introduction to D/ACC. @VitalikButerin shared his insights on d/acc (defensive / decentralization / differential acc) β an approach to tech advancement focused on building resilient technology. Watch the full talk, including Q&A, here:.
7
15
128
Some of the biggest challenges facing science according to 270 researchers, and how we can fix them potentially with decentralized science π§βπ¬. 1. Academia has a huge money problem π«°.Use funding models like @vita_dao to provide more stable, long-term funding for scientists,
10
38
112
.@lab_dao is building an execution layer for the life sciences, enabling everyone to plug into powerful bioinformatics and labs, and collectively building this protocol π§βπ¬π§ͺ. One of the most exciting communities and protocols to accelerate scientific progressπΏ
4
12
108
Deepseek completely mogging the closed ai labs. Creating a state of the art model for $5.6m.
> $5.5M for Sonnet tier.it's unsurprising that they're proud of it, but it sure feels like they're rubbing it in. Β«$100M runs, huh? 30.84M H100-hours on 405B, yeah? Half-witted Western hacks, your silicon is wasted on you, your thoughts wouldn't reduce loss of your own modelsΒ»
6
4
106
Decentralized and truly open AI is coming. @colinraffel beautifully making the case for decentralized ai!. An ecosystem of specialist models would likely be dramatically more efficient and effective than big models like GPT-4 on many measures.
6
13
101
Excellent essay, relevant in the current Q* discussion, by @finbarrtimbers (ex DeepMind). "Greedy sampling is the worst form of sampling, except all those other forms that have been tried from time to time." - Winston Churchill, if he worked in NLP". (h/t
3
4
105
@cz_binance Check out Decentralized science and biotech: DeSci Wiki, covering almost every project.
5
10
91
decentralized training.around the world
Releasing INTELLECT-1: Weβre open-sourcing the first decentralized trained 10B model:. - INTELLECT-1 base model & intermediate checkpoints.- Pre-training dataset.- Post-trained instruct models by @arcee_ai.- PRIME training framework.- Technical paper with all details
12
5
94
Layer 0 "ideology layer" by @balajis: "we need to code laws faster than they can outlaw code"
0
10
89
Really excited for the upcoming open and decentralized science quadratic donation round with Gitcoin. Grateful to @VitalikButerin @juanbenet @protocollabs @StefanDGeorge @SCRForum @Molecule_dao (and hopefully more soon) for supporting with generous matching donations. True MVPs.
In GR15, there are four cause rounds: Climate Solutions, Crypto Advocacy, DEI (Diversity, Equity & Inclusion), and [NEW!] DeSci (Decentralized Science). Stay tuned for round eligibility criteria and available matching funds!.
5
16
89
@paulg Check out IP-NFTs, that we use to fund longevity research with @vita_dao enabled by @Molecule_dao .
2
12
88
Anything missing for this definition of fully open source AI?.- code accessibility: source code, training data, and pre-trained weights are openly available. - licensing: permissive licenses like apache 2.0, MIT, or GPL allowing unrestricted use, modification, and distribution.
The definition is pretty clear cut if you ask @vincentweisser . βVincent Weisser the founder of Prime Intellect, an AI lab based in San Francisco, would prefer if the model were made βfully open on every dimensionββ. @TheEconomist
11
10
89
We are making science autonomous with @PrimeIntellect @vita_dao @Molecule_dao @bio_xyz and many other amazing builders in decentralized science + AI!.
A Blueprint for Breakthroughs:. Our latest piece on DeSci <> AI where we deep dive into how this ultimate collab will revolutionise the entire medical industry. Here's a guide to how it's gonna play out π
2
9
83
Let's work towards making the proposed crypto-powered ARPA (Advanced Research Projects Agency) by @juanbenet a reality this year!. @Molecule_dao @foresightinst @protocollabs @hypercerts @lab_dao @vita_dao @bio_xyz @DeSciLabs @ResearchHub @uselateral . collaborating on thisπ§βπ¬
9
16
83
Open source AI is catching up quickly. DeepSeek-V3 seems to be on-par/better than Claude, 4o etc on many benchmarks. Trained with much less compute.
π Introducing DeepSeek-V3!. Biggest leap forward yet:.β‘ 60 tokens/second (3x faster than V2!).πͺ Enhanced capabilities.π API compatibility intact.π Fully open-source models & papers. π 1/n
8
3
82
New nanogpt speedrun record breaking 3min β just ~3 days after the last record we supported! . Amazing to see this continued progress in open-source. And excited @PrimeIntellect could support this incredible researchπ«‘
Sub 3-minute NanoGPT Speedrun Record. We're proud to share that we've just breached the 3 min mark!. This means that with an ephemeral pod of 8xH100s that costs $8/hour, training a GPT-2-ish level model now only costs $0.40!. ---. What's in the latest record? A π§΅.
4
4
82
What are the most impressive ai knowledge tools that you've seen?. Big fan of obvious ones like . (@elicitorg).(@omniscience42). which ones am i missing?.
10
13
76
A landmark moment for network states! π΄. Exciting to see the flourishing of so many network state initiatives. Check out and by @vita_dao π.
1
9
76
Awesome event by binance + @bioprotocol discussing decentralized science and ai with Vitalik, CZ and many other amazing builders.
4
6
76
First longevity biotech startup spinout from @vita_dao in collaboration with the amazing Vera Gorbunova and her lab π§βπ¬π₯³. Matrix is leveraging the anti-cancer and pro-longevity effects of high molecular weight hyaluronic acid from naked mole rat to human π.
π€― VitaDAO becomes the FIRST DAO to π± kickstart a BIOTECH company, MatrixBio. π¬π§¬. MatrixBio explores hyaluronic acid-based compounds, aiming to pioneer in cancer and aging treatments, utilizing insights from cancer-resistant naked mole rats π. π§΅.
2
6
74
.@cryodao community has crowdfunded a super exciting cryopreservation moonshot research project (within one day with $900k). focused on high sub-zero preservation and revival of a small mammal, led by the amazing @aschwindewolf
5
10
71
@ClementDelangue @ylecun @elonmusk We clearly need both, and nothing moves the world forward as much as scientists paired with entrepreneurs translating and bringing the research to market.
1
2
66
We are hiring! Join us fixing science funding at @Molecule_dao π§βπ¬π§ͺ. - VP of Ops.- VP of Marketing.- UI Designer.- Head of Ventures. Read more here: If you have question ping @EzanneTess @paulkhls or me
9
18
68
Exciting to talk about Decentralized AGI at @MIT Decentralized AI Roundtable. Making the case for decentralized AI, exploring opportunities, addressing risks, and outlining research paths.
5
12
69
Decentralized training accelerating further! Great work by Nous on Distro/Demo. Excited to dive deeper, experiment with it, and integrate it into our framework as we collectively scale decentralized training π«‘.
Nous Research announces the pre-training of a 15B parameter language model over the internet, using Nous DisTrO and heterogeneous hardware contributed by our partners at @Oracle, @LambdaAPI, @NorthernDataGrp, @CrusoeCloud, and the Andromeda Cluster. This run presents a loss
1
7
67
Decentralized training is the path forward in the inference-time compute paradigm that enabled o1. Our first release by @MatternJustus in this direction to effectively scale reasoning.
Today, we are releasing:. - INTELLECT-MATH, a frontier 7B parameter model for math reasoning.- The largest synthetic math dataset to date of 5M verified reasoning traces.- An outlook on decentralized training in the inference-compute paradigm.
7
7
66
@RyanSAdams - ImpactDAOs, DeSci, Refi: - Web2 integrating web3.- GameFi .- Broadening of NFTs to research (IP-NFTs), music, video and other verticals.- More pro and noob friendly defi.- Social crypto (next level on top of lens, POAP etc.).
3
3
62
Get a bounty discussing the different @longevityprize hypothesis prize winners and submissions from last year . (cc @ResearchHub).
3
9
63
Excited to introduce OpenDiLoCo - big step towards making decentralized training more accessible by our team reproducing, scaling and open sourcing DeepMinds research.
Introducing OpenDiLoCo, an open-source implementation and scaling of DeepMindβs Distributed Low-Communication (DiLoCo) method, enabling globally distributed AI model training.
2
10
64
Join my talk about decentralized science at @EthCC: . "Why DeSci? The purpose and impact of decentralized science" π§βπ¬. July 18th, 3:35 pm - 4:00 pm.Eiffel Stage.
π€ #EthCC Speakers π€. @vincentweisser from Molecule. Track: Blockchain for good. ππ€β€οΈ
4
11
65
Who is coming to #EthAmsterdam? π³π± . Excited for DeSci Amsterdam (@descieth), @gitcoin Schelling Point, @TheDAOist_ and much more.
14
6
64