Ky⨋ Gom⨋z (U/ACC) (HIRING)
@KyeGomezB
Followers
2,815
Following
650
Media
1,227
Statuses
15,734
Enabling AI Engineers to Orchestrate Swarms of Agents: $ pip install swarms
Palo Alto
Joined October 2021
Don't wanna be here?
Send us removal request.
Explore trending content on Musk Viewer
Iran
• 341475 Tweets
ايران
• 244779 Tweets
#เปิดกล้องซีรีส์หยดฝนกลิ่นสนิม
• 233808 Tweets
Ismail Haniyeh
• 215023 Tweets
EL START SHOOTING PETRICHOR
• 213344 Tweets
اسرائيل
• 191426 Tweets
Megan
• 156687 Tweets
Centro Carter
• 143936 Tweets
Tehran
• 111855 Tweets
#GranHermanoCHV
• 82137 Tweets
#اسماعيل_هنيه
• 70708 Tweets
Kari Lake
• 53539 Tweets
THANK YOU FOR NARCISSISM
• 51248 Tweets
طهران
• 46815 Tweets
Sebastián
• 46472 Tweets
Dodgers
• 45282 Tweets
NanaNu 2nd Anniversary
• 41531 Tweets
スペースマウンテン
• 35597 Tweets
日銀利上げ
• 33164 Tweets
#Hamas
• 29201 Tweets
Mossad
• 25438 Tweets
Inna
• 19886 Tweets
マギレコ
• 19611 Tweets
Daenerys
• 18611 Tweets
Rayados
• 14758 Tweets
رييس المكتب السياسي
• 14583 Tweets
Hoes for Harris
• 14173 Tweets
ابو العبد
• 13300 Tweets
追加利上げ決定
• 11905 Tweets
Mistral's team litterally just forked llama changed less than 40 lines of code and raised 120+M.
Investors what are you doing 😢 this is horrendous
92
68
1K
Nobody is talking about this right now but Google dropped a CRAZY model interpretation graph tool, to enable you to better understand your models better.
Check it out, link 👇
5
174
1K
540x Faster than GPT-4
100x Longer Sequences than GPT-4
And, better performance on Long Sequence tasks than GPT-4.
Multi-Modal Mamba is going to change the LLM game on a scale you couldn't possibly imagine in the flash of a lightning.
[Get Access Now]
34
163
1K
This prompt is OVERPOWERED.
With this Tree of Thoughts 🌴 prompt, you can split your agent into multiple personalities // experts that debate internally for a problem.
It’s great for math and science or can even be used for more nefarious purposes
8
72
496
Announcing, The Open Source Implementation of AlphaFold3
AlphaFold3 isn't open source but it must be and we're making it open source.
Join us now:
5
77
408
Introducing Mamba Swarm 🤖 🤖 🤖 🤖
The first ever implementation of a swarm of Mambas for real-world language modeling. There are various custom fusion methods such as weighted average, the absmax, softmax, and more.
LLMs will never be the same...
6
55
320
Lmao
@PropheticAI
changed the visibility of their posts because I implemented their model fast.
This is a lesson.
Don’t close source your AI models or they’ll get implemented open source anyways 😂
26
17
283
Introducing Mamba Transformer,
Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling.
8
37
281
I just launched Swarms on ProductHunt 🚀
It's a simple python package that enables you to build, deploy, and scale "Swarms" of LLMs, you can get started in 5 lines of code, check it out:
Follow it and pls leave a review if you have tried it 🙏
8
23
147
LINK:
Github:
1
11
148
I'm very excited to announce the Pytorch Model Implementer GPT that helps you create bleeding edge models in pytorch 😊 🤖
This has been my personal companion helping me implement 100s of AI papers for acouple months now.
Get Started:
5
27
130
I was the first ever to implement Mamba + Transformers:
Good to see the architecture being adopted.
Jamba
A Hybrid Transformer-Mamba Language Model
present Jamba, a new base large language model based on a novel hybrid Transformer-Mamba mixture-of-experts (MoE) architecture. Specifically, Jamba interleaves blocks of Transformer and Mamba layers, enjoying the benefits of
5
60
428
2
10
114
I'm done.
I can't implement so many papers all the time, I need you.
I'm releasing a list of papers that need to be implemented to democratize SOTA AI for all Humans and advance Humanity.
Join the Agora community to learn more:
7
7
94
Updates on AlphaFold3 OS Implementation 🔥 100
✅ Genetic Diffusion Module
✅ PairFormer: Implementation from scratch
✅ MSA Embedding
And, join the discord to help:
1
17
84
I’ve been thinking about setting up hacker houses in SF, El Segundo, NYC, and Miami to connect people from different locations together.
Kinda like little monasteries you can come and stay at if you’re in the city.
Should we make this happen?
21
1
79
I’m looking to create dope banners to promote open source, if you’re a graphic designer and want to advance Humanity dm me.
And, if you know someone tag them
74
0
77
Announcing Neo Sapiens, the next stage of AI.
This project introduces the first-ever self-replicating hierarchical swarms of autonomous agents in production for real-world tasks.
Get started here:
4
18
77
How does AlphaFold3 work exactly?
Let's dive into the model architecture and training strategy of this new historic protein prediction model.
We're implementing AF3 open source right now.
1
14
72
Agora will be giving away 50-A100 GPUs with 0 time-limits to researchers working on cool stuff.
Steps to Qualify:
-> Join Agora:
-> Share your project in the "Creator Showcase" channel
-> Like, Retweet, and comment on this post.
You have 1 week.
12
17
60
Announcing, WhiteRock
The first ever fully-automated VC fund transforming venture capital. Built at the HackAIThon by Craft Ventures, Agent Ops, and others.
7
8
59
@BasedBeffJezos
DOUBLE ENERGY GENERATION
TRIPLE ENERGY GENERATION
QUADRUPLE ENERGY GENERATION
WHATEVER IT TAKES.
WE MUST GO FORWARD!
5
3
55
I'd like to share my first ever 3d object creation model!
It's the pytorch implementation of the new paper Gamba, an end-to-end amortized 3D reconstruction model from single-view image
Paper:
img -> 3d object using Mamba!
0
6
49
Announcing Open Gemini, the open source implementation of Google's fantastic Multi-Modal Model.
Multi-Modal models like this need to be democratized or we face real existential risk.
5
10
47
Google spent 1BILLION DOLLARS on Gemini, and I'm almost done with my implementation that I made in around 2+ hours of work for free.
Investors what are you doing this is SUPER HORRENDOUS 😢 😢
8
5
41
It’s official.
The Swarm Corporation office is now in Mountain View 🛸👾👾👾
This will be our office until 1B revenue.
If you want to join the team, join the discord and send PRs to the Swarm repo!
5
0
38
Anybody in Robotic AI want to partner on this? I've implemented RT-2
The leaderboard for the HomeRobot challenge is now open at :
- create a docker image containing your agent
- planning or learning, use your favorite strategy
- we plan to run the top 3 on real hardware
- potentially win a robot from
@hellorobotinc
2
22
83
2
8
36
This is fucking ridiculous.
Faster, higher, and stronger Multi-Modal models [PaLM2-VAdapter]
PaLM2-VAdapter outperforms SOTA with 30∼70% fewer parameters.
My open source Implementation is ready for training ✅ 😊
2
3
35
@kyritzb
@PropheticAI
Everything is a Lego block, you just need to know how they connect together
1
3
34
I'm very proud to announce HLT, Humanoid Locomotion Transformer.
This is the first ever open source implementation of a transformer for humanoid robotics.
This an implementation of the paper: "Real-World Humanoid Locomotion with Reinforcement Learning"
3
4
34
It's insane how a vast majority of the chinese AI research labs are open sourcing all their research with code and weights and everything while Western research labs close source everything.
What's going on here?
8
4
34
@Blockworks_
This is horrible. A USD-backed stable coin would have unimaginable consequences such as targeted inflation, targeted credit inflation, and other horrible horrible effects.
This is not it whatsoever.
10
0
30
BREAKING 🚨 ‼️
Imagine fully automated hospitals running at 100% efficiency. Check out this new paper on a hospital swarm:
PAPER: Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agents
4
4
34
@SamuelMullr
this is why papers who do not release code with experiments should be overlooked, as there is no way to formally test the paper's findings
2
2
34
Implementation in progress ✅
1.5Bit must be democratized.
Microsoft presents The Era of 1-bit LLMs
All Large Language Models are in 1.58 Bits
Recent research, such as BitNet, is paving the way for a new era of 1-bit Large Language Models (LLMs). In this work, we introduce a 1-bit LLM variant, namely BitNet b1.58, in which every single
52
622
3K
2
4
33
El Segundo is insane.
Most capable people on the planet building ferociously to advance Humanity.
Build. Build. Build.
Everything else doesn’t matter.
Godspeed ⚡️
1
0
32
never finished high school or went to college.
And, I'm building better models than the best AI PHDs on the planet.
How?
Iteration.
1
3
30
@drchristhorpe
The Open Source Implementation of AlphaFold3
We need to democratize this technology asap
1
5
30
Excited to announce AI paper to code GPT
Implement AI research Papers into Pytorch, Jax, Triton, and Einops or framework of choice effortlessly 👾🚀
Built at the AGI house!
3
1
29
Communism has enslaved my people.
Cuba must be liberated.
And, Communism destroyed forever.
BREAKING:
Cubans have taken to the streets.
Tired of the communist regime and the policies ruining the countries economy, they are chanting “FREEDOM”
🇨🇺
510
6K
27K
2
3
29
Excited to Announce AgoraX/AIEC-140K 📝
An all-new dataset with super high High Quality AI Engineering Code Tokens totaling 140k samples!
AEIC is from the top research labs like OpenAI, Nvidia, Google, Lucidrains, and others scraped through github!
1
4
29
Very excited to share my implementation of Screen AI, a multi-modal model for UI and Infographics Understanding in pytorch📄 📄
✅ Model Architecture: Patching -> Vit -> embed + concat -> multi-modal encoder -> decoder
✅ ready to train right now.
1
4
28
The next era of Robotics is here 🤖 🤖 🤖
Announcing HRTX, a Hivemind Multi-Input and Multi-Output Transformer for Robotics.
This can model can process inputs from any number of N robots and output any Z actions across any of those robots.
1
2
28
Announcing, Creating a Language Model with PyTorch in 5 Minutes 🔥 🤖
Build a SOTA Language model with this simple tutorial using Pytorch in 5 min 🚀 Will be sharing a series on creating Transformers and deploying them into production soon stay tuned.
0
5
26
Agents don't suck.
Individual agents suck.
Multi-agent collaboration bypasses all the limits of individual agents like context window limits, single task threading, and hallucination.
Don't believe me? Check out these papers for more.
3
2
26
I'm very proud to announce Open QwenVL
An open source production grade ready to train Qwen VL exactly as described in the Qwen Paper.
✅ Full Multi-Modal Processing [Vit, Cross Attn]
✅ Modular and Re-Usable
✅ Built with Zeta
Get started now:
Ah it's not open source.
You know what that means?
We're going to open source it.
Nobody is safe from us.
2
0
19
4
4
24
Your personal Devin in less than 80 lines of code with Swarms.
✅ Tools like Terminal ++ Browser
✅ Longterm memory
✅ Stopping conditions
✅ Any LLM [GPT-4 // Llama // etc
Get started now:
$ pip install swarms
2
2
23
I grew up impoverished in one of America’s poorest cities.
I never finished high school.
Nor did I go to get a PHD at university.
I taught myself by reading hundreds of books and failing again and again thousands of times in an endless loop over a decade.
You can do this
3
2
23
When an AI startup raises 100M to invest all into one model then Kye Gomez open sources it for free.
😂
2
2
23
Excited to share Hierarchical Mamba 👾👾👾
This is the first hierarchical Mamba where a low level mamba will output a sequence that will then be picked up by a high level mamba.
HSSS outperforms SOTA Transformers by at least 23% on MSE.
1
5
23
I'm excited to announce AgoraX/VMMFC-3OK,
The first open multi-modal function calling dataset with 30k+ samples for a vast array of real-world tasks such as parallel tool usage, api calling, and multi-modal action execution.
Bigger verisons otw!
1
1
21
At 2,000 followers I’ll open source something that will fundamentally reshape Human civilization.
Like, retweet, and share with your family and friends
1
4
23
Behold the Swarms Pitch Deck:
Provide your brutally honest feedback as it's still a work in progress.
And, if you would like to invest DM me.
11
0
22
I Keep getting the same question
"How is Swarms compared with Langchain"
"Autogen"
"Griptape"
And, my only answer is
Production Grade Reliability
That's why swarms exists
To provide thee most reliable agents that actually do what you want them to do
6
2
20
Dont hope for GPT5 or LLAMA 3, make models better than them.
Hoping and waiting around like a puppy isn’t going to help you.
Learn PyTorch and lucidrains and Cuda.
Take control of your destiny.
4
0
20
[Starting next week]
I'm going to make a tutorial on how to make a transformer GPT-3 like model in less than 100 lines of code, other multimodal tutorials, and maybe even stream all day every day.
We need to accelerate learning.
0
0
20
1 Bit Lora is here.
Get started with:
$ pip install bitnet
And, the repo is here:
Appreciate you
@shxf0072
The way we do normal lora won't work bitnet, bcs we have to maintain property when lora weight are merged they can still be quantized into good ternary, we need littel reformulation in forward pass, so
BitLora
4
18
119
0
3
20
Imagine buying 1,000 pounds of salad for 1$
This will soon become possible with Swarms of autonomous agents operating vertical farms.
Post Scarcity is close…
We just need a push
3
0
19
Ah it's not open source.
You know what that means?
We're going to open source it.
Nobody is safe from us.
Alibaba announces Qwen-VL
demo:
blog:
Qwen-VL outperforms GPT-4V and Gemini on several benchmarks.
27
165
757
2
0
19
Announcing, Open Source Implementation of Pairformer 🧬 🧬
Pairformer is used in AlphaFold3 to model the interactions between ligands, atoms, and more.
Help us Implement AlphaFold3 in Agora!
1
2
20
I'm delighted to share that I've implemented a radically simple Jamba in pytorch, to help you get started with joint Mamba + Transformer architectures!
And, if you like building models join Agora, the open source AI research lab!
0
2
18
[Swarms][N2]
A Swarm is any group of 2 or more agents working together to accomplish a task.
In a swarm, communication between the agents is the biggest limiting factor between the agents achieving trying to achieve a task.
2
2
19
AI Research Team 🤖
A 3 agent team that works together to implement an AI research paper in code. Amazing swarm for easily extracting the algorithms from a paper and using them!
�� GPT-4 + Claude
✅ Multi-Agent Orchestration
✅ SOP Prompting
1
6
19
One of the most underrated papers of all time: "Assembly theory explains and quantifies selection and evolution"
Provides a simple formula called The Assembly Index to predict evolution in any kind, life or technology. It's insane. check it out
0
1
19
I’m excited to announce I’m headed back to SF tomorrow for a month with
@thomasschulzz
Solaris Residency Program 😆
Let’s get dinner, work on autonomous agents, and advance Humanity 💯🤖🤖🤖
2
0
19
implementing this right now in Pytorch and Zeta!
Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model
paper page:
Recently the state space models (SSMs) with efficient hardware-aware designs, i.e., Mamba, have shown great potential for long sequence modeling.
2
30
201
1
1
19
300+ free AI Models, 6+ years of open source AI, most important AI engineer in Human history
Please sponsor or donate to him so he may continue open source AI research otherwise he won't be in open source anymore and humanity be set back 100 years.
0
8
17
Announcing Atom ⚛️, a suite of finetuned LLMs for atomically precise function calling 🧪
✅ Massive function calling dataset of over 20M samples.
✅ First Model: Atom-Z-Tiny - Zephr trained on 100k samples
✅ Vision function calling coming soon
Wandb
1
1
18
I have a completely absurd announcement to make sometime later today.
This changes absolutely everything.
A new era of acceleration has commenced.
5
0
18
Damm, just hit 8,000 commits on github.
Is this a world record?
5
0
18
Just Implemented the new Zamba joint mamba-transformer paper.
The architecture is:
6 mamba -> attention -> mlp -> linear -> 6 mamba -> attention -> mlp -> linear -> finally 6 mamba
The model architecture is new and performance is exceptional.
Links below:
1
0
18
Zeta is overpowered.
I can implement any paper in 15-30 minutes with modular plug in and play blocks
-> Transformers
-> FFNs
-> SSMs/ Mamba
-> Activations
-> Embedding functions
-> Biases
2
1
17
i might start streaming on twitch, would you watch?
Implementing AI research papers and working on Swarms and Zeta.
3
1
18
0
0
16
My Implementation is here:
Please tell me what's wrong or bad so we can improve it!
0
0
17
Now integrating everything together.
Need some help.
Join the OS AlphaFold 3 Team:
Updates on AlphaFold3 OS Implementation 🔥 100
✅ Genetic Diffusion Module
✅ PairFormer: Implementation from scratch
✅ MSA Embedding
And, join the discord to help:
1
17
84
1
3
17
AoT is the most underrated prompt technique EVER.
It searches the space of all possible solutions to a problem in one step. Not multiple steps like chain of thoughts or tree of thoughts and others!
Just copy and paste with your task:
1
3
17
Let's discuss why individual LLM agents fall short. Despite their advanced capabilities, they face five major problems: hallucinations, limited context windows, single-threaded processing, lack of collaboration, and huge size/cost.
1
2
17
It's insane how poorly built Langchain, BabyAGI, Autogen are built.
They all produce results that are not desire-able in any capacity.
All of these agent frameworks are doomed to death.
If you can't produce outcomes people want and need you're screwed.
6
1
17
Interstellar is one of those movies that can change your life.
It collapses your world view into the size of a small ball and shows you temporary your burdens are.
It shows you what actually matters which is advancing Humanity and building a family
1
0
16
Architecture:
-> Encoder + Decoder [Weird but okay?]
-> RMSNorm
-> MGCA
-> RoPE
-> SwiGLU
-> Based on Noam Architetecture
-> Bfloat
Implemented here:
Meet Reka Core, our best and most capable multimodal language model yet. 🔮
It’s been a busy few months training this model and we are glad to finally ship it! 💪
Core has a lot of capabilities, and one of them is understanding video --- let’s see what Core thinks of the 3 body
53
246
1K
1
2
16
Billion Dollar App Ideas 💡
- Open source peer to peer Uber.
- Open source Calendly
- Open source Loom
- Open source peer to peer Food Truck discovery app
- Open source payment system like Cashapp
4
0
16
Learn How LLAMA 3 Works Now: The Complete Beginner’s Guide
From Zero to Hero: Simplifying How LLAMA 3 Operates.
1
1
15
@pedrobeltrao
The Open Source Implementation of AlphaFold3
We need to democratize this technology asap
1
0
16
❌ Never went to college
❌ Never finished high school
❌ Didn’t come from money [ my family came to America on a boat from Cuba ]
❌ Built many failed businesses
❌ lost 90% of my networth
Why do we fall?
To learn how to pick ourselves up.
Keep pushing forward
1
0
16
Ai researchers and academics don't know how to code.
It's very inefficient, poorly optimized, and just low quality.
Which is why I made Zeta, to make AI engineering as simple as possible:
Every time I try to use some simple install instructions for research code from github, I get frustrated. Even with conda etc, it seems like AI code is much less reproducible than you would think.
12
3
79
0
0
16