omkaar Profile Banner
omkaar Profile
omkaar

@omkizzy

Followers
2,605
Following
673
Media
85
Statuses
1,465

ml/distsys/os | past @uwaterloo @cartainc @autodesk | dist sys breakdowns for 6000 SWEs

Joined July 2015
Don't wanna be here? Send us removal request.
Explore trending content on Musk Viewer
Pinned Tweet
@omkizzy
omkaar
5 months
GPU Poor? **Friends** is all you need. i built a distributed training module from scratch that performs model training over a cluster of M-series macs connected over the same network. this was inspired by @anyscalecompute 's Ray, @hnasr 's work, @ShopifyEng 's merlin article and
75
79
929
@omkizzy
omkaar
2 months
Introducing BeyondPDF, a smart, free, fully-local (wifi-less) PDF search app for MacOS. "Free" has always connoted to "It's free but we will steal your data"... not anymore. Whats wrong with MacOS's Preview? It's great... but I NEED smart/semantic search. Searching for words is
81
112
1K
@omkizzy
omkaar
4 months
gpu poor? I wrote a simple distributed training module to train a vision model on three M1 macbooks. it's open sourced! i wanted to build a distributed training tool for M-series macs but I faced two hurdles: network latency is extremely high and my friends weren't happy with
36
61
809
@omkizzy
omkaar
3 months
AI chatbot startups have raised $100M+ right now but have it all wrong. Your chatbots point users to a 100-page zendesk doc on "how to ***" but why not just complete the task? I built ActBot: set up your own agentic chatbot on any website! The demo below shows ActBot
34
17
385
@omkizzy
omkaar
2 months
Introducing Agenata: a free, open-source web annotation tool. The demo below shows a live annotation of adding an item to cart on uber eats. Currently, SOTA web agents underperform because: 1) Fewer web trajectory datasets lead to poor reasoning and planning over different
22
23
292
@omkizzy
omkaar
5 months
federated learning across mine and my friend's mac... now i can sleep 🙂‍↔️
11
1
212
@omkizzy
omkaar
6 months
@sincethestudy @cognition_labs loool two things that are inevitable: taxes and gpt-4 prices dropping
2
0
94
@omkizzy
omkaar
4 months
i suspect adam (just quit as ceo of aws) and ilya (just quit as CS at openai) are building a gpu startup tg
3
1
89
@omkizzy
omkaar
4 months
one man's biases are another man's weights
7
7
75
@omkizzy
omkaar
8 months
I built an AI agent that can perform end-to-end tests on your webapp with natural language test definitions. traditional heuristic evaluations cost $10,000+ dollars, an llm-agent-based heuristic eval can cost < $1,000, even for large projects! shoutout to @ivan_yevenko from
14
5
76
@omkizzy
omkaar
5 months
Self-building, on-the-fly APIs with agents. Demo ⬇️ The world needs devs to spend more time architecting developer-friendly APIs not code monkeying the same boilerplate. I time-boxed myself to build a simple self-building, and soon self-healing, API that can build and fix
2
1
73
@omkizzy
omkaar
2 months
soft launch, video coming
Tweet media one
Tweet media two
7
0
59
@omkizzy
omkaar
8 months
I built a patent search engine to look through billions of patents (my demo only does millions for now) through semantic search. The infra for this is very hard and required some work on the embeddings / vectordb front. To scale up your embedding search, you need: - small
6
0
57
@omkizzy
omkaar
4 months
@karpathy hey andrej, can you pass the joint you are on!
0
0
52
@omkizzy
omkaar
3 months
@isidentical 480gb vram????? try mailing the gpu to me
1
1
51
@omkizzy
omkaar
3 months
got out-shipped but this is sick!!!!
@mo_baioumy
Mohamed Baioumy
3 months
One more Apple announcement this week: you can now run your personal AI cluster using Apple devices @exolabs_ h/t @awnihannun
139
499
4K
4
1
49
@omkizzy
omkaar
4 months
@sincethestudy @natfriedman yo brian, thank you for helping me build the thermoclinic neucliophillic ai agent reactor that, since the study, has helped cure cancer (currently in stealth mode)
0
0
44
@omkizzy
omkaar
2 months
@Bojohnzon exactly, i hate companies charging for this... i do like obsessing on the ux, thank you for noticing
1
0
45
@omkizzy
omkaar
5 months
for anyone else in the same boat
Tweet media one
2
0
42
@omkizzy
omkaar
9 months
Hey @metaphorsystems ( @wangzjeff @SarahChieng )! I use google and metaphor frequently, and recently, I have been thinking about how Query Biased Snippets on Metaphor's search results could really enhance user experience. Here's a quick video/demo of metaphor with QBS. Things to
10
2
43
@omkizzy
omkaar
4 months
sitting on @ClementDelangue 's table to close my skill issue gap
Tweet media one
2
0
42
@omkizzy
omkaar
2 months
we are apparently charting the app store in utilities!!!!!! can we run this up?
@omkizzy
omkaar
2 months
Introducing BeyondPDF, a smart, free, fully-local (wifi-less) PDF search app for MacOS. "Free" has always connoted to "It's free but we will steal your data"... not anymore. Whats wrong with MacOS's Preview? It's great... but I NEED smart/semantic search. Searching for words is
81
112
1K
4
3
41
@omkizzy
omkaar
4 months
hmm what could this be?
Tweet media one
3
0
41
@omkizzy
omkaar
5 months
@daraladje it gotta chill on the capitalization dawg, only serial killers use perfect caps 😳
3
0
40
@omkizzy
omkaar
2 months
@0xluffyb haha building anything is easy, lets see you sell and make some money
3
3
39
@omkizzy
omkaar
4 months
??
Tweet media one
2
0
35
@omkizzy
omkaar
4 months
i know a waterloo first year still looking for a summer internship. good full-stack, AR and embedded experience but most importantly, done to learn. anyone interested in a chat?
3
1
34
@omkizzy
omkaar
1 year
Tweet media one
17
1
32
@omkizzy
omkaar
4 months
tobias is smart, super ambitious and will grind no doubt, any company that hires him is lucky!
@grethermurrayt
Tobias Grether-Murray
4 months
Just got word that my fall tesla internship on the battery manufacturing eng team was cancelled due to layoffs. I'm a mechatronics student at uwaterloo, if anyone is looking for a mechanical/robotics position, let's chat! down to grind on the most ambitious ideas :)
Tweet media one
Tweet media two
Tweet media three
22
18
252
1
1
31
@omkizzy
omkaar
4 months
an employee's worth is the domain knowledge they possess which is not in GPT's pretraining data
3
4
26
@omkizzy
omkaar
5 months
im SO bullish on the mlx. when apple builds, they build seamless integration within their ecosystem. Federated Learning is great across mac mps backends, but.... I have some thoughts on this, but I will let you extrapolate :) maybe I'll even build and OS it
2
0
29
@omkizzy
omkaar
4 months
hey @OpenAI pls can u revert to your older checkpoint
Tweet media one
4
1
28
@omkizzy
omkaar
1 year
GitHub searches through 300,000,000 repositories instantly. Learn the nitty gritties of their search from a 5 min article. Read here:
0
4
26
@omkizzy
omkaar
2 months
whoever gave me the 5 star on BeyondPDF, you are a real one!
Tweet media one
1
0
24
@omkizzy
omkaar
4 months
If a service is free, you are the product. gpt was never meant to have just a consumer biz model, it does not scale as well... now enterprises (like apple) will fill oai's pockets for us to use it... parallels with how Google provides search for free. giving it for free leads to
4
1
24
@omkizzy
omkaar
4 months
hello im raising $7T preseed to automate $4.6T worth of work, anyone want in?
3
0
25
@omkizzy
omkaar
5 months
my intention is to get this to be readable, DX-oriented and open source it so people can learn that federated learning is actually not hard (on a dev scale)
2
0
25
@omkizzy
omkaar
1 year
My profile pic is inspired by this image. I love everything TinTin is about.
Tweet media one
4
0
24
@omkizzy
omkaar
2 months
seeing a friend organically opening BeyondPDF, making a search and deriving value is magical, 1.0.2 is coming
3
1
24
@omkizzy
omkaar
10 months
doing full-time side-quests and part-time school has made me more fulfilled then ever
4
0
24
@omkizzy
omkaar
10 months
im so grateful to school. it helped me develop world-class prompt engineering skills that now directly translate into real world applications.
2
0
23
@omkizzy
omkaar
5 months
dropping OS federated learning tomorrow. it still uses grpc but the codebase should be pretty readable.
Tweet media one
0
0
21
@omkizzy
omkaar
5 months
@awnihannun @anyscalecompute @hnasr @ShopifyEng thats the best part, i went with pytorch because im more familiar with it. in mlx, this would be even more optimized :) OS + tutorial coming soon
0
1
20
@omkizzy
omkaar
3 months
dropping a more agentic OS version of this tmrw... stay tuned!
@tryramp
Ramp
3 months
Introducing Ramp Tour Guide: an AI Agent that can show you how to do anything on Ramp! Today, we'd like to share a sneak peek of Ramp's near future. As Ramp grows in functionality, we want to make all of it easily accessible to all of our customers. To do that, we're demoing a
35
57
596
3
0
19
@omkizzy
omkaar
4 months
Training your model Training your model on on a single M1: multiple M1s:
@tunguz
Bojan Tunguz
4 months
Training your model Training your on a single 1080 Ti: model on 600K H100s:
Tweet media one
Tweet media two
24
42
805
1
1
19
@omkizzy
omkaar
2 months
@cHHillee Also its an inference chip... this is great competition for groq not the H100, im hoping a distributed inference provider steps in and provides great competition!
0
0
19
@omkizzy
omkaar
5 months
I made a big list of books based on my last tweet's replies which ill pick from next time. I got the one below. ever since i became more ambitious (2nd year waterloo eng onwards), I have felt a deep difference in friendships I had in high school vs rn. I realized I became
Tweet media one
@omkizzy
omkaar
5 months
im going book shopping, drop your favorite book recs! idc if its about business, fiction, science, biographies, etc. I want to expose myself to something new. will post an update of what I buy :)
14
0
14
4
0
19
@omkizzy
omkaar
10 months
woke up and the inner tech bro in me was convinced I needed a mullet, so here it is
Tweet media one
3
0
17
@omkizzy
omkaar
4 months
i hate excelling cuz ppl spreadsheet
5
1
17
@omkizzy
omkaar
3 months
dont accept code from strangers
3
0
18
@omkizzy
omkaar
3 months
how does my dad have almost 20,000 subs on youtube and I am at 11
5
0
18
@omkizzy
omkaar
2 months
@keshavchan my brother lookmaxxing is a form of gradient ascent
1
0
18
@omkizzy
omkaar
2 months
@radshaan ill one up and say original thought doesnt exist
3
0
17
@omkizzy
omkaar
4 months
the replit layoffs unleashed an absolute swath of cracked builders into the world, we are going to see some insane builds soon
0
0
17
@omkizzy
omkaar
5 months
till compute naturally scales 10x, who is working on scaling data 200x? (chinchilla)
8
0
17
@omkizzy
omkaar
4 months
can someone run swe-agent with llama3? zuck said 20% of the training data was code!!!
2
0
17
@omkizzy
omkaar
7 months
@jxnlco you should change your twitter name to json lool
0
0
16
@omkizzy
omkaar
3 months
@VictorTaelin @fireship_dev insane, i think the launch was perfectly executed, congrats!
0
0
14
@omkizzy
omkaar
2 months
apple intelligence will be apple's biggest feature. we talk about why agents should not use user interfaces and instead get work done with api calls to services... but most services don't actually offer public apis. through app intents, apple basically gets their top apps
1
1
15
@omkizzy
omkaar
4 months
most people believe that the hardest substance on the planet is a diamond... its actually waterloo water
1
0
15
@omkizzy
omkaar
4 months
scientists say the human brain does not back prop. a person reflecting is a person back propping
2
1
14
@omkizzy
omkaar
4 months
crazy how a three second interaction can manifest a life-changing moment three months later
0
0
15
@omkizzy
omkaar
4 months
application layer gets all the love
3
0
15
@omkizzy
omkaar
1 year
wanna learn how discord scaled their datastore to 1,000,000,000 messages? check out
Tweet media one
1
3
14
@omkizzy
omkaar
3 months
@VictorTaelin twitter dms and replies for hiring is noisy, two ways iv seen ppl make great hires: - approach a highly technical vc (they exist) and get them to make intros within circles (they know ppl at nvidia, meta AI, etc who are bored out of their minds wanting to work on next gen
0
1
14
@omkizzy
omkaar
5 months
im going book shopping, drop your favorite book recs! idc if its about business, fiction, science, biographies, etc. I want to expose myself to something new. will post an update of what I buy :)
14
0
14
@omkizzy
omkaar
5 months
decided last night that grpc is not the right tool to use on my simple-federated-learning tutorial repository (and is a pain to build on). its going to limit the repo's power in penetrating the depths of your intuition. switching to basic REST.
2
0
14
@omkizzy
omkaar
2 months
I was waiting for Google's email about my extension getting approved... instead got this
Tweet media one
@omkizzy
omkaar
2 months
Introducing Agenata: a free, open-source web annotation tool. The demo below shows a live annotation of adding an item to cart on uber eats. Currently, SOTA web agents underperform because: 1) Fewer web trajectory datasets lead to poor reasoning and planning over different
22
23
292
0
0
14
@omkizzy
omkaar
2 months
I created an iPhone 12 ad four years ago, before they released the three camera concept, had to bring out this old gem
1
0
14
@omkizzy
omkaar
4 months
the openai's and deepmind's of the world are in a special position. most companies have to improve ux, add features, etc to win over competition. oai, dm, etc have to perform and invent literal magic to win over each other...
0
0
14
@omkizzy
omkaar
10 months
won (with my team) the @UWVelocity agetech challenge by building a working prototype that can help detect early signs of dementia and costs < $10 to build currently such machines cost $500,000+ and work by measuring plaque deposits in retina looking to build this out further!
Tweet media one
3
0
14
@omkizzy
omkaar
5 months
yesterday I completed a dist sys project in 12 hours that I had failed to accomplish in two previous attempts each of which took more than a day. it did take me a year to build the intuition. if people like it upon release I will build this further for fun maybe even drop a tut
3
0
14
@omkizzy
omkaar
4 months
the ad economy 2010s: for humans, by humans 2020s: for humans, by bots 2030s: for bots, by bots
1
0
12
@omkizzy
omkaar
5 months
Youtube SEO competition goes hard
Tweet media one
1
0
11
@omkizzy
omkaar
4 months
the past 3 weeks have taught me that agency is the most valuable currency
2
0
13
@omkizzy
omkaar
4 months
imo openai is economically constrained from releasing gpt-5. compute is a big bottleneck and they havent figured out how to effectively reduce gpt4's size to support offering that efficiently. but satya could step in and just eat the costs so openai can dominate. EOD, jensen
1
0
13
@omkizzy
omkaar
5 months
im from mumbai but this looks so much like home and i miss it a lot
@amuldotexe
amul.exe
5 months
Blr being blr a road with a canopy iykwim
Tweet media one
Tweet media two
Tweet media three
4
0
24
1
0
13
@omkizzy
omkaar
2 months
fully local, always free
3
0
12
@omkizzy
omkaar
2 months
@VictorTaelin are you referring to the HOC tuah coin?
1
0
12
@omkizzy
omkaar
2 months
i like to create different architectures from my factor meals boxes
Tweet media one
1
0
12
@omkizzy
omkaar
4 months
nvidia is nothing without its people (vcs funding GenAI startups which indirectly gets funneled to nvidia)
1
0
11
@omkizzy
omkaar
4 months
a paper should never be your defensibility and a lot of "ai" startups rn are doomed if they dont invest in research
0
0
12
@omkizzy
omkaar
4 months
cocomelons the real opp
2
1
12
@omkizzy
omkaar
5 months
"ellie goulding hits of 2010s" playlist on spotify hits so different in deep code mode
1
0
11
@omkizzy
omkaar
29 days
the tech community needs better fake praises like - you have the "creativity of an ai founder" - wow you have the "MMLU of gpt-3.5-turbo" - dude you as as agentic as SOTA ai agents!!!
0
1
11
@omkizzy
omkaar
1 year
Today I launch - systems design newsletter for busy engineers. Learn topics like how @GitHubEng achieves blazing-fast search on 300M repos. Sounds interesting? Read it (no email) at @_buildspace @FarzaTv #buildspace #buildspace
1
1
11
@omkizzy
omkaar
9 months
AI cannot replace the world's toughest job: being a good mom
1
0
11
@omkizzy
omkaar
3 months
ship or get shipped
0
0
11
@omkizzy
omkaar
2 months
could anyone connect @crsamra @SymphonicLabs to @OpenInterpreter ? theres an insane accessibility unlock waiting to happen
@crsamra
Chris Samra
2 months
"Introducing MAMO. <=>" "MAMO is a multimodal interface that lets you talk to your computer without needing to make a sound. <=>" "Powered by @symphoniclabs multimodal Silent Speech Foundation model. <=>" Signup for MAMO beta here: cc @_nightsweekends
24
8
111
1
0
11
@omkizzy
omkaar
3 months
I sometimes imagine myself on my deathbed and reflect on "biggest regret?", etc type questions. starting to realize any answers I think of now or would say then, are going to be very biased. Even answers from people currently on their deathbeds will be biased by nature.
2
0
10
@omkizzy
omkaar
4 months
synthetic intelligence will help us understand ourselves better
2
1
9