Vipul Vaibhaw
@vaibhaw_vipul
Followers
12,146
Following
3,425
Media
921
Statuses
6,409
Open source contributor - apache datafusion-comet. Maintainer raft-rs. Math Grad. Rust. Scala. Python. Distributed Systems.
Pune, India
Joined May 2015
Don't wanna be here?
Send us removal request.
Explore trending content on Musk Viewer
lisa
• 902355 Tweets
#VSFashionShow
• 336240 Tweets
Venezuela
• 257455 Tweets
Colombia
• 202963 Tweets
#السعوديه_البحرين
• 177969 Tweets
Chile
• 167882 Tweets
Adriana Lima
• 132869 Tweets
سالم
• 117876 Tweets
Jimmy Carter
• 68803 Tweets
bella hadid
• 68444 Tweets
Tyla
• 63641 Tweets
مانشيني
• 61676 Tweets
#GHLímite6
• 50276 Tweets
Cher
• 38979 Tweets
Alessandra
• 37743 Tweets
Durán
• 35384 Tweets
Candice
• 27613 Tweets
kate moss
• 26099 Tweets
#فزعه_الشعب_السعودي
• 24047 Tweets
Anok
• 23770 Tweets
barbara palvin
• 23588 Tweets
Paraguay
• 22567 Tweets
EU TE TRATO MAL
• 21771 Tweets
Gareca
• 20215 Tweets
Gisele
• 19960 Tweets
Alex Consani
• 17968 Tweets
Tyra
• 17626 Tweets
パルクロ
• 13736 Tweets
Irina
• 13395 Tweets
kendall
• 13100 Tweets
Vidal
• 12435 Tweets
#LaRojaxCHV
• 11605 Tweets
Milad
• 11123 Tweets
Pinned Tweet
If greatness necessitates adopting an unpleasant demeanour, I willingly embrace mediocrity.
Humility and empathy are qualities that often don't receive the recognition they truly deserve.
4
11
210
Matrix Multiplication: Optimizing the code from 6 hours to ~ 1 sec.
"Performance Engineering is a lost art." - Charles Leiserson
I followed this lecture -
28
322
2K
Donald Knuth advice to young engineers -
- Follow your own instincts.
- Prestige comes from doing good science, not just popular science.
- Deep knowledge builds confidence.
- A liberal education involves learning everything about something and something about everything.
8
242
1K
In the journey of every middle-class boy when he realises that the lack of respect is because of lack of money in his family.
From that day forward, a transformative shift begins.
30
94
1K
Andrej Karpathy talking about -
- rarity of talents in distributed computing with GPUs.
- the opportunities in computer architecture because von Neumann architecture may not be optimal
- progress in precision
- sparsity in neural networks
6
134
1K
I found this amazing lecture series on concurrent and parallel programming using rust.
I will be going through it myself. Not sure about the content quality but it looks good.
8
152
1K
how to learn math from scratch? This might help.
assumption is that we have knowledge of discrete math topics - functions, set theory, order and relations, etc.
Linear Algebra -
Books: Introduction to Linear Algebra" by Gilbert Strang
Topics: Matrices, Systems of linear
25
124
1K
Learning to program GPUs.
Lecture series -
Reference book -
19
139
969
Here are my favourite lectures on YT to learn distributed systems -
- MIT 6.824 Distributed Systems (Spring 2020)
- UWaterloo CS 436: Distributed Computer Systems
- lecture series by Martin Kleppmann
9
149
906
He is right. I would recommend studying the following trends in computer science -
- distributed systems
- multicore programming
- compilers
basically the backend that empowers AI. It needs a lot of work and a lot of opportunities there.
I know I’ll get a lot of backlash for this but I’ll say it anyway.
If you’re going to college for 4 years, you better be DAMN sure it’s a top rated one. In 4 years, we’ll have insanely good AI — You’d have spent that time doing irrelevant assignments while the world races past.
111
287
3K
18
65
727
A few book recommendations to dive deep in the coming years, especially if you are into systems programming, concurrency, or distributed systems:
- Art of Multiprocessor Programming - Essential for understanding parallelism and concurrency, offering practical insights into
15
90
681
Listen! Has life showered you with misery? Do you carry a generational trauma of poverty or lack of money?
WORKING HARD is your only option!
I don't need to explain about that trauma, that disrespect, that feeling of being "i don't matter". If you have felt that you know what I
47
97
672
The Father of Algorithms, Professor Donald Knuth, recreates his very first lecture taught at Stanford Univeristy.
Must watch this weekend!
0
153
595
If you are looking to learn algorithms from basics to advanced,
here are my two favourite playlist -
-
-
5
81
580
Sam talks about 'taking an year off'.
Being productive over a decade and not over-optimizing your days.
He talks about
- reading voraciously,
- traveling to different countries in conferences,
- engaging in interesting conversations
- and learning about investing.
5
46
556
If someone is interested in learning to build low-latency Trading systems, check the following talks -
-
-
-
-
5
89
554
Here are two amazing reading lists for distributed systems -
1.
2.
3
83
526
A few years ago I wrote this post while I was following MIT performance engineering lectures.
I tried to achieve numpy level matrix multiplication performance. I started with a basic code which takes 6 hours and got it to execute around 1 sec.
Numpy took 0.6 secs. 🤯
12
19
494
If you are looking to learn distributed systems, here are some interesting reads -
-
-
-
- "Problems with simultaneity in distributed systems" -
6
103
489
One developer supports 5.2 million games annually, competing closely with Chess . com's 138-person team.
No meetings, no micromanagement—just one dedicated dev who cares.
Lichess: Uses scala and typescript() mostly and it uses rust to develop low-level
9
70
484
Videos I love about startups -
1. Competition is for Losers with Peter Thiel -
2. What does it mean to do things that don't scale? Paul Graham -
3. How to Start a Hard Tech Startup with Sam Altman -
0
86
453
Don't take advice from people whom you don't see executing.
Also, Avoid learning from teachers who don't practice.
Hardy, Feynman, Einstein, APJ Abdul Kalam, Yoshua Bengio etc all were executing in their field while teaching.
14
33
440
If you are looking to dive deeper in systems engineering topics like -
- Concurrency
- Distributed Systems
- Introduction to Formal Methods
We plan to cover things like -
- Mutex, Atomics and Lock less data structures
- Coroutines, Structured Concurrency, Work stealing etc.
-
3
24
414
I have loved reading this book so far.
Patterns of Distributed Systems by Unmesh Joshi
9
40
387
Forget about memory and disk optimizations.
Yellowbricks architecture goal is to execute queries from the data persisted in CPU L3 cache rather than from main memory!
Insane system engineering.
12
34
375
Context : Build systems which will support AI. A lot of work needs to be done around distributed training and inference of AI. Look at mojo, a unified language for CPU and GPU programs.
I ain't saying AI model building is useless. I am saying that there are other areas too.
7
15
361
Operating system: three easy pieces is a good read.
I am reading a few good books these days. I need to fill some gaps in my knowledge. This book is really helpful.
It is in three parts - virtualization, concurrency and persistence.
16
11
366
Just being a teacher is a modern invention. A teacher who isn't an active practitioner in their field should be viewed with suspicion. Let me explain.
Note: My experience is in Computer Science and Mathematics, so this post is strictly about those domains.
Formal education as
12
35
334
How to Master Distributed Systems? 💡🤔
In recent years, there's been a surge in people eager to explore distributed systems. Whether you're a seasoned IT professional or a curious newcomer, grasping distributed systems might seem daunting.
Here's a streamlined approach to get
7
47
324
Finally, finished CMU Advanced DB course by Andy Pavlo.
Learnt so much!
- Vectorized query execution
- Parallel has joins
- DB networking
- Query Optimizations
- Internals of Photon, Dremel, Yellowbricks etc.
6
12
314
Reading Edgar Dijkstra's 1-page paper that introduced the notion of "mutex," I'm profoundly struck by his succinct writing.
A remarkable skill in precisely defining a problem above code, an ability that many programmers, like myself, lack.
So much to learn!
2
48
311
If you are interested in building Distributed Systems, Concurrent systems and tip-toe into formal methods, the 4th cohort of Empowered Coder is starting this weekend. 8 weeks, deep-dive and hands-on engineering. This is only for those who are really interested in exploring these
14
23
304
That itch to take a break for a year and contribute to quality open source projects and read shit ton of books!
13
19
273
Look what I found on YT.
This guy streams every week I guess and he is trying to build a kernel in C.
Crazy stuff.
3
29
302
Math and code are the purest forms of human expression.
Untouched by your upbringing, beliefs or geography.
Supreme beauty.
3
33
291
Torvalds Speaks: Rust's Impact on the Linux Kernel.
- plan is to integrate drivers and major sub-systems in rust
- it will take a some time before critical components or kernel is written in rust.
- Torvalds is not writing any rust, he is reading a lot of rust code though.
6
40
290
The next decade of computing will be around low-level engineering and formal methods!
Please don't create more wrappers around LLMs, you will be disrupted. Build deep-tech!
As systems evolve in complexity, proficiency in low-level engineering and a familiarity with formal
6
36
287
Programmers should learn to write recursion.
It is the cornerstone of good stateless programming.
Recursion encourages abstract thinking.
It is a gateway to think in terms of 'state machines'.
10
28
286
Imagine the following -
A 3 months outcome focused full-time in-person, residential bootcamp for programmers(read hackers) and mathematicians(also enthusiast), only deep tech topics -
- A GPU cluster
- networked multi-core servers
- Classic books available
- Whiteboards
41
12
290
One of the many things in computer science that utterly fascinates me, yet I may never fully understand or have the chance to work with, is CFDs -
17
16
272
Use Linux. Own your data. Make privacy non-negotiable.
Satya Nadella says Windows PCs will have a photographic memory feature called Recall that will remember and understand everything you do on your computer by taking constant screenshots
5K
3K
10K
5
36
277
Don't fall for 52 books a year type of bs advice!
Read high quality books. Read maybe 5-6 books a year. Dense book. They should force you to think. Then write a lot, think about the new ideas you got.
22
19
274
This week I am learning async rust.
Today I learnt -
- Streams
- Fused Streams
- repeat_with and unfold
- Chain and Zip
- working of a Async Runtime
Follow along here -
Following img is a representation of how an async-runtime, say tokio work.
7
34
272
If you're looking for one piece of life-changing advice:
Find an active open-source project that aligns with your interests. Contribute to it regularly without expecting anything in return.
This is the best way to remind yourself, "I still code things that excite me!"
4
13
263
Okay, so it begins. This is just a placeholder title.
I will be writing a book on "Code and Math".
I have got a few book ideas, which one would you like to read?
- Code and Math -
Intersection of Math and Software. Influence of math in Computer science. Topics like queuing theory, set theory, formal methods but very non-academic.
- The Mathematics of War -
Understanding
22
3
122
20
11
248
Let me say this, Don't fake it.
If you think you don't know something, learn it. Take time - watch lectures, build prototypes etc.
In this world of pretence, Be honest, at least to yourself!
Lastly, with countless ways to live, choose the one that brings you true happiness.
5
26
250
Designing a good, fast, portable SIMD algorithm with rust.
Loved this blog.
2
33
246
Here is the video from today's call where we discussed
- Abstractions.
= thinking about computation in terms of state machine and state transitions.
- Coding as a Mathematical Proof using kani, a model checker in rust.
5
36
242
System Performance -
- LISA19 - Linux Systems Performance -
- Tuning Essentials - Linux Performance Optimization - Red Hat EX442 -
Please let me know if you have some resources, I want to get deeper into it.
4
17
242
Always fantastic to catch up with you
@arpit_bhayani
.
Loved the 2 hour discussions we had about -
- systems
- Teaching online and cohorts
- consistent hashing
- DiceDB, raft-rs
- working towards building deep tech companies
- communities and open source
- managing ego, etc.
3
0
235
If you are interested in -
- diving deep in concurrent systems
- exploring distributed systems
- read TLA+ spec and other formal method tools like Kani
- learn about GPUs
- write assembly code and import that in rust (new addition)
- read some research papers
- so much more.
7
20
231
Mad respect for
@MLStreetTalk
. It is still the top tech podcast. Each episode is equivalent to netflix production quality.
Here is Simon Prince talking about Deep Learning and his new book.
If you are looking to get started in DL, this is the video!
3
33
233
Reading this today evening.
'How to do Great Work" - Paul Graham
6
26
229
I love talking to humble, smart people.
I dislike being friends with people who think they are smarter than everyone else.
8
15
224
Spent this weekend implementing raft in rust.
Work in progress. You can follow along -
3
18
214
The truth is, you’re likely not as good as you think. It’s hard to accept, and your ego resists it.
But that quiet voice urging you to improve? It’s probably right.
8
13
211
Prove math. Code projects. Build things. Teach others. Write extensively.
1
14
205
Understanding concurrency is the key skill of this decade.
6
7
205
- Learning to learn is tough. Schools fail here. Master it, and you’ll do wonders.
- Rust, C, Scala - don’t seek the best. Choose the one that lets you express yourself. We need to find a semantic level in which we are most comfortable in. The world needs C devs, GO devs, Java
1
14
207
These kids should get a reception similar to Indian Cricket team or coverage similar to ISRO.
They will inspire generations.
I also prepared for INMO in Bihar, a state with no culture or mentorship for this. Despite the challenges, the impact on my life was phenomenal.
It’s a matter of immense joy and pride that India has come 4th in its best-ever performance in the International Maths Olympiad. Our contingent has brought home 4 Golds and one Silver Medal. This feat will inspire several other youngsters and help make mathematics even more
2K
10K
72K
4
10
198
"I was just an ordinary person who studied hard" -
“Study hard what interests you the most in the most undisciplined, irreverent and original manner possible. - Richard Feynman
3
15
194
Learning to teach concurrency for the empowered coder cohort by Leslie Lamport himself -
3
27
192
Week 2 : Distributed systems and Concurrency cohort. We discussed this seminal paper by Edgar Dijkstra.
We will also be working on a transpiler project related to parallel programming. More updates to follow.
2
15
184
Citybound a high performance distributed actor systems written in rust.
This is written by 1 person! in his spare time!! 🤯
4
18
183
Elon Musk had 0 years of experience in the aerospace industry when he started SpaceX and built re-usable rockets.
Linux was built entirely asynchronously and remotely.
Apollo 11 Guidance Computer (AGC) operated on a single-threaded architecture.
Ramanujan's brief life yielded
3
13
188
If you are into compilers or programming language research then this is an amazing repo by
@wordsofteekay
5
36
183
This was a super interesting read. Understanding Push vs Pull query engines.
1
18
185
Read for this weekend -
A critique of the CAP Theorem -
5
19
184
A great podcast where
@ponnappa
shared his insights on -
- generalist vs specialists debate
- building a consulting + product company
- angel investing
Heard him on a twitter space, loved his thinking.
I hope to get a chance to talk to him soon!
5
16
179
writing some arm assembly for my book.
The goal is to demonstrate the "cost" of abstractions.
9
5
180
Tech is a cooperative game. Stop gatekeeping.
Respect those in tech for financial goals or mere interview success; these pursuits are valid.
Everyone has the right to earn for their family's well-being and personal upliftment.
Technology - a powerful facilitator.
6
13
174
Sometimes It's hard to believe - 4 years of education and never read a single research paper? What were you doing?
However, the good thing is that you can still start doing it.
Visit the websites of top conferences like VLDB, NeurIPS etc and find a paper that interests you.
10
8
175
Career update -
Excited to join Resonatehq as engineer to work on durable async/await.
What makes it even more exciting?
- It's an open-source project.
A compact yet dynamic team all set to embark on the journey of building from the ground up.
29
1
173
Learn Math, people!
Not just AI, it is very useful in thinking about distributed systems too.
The more I am learning about Formal methods the better my thinking process become. Understanding RAFT from its TLA+ spec is so intuitive and all you need is basic Set Theory.
I’ve signed this letter alongside many others to emphasize the profound importance of math education. I think a deep understanding of math will help us build elements that will bring AI usefully into the human world.
58
183
2K
6
10
168
This came in very late at night. Time to start my day with it now.
Learning GPU optimizations. Some amazing list of speakers.
Thank you
@chipro
for organising this. This was very helpful.
0
25
168
Every project at CMU Advanced DB course 2024, built on top of Datafusion.
To me, this denotes a clear trend towards "composable data stack" hypothesis.
Datafusion is designed from the ground up for extensibility.
Also, Rust lang was de-facto choice.
4
27
167
Leslie Lamport talks about 'The key differences between a programmer and a coder'.
Decide Behaviour -> Choose Algorithm -> Write Code
However, most of us fail to think a level above code. With increasing complexity in engineering, thinking in systems becomes a necessity!
2
35
163
If you are interested in Byzantine Fault Tolerance,
here is an amazing talk by Ittai Abraham (
@ittaia
) -
He spoke about -
1. Single Shot -> Consensus -> State Machine replication
2. Omission Model -> Byzantine fault tolerance
3. Blockchains
3
29
162
nice read about Amazon S3 formal verification using rust ecosystem.
Prusti - to do verifications.
3
20
161
Hardware Design in Rust - rust-hdl and Intro to FPGAs
1
18
159
I was talking to an ex-Meta, Founder-CEO of ML Infra startup.
The amazing and important open source contribution of Meta is under-appreciated -
Data - RocksDB, Cassandra, GraphQL
AI - Pytorch
Frontend - React
Testing - Jest
Document - Docusaurus
4
17
156
A mathematician is not a scientist. A Physicists is not an engineer. A linguist is not a poet. A reporter is not a writer, etc.
-----------------
Coding can be taught in 2-3 month bootcamp.
After acquiring that, an individual has the option to either delve into mathematics,
Stop calling yourself Software Engineer.
You’re not an engineer.
171
84
2K
2
8
154
April meetup : Understanding Groq's LPU by
@abhi9u
Thank you so much for taking out time to present this talk for us.
1
20
155
Every modern database you see is being designed with a hardware-first approach.
Even if you don't become a Hardware expert, understanding hardware will bring in immense value.
Gone are the days of generic software programming with h/w abstractions.
Love rohan's advice.
Leave the realm of the database/compilers!
They already have people that are more skilled in their craft than you could ever be as a novice.
Rather start learning hardware!
11
23
247
4
17
153