Jonathan Lei Profile Banner
Jonathan Lei Profile
Jonathan Lei

@jonathanlei0

Followers
699
Following
586
Media
48
Statuses
382

credit card connoisseur // airline miles collector; and also cloud architect @voltagepark

Massachusetts, USA
Joined April 2016
Don't wanna be here? Send us removal request.
Explore trending content on Musk Viewer
@jonathanlei0
Jonathan Lei
7 months
ahahahah my christmas gift has finally arrived! :)
Tweet media one
11
0
76
@jonathanlei0
Jonathan Lei
1 year
5:24 AM @hackmit . Have 3 psets due at night, but I will not sleep yet- my team’s project is not done!!
Tweet media one
11
1
68
@jonathanlei0
Jonathan Lei
1 year
The harvard dorm setup :))
Tweet media one
2
0
39
@jonathanlei0
Jonathan Lei
1 year
Tmr at HackHarvard, TensorDock will be giving 300 limited edition miniature petite glassware. For water and Celsius consumption only, of course Come meet our team, learn about our GPU cloud, and win some free credits! (This could either be the best or worst marketing expense…)
Tweet media one
5
1
27
@jonathanlei0
Jonathan Lei
1 year
My first hackathon project in 2 years: vision OS text to 3D - @scale_AI Generative AI hackathon with @0xSigil @rrchalamala @0xSigil Made in less than 8 hrs :))
@mollycantillon
molly cantillon
1 year
Dream with Apple's Vision Pro 🪄 Transform your imagination into a stunning immersive reality 💭 Simply type in your vision, and voila - the objects appear right before your eyes! 🐘🗡️🔮 Built with 💪 @0xSigil @rrchalamala @jonathanlei0 at Scale’s Generative AI Hackathon.
Tweet media one
12
8
111
1
1
25
@jonathanlei0
Jonathan Lei
7 months
Astoundingly true lesson: if someone repeatedly talks about how good they are, they aren’t. Applies to advice, assistance, money, etc “My offer is so generous” when repeatedly mentioned, is such a red flag for me
4
1
22
@jonathanlei0
Jonathan Lei
7 months
Literally half of my comp is the free travel that comes with the miles we earn… 4x back on cloud service providers with Amex Gold card is insane Too bad that’s capped at $150k :))
@martin_casado
martin_casado
7 months
Very interesting hack I just learned. Put GCP on company credit card, and use earned flyer miles so everyone flies free ...
21
6
292
1
1
23
@jonathanlei0
Jonathan Lei
9 months
Today I learned I have a Pitchbook account through Harvard SSO. Huge W
2
0
21
@jonathanlei0
Jonathan Lei
8 months
From my calc partner yesterday: “humans are like vectors. We need direction for the magnitude to mean something” Well said, Marko, well said.
1
0
18
@jonathanlei0
Jonathan Lei
7 months
I feel like I’ve been really calm and happy lately. I think that this is because I have a lot of agency over my own life: whatever I want, I will try to find a way to get. Today I realized that this is something I subconsciously look for in other people as well
2
0
17
@jonathanlei0
Jonathan Lei
7 months
This is one of the coolest things I’ve seen in a while. Big hats off to the team, and proud to see it runs on TensorDock infrastructure!
@8teAPi
Prakash (Ate-a-Pi)
7 months
Story opening early access today. give it a whirl.
54
66
282
0
1
14
@jonathanlei0
Jonathan Lei
9 months
@G413N Rent it to me! We pay ~$200/mo/4090 and you can use the money you earn to rent beefy A100s and H100s on demand :) This looks like a gigabyte mobo btw?
1
0
15
@jonathanlei0
Jonathan Lei
6 months
Yesterday, I ran the same ML workloads across a dozen GPUs. H100 and A100 performance is unbeatable, but the price-to-performance of lower-end cards is much better. L40 and RTX 6000 Ada outperform the A100 at some tasks, as they are 1 gen newer (thread)
6
1
13
@jonathanlei0
Jonathan Lei
7 months
amazing people, amazing program! defo consider applying if you're into human augmentation
@auglab
Augmentation Lab
7 months
We are hosting a residency on Wearable AI & Personal Agents. 16 hackers, 8 weeks, at Harvard & MIT. Join to work on the HARD problems in building deeply personal, privacy-conserving agents. More here
7
16
105
0
0
12
@jonathanlei0
Jonathan Lei
11 months
(1/n) what did i do why is everyone running ads on tensordock's name now is this war? do i retaliate and run ads on their keywords?
Tweet media one
3
0
12
@jonathanlei0
Jonathan Lei
7 months
Small piece of wisdom through experience: relationships are more important than sales. If a big customer is leaving, do not panic. help them through the process. Graciousness is rewarded in the long run.
0
0
9
@jonathanlei0
Jonathan Lei
2 years
Just added! Carbon neutral NVIDIA A100 80GBs from $1.32/hr (vs $5.12/hr on GCP/AWS!)
Tweet media one
0
1
9
@jonathanlei0
Jonathan Lei
7 months
Taking on funding is associated with adding obligations [to generate returns for investors], which in turn decreases your agency. In that sense, I'm really lucky that the investors I work with intentionally do not encroach but somehow remain super helpful
0
0
7
@jonathanlei0
Jonathan Lei
11 months
Built using good old plain HTML and hosted on Cloudflare pages. 97/100 on PageSpeed Insights
1
0
7
@jonathanlei0
Jonathan Lei
5 months
@itsandrewgao @TensorDock Yes! 3090 is goated (and so is the 4090, A5000, 5000 Ada etc)... if you don't need more than 24 GB of VRAM
0
1
5
@jonathanlei0
Jonathan Lei
5 months
the actual video has like 5 straight mins of this, Silicon Valley HBO show writers could not even make this up the greatness starts at -2:09:41
@keshavchan
keshav
5 months
openai drops gpt4-o, meanwhile google
306
690
8K
0
0
7
@jonathanlei0
Jonathan Lei
7 months
Our H100s are available in full 8x node configurations with full 7.2TB/s NVSwitch and NUMA topologies passed into virtual machines. Further, preallocated RAM, RAM-based VM filesystem caching, and further optimizations make for near, or even better than bare metal performance :)
1
0
5
@jonathanlei0
Jonathan Lei
2 years
TensorDock Marketplace will be going public next week - so excited! Amazing Preview some of the lowest costs on the private marketplace right now. Prices include CPU/RAM/NVMe SSD: 3090: $0.30/hr - vs $3.60/hr @ iRender 3080: $0.20/hr - vs $0.90/hr @ Genesis Cloud 1650: $0.10/hr
Tweet media one
0
1
6
@jonathanlei0
Jonathan Lei
8 months
Meta to make an open source Sora alternative?
@ylecun
Yann LeCun
8 months
@model_mechanic Hi Aditya, ants have 6 legs, no?
151
22
1K
1
0
6
@jonathanlei0
Jonathan Lei
7 months
Update: I know I should not be this happy, but I ended up with the only empty row! Window seat pax must have decided to move to a front window seat, leaving me with this bed :)
Tweet media one
Tweet media two
Tweet media three
0
0
5
@jonathanlei0
Jonathan Lei
7 months
The one thing that remains relatively constant across time seems to be culture. Competitors come and go, customers come and go, team members come and (eventually) go — but culture remains constant. A strong team hires strong teammates, and the cycle repeats…
1
0
7
@jonathanlei0
Jonathan Lei
2 years
Michigan servers coming online soon!
0
0
5
@jonathanlei0
Jonathan Lei
7 months
Air France roulette - will I get an empty row? (Flight is in 10 hrs. Normally I’m a front cabin window person, but I figured I have a higher chance of getting a row to myself if I select a back aisle seat… hoping some tour group doesn’t claim all seats and make me regret this)
Tweet media one
1
0
5
@jonathanlei0
Jonathan Lei
11 months
(5/n) PRICE LOW --> LOW STOCK, NO AD SPEND Some clouds price low. Longer than 18 month ROI even at 100% utilization. And they get that utilization. They don't spend on ads, and they don't need to—stock is always rented! But it also means you can't scale if you use them.
1
0
3
@jonathanlei0
Jonathan Lei
2 years
Up to 8x NVIDIA A6000s available on TensorDock Marketplace for $0.415/hr ea
2
2
5
@jonathanlei0
Jonathan Lei
7 months
From what I can tell, these are THE world's cheapest on-demand H100s. Sub-$2/hr pricing is typically what you'd need a 3 year commitment for. We've priced these in staggered so that you always know you're getting the best price you can while having availability to scale 🎉
0
0
4
@jonathanlei0
Jonathan Lei
5 months
by now you definitely could have deployed your own 3 70B on a <$3/hr H100 instead of waiting for chatGPT to come back online 😛
1
0
5
@jonathanlei0
Jonathan Lei
1 year
I find tech bros (err, maybe just myself 😅) are drawn to artificial imitations of real life. Indoor rock climbing, silent discos, DoorDash/Uber Eats, soylent. (when I suggested to walk on treadmills with VR goggles, a friend didn’t realize it was a joke!)
0
0
5
@jonathanlei0
Jonathan Lei
8 months
@natfriedman @GpuList Posting submitted ! :)
1
0
5
@jonathanlei0
Jonathan Lei
7 months
@CalebDenio $96 for priority boarding is objectively absurd And it's not like boarding early for economy gets you anything - who wants to pay to get into the metal sardine can first?
1
0
3
@jonathanlei0
Jonathan Lei
1 year
TensorDock: 100+ globally distributed GPUs. Deploy on-demand or bid from just $0.05/GPU/hr. A4000s from $0.17/hr V100s from $0.22/hr 3090s from $0.22/hr 4090s from $0.37/hr A100 80GBs from $1.22/hr
1
2
4
@jonathanlei0
Jonathan Lei
1 year
@jonxuxu Yes- come rent it to us
0
0
4
@jonathanlei0
Jonathan Lei
3 years
First picture of TensorDock's rackspace at Singapore at Ascenix! Many more servers to come :)
Tweet media one
0
2
4
@jonathanlei0
Jonathan Lei
2 years
Demand exceeding supply on our marketplace, so having to reserve specific hostnodes to high spending customers so that the machines don't get taken up by other customers first😮‍💨
Tweet media one
0
0
4
@jonathanlei0
Jonathan Lei
2 years
TensorDock is hiring! Why join? - Build cloud infra that researchers, startups, and hobbyists use to build products of tomorrow on - Quickly-growing reseller business - Strong balance sheet, with physical assets spanning BOS to SIN - Net profitability
Tweet media one
0
1
4
@jonathanlei0
Jonathan Lei
2 years
Just exited my website hosting business () to @servarica - they are an absolute pleasure to work with!🎉
0
0
4
@jonathanlei0
Jonathan Lei
2 years
Each one is a TensorDock virtual machine! :) In a single day, more than 1/10 of our virtual servers are created/deleted. Yet volume is so high that actual usage ends up being rather consistent - generating consistent revenue for hosts!
Tweet media one
0
0
4
@jonathanlei0
Jonathan Lei
11 months
(6/n) There isn't really a good middle ground; no traditional cloud is both cost-effective AND scalable. At TensorDock, we're trying to commoditize compute into something that can be traded like grain. Whenever inventory is rented out, suppliers add more—albeit at higher prices.
1
0
3
@jonathanlei0
Jonathan Lei
11 months
1
0
2
@jonathanlei0
Jonathan Lei
2 years
From one of our hosts!
Tweet media one
0
1
3
@jonathanlei0
Jonathan Lei
10 months
@kdrag0n Rite of passage indeed! During Thanksgiving I finally got around to moving everything (projects, TD microservices, S3 backups, etc) off AWS. Now everything costs <$100/mo combined Taking the AWS activate credits was a huge mistake in hindsight 😅 egress fees be a cash cow
Tweet media one
2
0
2
@jonathanlei0
Jonathan Lei
7 months
Update: a tour group filled up all the remaining seats :)
1
0
3
@jonathanlei0
Jonathan Lei
2 years
@clairebookworm1 Boston! So that it’ll be close to home for me :)
0
0
3
@jonathanlei0
Jonathan Lei
2 years
Working on new API for the @tensordock marketplace :) First endpoint done!
Tweet media one
0
1
3
@jonathanlei0
Jonathan Lei
2 years
Peak usage from earlier month: 400 concurrent GPU virtual machines!
0
0
3
@jonathanlei0
Jonathan Lei
2 years
Team building servers :)
Tweet media one
0
1
3
@jonathanlei0
Jonathan Lei
1 year
I visited @aaronchewbani / @calebsirak from @FUN in July- they’re building infrastructure for crypto authentication. excited to see them launch!
@FUN
Fun.xyz
1 year
Introducing 🔥🔑🏦 The easiest way to build crypto accounts without compromising usability, trust, or security. Fully non-custodial. Powered by ERC-4337. Built on @BuildOnBase 🚀 /1
98
157
571
0
0
3
@jonathanlei0
Jonathan Lei
11 months
(9/9) So... if you need GPUs, try us out! Hundreds of GPUs released and claimed daily --> 3090s from $0.21/hr --> A6000s from $0.47/hr And if you believe in our mission, shoot me a DM! I'm looking to add 1-2 opportunistic full-time hires to our team :)
1
1
3
@jonathanlei0
Jonathan Lei
1 year
@levie It exists - :)
0
1
1
@jonathanlei0
Jonathan Lei
2 years
@amasad @0interestrates Holy shit. I run the high school hackathon Hack3 of the T-shirt @0interestrates is sporting — keep it strong! Hope the team you met + workshops you hopefully attended will help you find a job after being fired from twitter🤣
0
0
2
@jonathanlei0
Jonathan Lei
11 months
(4/n) and these are the ones that you should only ever use for bursts. In general, if you need X thousand servers, and someone has them in stock available tomorrow, they're going to be overpriced... because that's why nobody else is renting them
1
0
2
@jonathanlei0
Jonathan Lei
10 months
@kdrag0n @willdepue @LambdaAPI @runpod_io LMAOOO true true, @willdepue when you need more GPUs, I gotchu as well
0
0
2
@jonathanlei0
Jonathan Lei
11 months
(7/n) There's always an equilibrium that guarantees both inventory availability and cost-effectiveness. When you rent servers from us, you get the best deal available. You can scale up/down without needing to integrate multiple cloud providers' APIs, albeit at higher unit prices
1
0
3
@jonathanlei0
Jonathan Lei
7 months
@developedbytoby A welcome change! Though wholesale bandwidth costs almost always average to less than <$0.01/GB at data centers :)
0
0
3
@jonathanlei0
Jonathan Lei
2 years
A really cool rendering... future ad incoming!
Tweet media one
0
1
3
@jonathanlei0
Jonathan Lei
8 months
@XaevrM @AravSrinivas Oo thx for the mention! Honored :))
0
0
2
@jonathanlei0
Jonathan Lei
7 months
@abacaj Try increasing the ram in the filter above :))
0
0
2
@jonathanlei0
Jonathan Lei
6 months
Lambda Labs did a similar GPU benchmark a while ago, and I just wanted to point out that their measured H100 PCIE performance is only 20% better than A100 PCIE performance as well
1
0
2
@jonathanlei0
Jonathan Lei
8 months
1
0
2
@jonathanlei0
Jonathan Lei
2 years
Mmmmmm 8x A6000!
Tweet media one
0
0
2
@jonathanlei0
Jonathan Lei
2 years
Just reduced our database usage by 50%+ by merging together individual transactions & creating monthly spend ones 🎉 (Backups made of course, but the primary db should be much snappier now)
1
0
2
@jonathanlei0
Jonathan Lei
2 years
My favorite place to be
0
0
2
@jonathanlei0
Jonathan Lei
2 years
@stephenbalaban @MasterScrat @stephenbalaban Just to understand, $100k leads to ONLY $35k spending at reduced costs right? H100 SXM: $2.8 -> $1.98, $14.5k/yr saved So $100k upfront would take ~7 years to generate a ROI on for H100 SXMs. For A100 40G, ~11 yrs
2
0
2
@jonathanlei0
Jonathan Lei
2 years
Congrats to @max_elbo / (a TensorDock customer) for being featured in The Spectator! Honored to have provided you with the infrastructure to create these wonders :) Also, @spectator , thanks for mentioning us in the image credits!
0
1
2
@jonathanlei0
Jonathan Lei
2 years
@alecvxyz @michelleefang That seems like United Polaris on a 777! Lie flat bed :)
1
0
2
@jonathanlei0
Jonathan Lei
3 years
is one of the companies that never ceases to amaze me. I used to never use Twitter; now, I log on once a day and try to create something new with @max_elbo . I feel like I'm becoming a bit of an art connoisseur trying different art styles!
@puppetryai
Puppetry
3 years
We just cross 2000+ images generated 🥳! Thank you all for being our early adopters and trying us out 🙏. If you are thinking of signing up for our creative plan, please use the coupon PICASSO to get 20% off FOREVER! (Only 30 coupons available).
3
0
6
1
1
2
@jonathanlei0
Jonathan Lei
2 years
@NothotdogCorp @skr_elbo @danielgross @TensorDock Thanks for the mention @skr_elbo ! @NothotdogCorp - happy to give you some free credits if you'd like. Shoot me an email :)
0
0
2
@jonathanlei0
Jonathan Lei
1 year
The setup tonight at Helsinki Airport. 10:47 PM and sunset
Tweet media one
Tweet media two
0
0
1
@jonathanlei0
Jonathan Lei
7 months
@stanleyzhaoo @pitdesi @vladtenev Interchange (what merchant pays so that the card is accepted) after network fees will probably be only ~2% for RH. So the rest has to come from enough people moving over balances from month to month on their high APR. they’re basically subsidizing people who pay on time
1
0
2
@jonathanlei0
Jonathan Lei
11 months
(8/n) It's a win-win-win: - you get compute at the market's best prices - suppliers serve more workloads than they would without us (customers use us and pay a premium because they can scale across our entire network of hosts rather than a single one) - we take a cut.
1
0
1
@jonathanlei0
Jonathan Lei
2 years
@stephenbalaban @MasterScrat Gotcha - this would probs be the more significant benefit than pure discounts :) (ROI on money in 7-ish yrs = ~10% YoY return which while good, is hard to justify from a cash allocation standpoint purely from a risk/security view for a startup like mine)
1
0
2
@jonathanlei0
Jonathan Lei
2 years
Launching long-term cloud servers for 10 GPU models at 11 locations! More options, lower prices! NVIDIA A100 servers for only $950/month!
@TensorDock
TensorDock
2 years
Check out our new subscription service!
0
2
2
0
0
2
@jonathanlei0
Jonathan Lei
5 months
0
0
2
@jonathanlei0
Jonathan Lei
6 months
When grouping by VRAM, we see a clear trend. Lower VRAM GPUs consistently provide better value... but that's only useful if your model fits on the GPU. So rule of thumb: always use the smallest GPU your model can fit on if you want the best value.
Tweet media one
1
0
2
@jonathanlei0
Jonathan Lei
11 months
(3/n) PRICE HIGH --> PLENTIFUL INVENTORY. H100s should not cost $5/hr+ on-demand, but some clouds charge that. When they're rented, great! But much of the time, they aren't. Expensive clouds are also the ones dumping money on ads to try to fill them up....
2
0
2
@jonathanlei0
Jonathan Lei
2 years
@skr_elbo @max_elbo 🔥🔥🔥🔥🔥🔥🔥🔥🔥 Amazing!
1
0
2
@jonathanlei0
Jonathan Lei
10 months
@SarahChieng Have him shoot me an email! —> Jonathan [at]
0
0
1
@jonathanlei0
Jonathan Lei
11 months
@aidenybai omg, congrats so much Aiden!!! 🥳
0
0
1
@jonathanlei0
Jonathan Lei
2 years
@max_elbo #create beautiful flowers
20
0
2
@jonathanlei0
Jonathan Lei
3 years
An inside glimpse at the hardware we've been testing over the past month at #TensorDock . We rigorously test each hardware configuration before deploying it. AMD Ryzens coming soon?😉 We have over 1k GPUs in-stock, ready for deployment:
Tweet media one
1
1
1
@jonathanlei0
Jonathan Lei
6 months
The generational speedups from NVIDIA's newest chips come more from the interconnect that allow you to train or run inference more efficiently across a number of nodes and not the unit performance from individual GPUs :)
0
0
2
@jonathanlei0
Jonathan Lei
2 years
Sneak preview of upcoming TensorDock compute marketplace... In dark, with organizations so you'll be able to invite your coworkers!
Tweet media one
0
0
2
@jonathanlei0
Jonathan Lei
11 months
(2/n) In all seriousness, this is symbolic of the widely-differing pricing/business strategies cloud providers employ. I'm leaving out reserved, prepaid, and lease-to-own arrangements for this short thread.
1
0
1
@jonathanlei0
Jonathan Lei
2 years
18 GPU servers created today on the TensorDock Marketplace!🎉 At the lowest stock during past two months Still available: 9 A6000s from $0.42/hr, 7 3090s from $0.22/hr, etc. Adding a boatloads more A4000s at $0.14/hr next month along with more 3090s
0
0
2
@jonathanlei0
Jonathan Lei
7 months
@itsandrewgao @TensorDock holy shit that’s huge
0
0
1