![Shayon Mukherjee Profile](https://pbs.twimg.com/profile_images/1335067130706976768/yYzvMpSs_x96.jpg)
Shayon Mukherjee
@shayonj
Followers
992
Following
28K
Statuses
3K
Everything, everywhere - always in progress. Do less, well. πββοΈπ¨π½βπ³π»
Cambridge, MA
Joined October 2009
Heya! Thanks for reading. I don't have specific numbers, mostly because it's meant to be a high level doc (mentioned in the post). However, these are mostly references from my personal experience from managing 100+ PG clusters, where each cluster manages 10-12 k commits/s at peak with 15-30TB database size at peak, if that helps :) I must say, i totally forgot about connections when writing that post π. Perhaps in the next one. I'd be curious to learn about any anecdotes from your experience too ππ½
2
0
2
RT @tines_hq: Weβre thrilled to announce our Series C fundraise and company valuation of $1.125 billion. β¨ WATCH: CEO @eoinhinchy shares wβ¦
0
6
0
Using a proxy table for counter helps where the only updates that are done are for counters. Something like this (from an internal tech plan) Load testing showed better results, also ofc because reads are extremely fast now, while writes do take a bit of an hit. Be interesting to do a load test and compare the results between updating the single row vs spread across 100 rows/slots.
0
0
1
@isamlambert That has been my sense too. Esp when it comes to QPS. Good examples of larger companies doing sharded setups fwiw.
0
0
1
Really cool and impactful work from the folks at @paradedb on how they moved their Tantivy-powered search from the file system to Postgres block storage. Really clear explanation of the challenges and solutions π (must read)
1/11. ParadeDB is now integrated with Postgres block storage. As far as we know, no one has integrated a search and analytics engine with Postgres storage before. This is a big deal. Here's why we did it, how we did it, and why you should care. π§΅
0
1
6
@_mfridman Very nice indeed. A small footprint that takes in flags and falls back to env vars (a feature req if I may) is what I usually need 99% of the time :).
0
0
1
@eatonphil Just these two for now. I found the basics and guides to ingredient sections extremely useful. Especially getting the βscienceβ right of what goes well with what, how to use existing ingredients for the resources required, building good mental models and so on.
0
0
1
I have been recently looking into LSM trees as I think it solves certain use cases very well. Stumbled upon this thread in Postgres ML - I would _love_ a PG compatible (fully) LSM solution if possible. And yes I did try to bake in rocksdb into PG, it "worked" but also failed hilariously :D.
I would welcome an empirical study or survey paper comparing B-Trees and LSM Trees, focusing on performance, resource utilization, and code complexity
1
0
4