Justin Profile Banner
Justin Profile
Justin

@justinjaffray

Followers
1,827
Following
599
Media
1,076
Statuses
5,811

turning to the succor of modern computing machines, let us renounce all analytic tools

he/him
Joined February 2012
Don't wanna be here? Send us removal request.
Explore trending content on Musk Viewer
@justinjaffray
Justin
2 years
A friend at LinkedIn who would prefer to remain nameless tells me they reduced their storage costs by 7% just by manually interning the phrases "Congratulations!", and "Congrats, <name>!" in their comment database schema.
12
30
548
@justinjaffray
Justin
4 years
for my money the best paper ever written on query optimization is this one from 1998
Tweet media one
5
45
350
@justinjaffray
Justin
3 years
Tweet media one
0
13
153
@justinjaffray
Justin
1 year
Joins 13 Ways:
Tweet media one
4
24
143
@justinjaffray
Justin
2 years
I came across a really cute algorithm for count-distinct yesterday and couldn't believe I hadn't seen it before, so I did a little write-up on how it works:
9
23
132
@justinjaffray
Justin
3 years
@jesawyer is this the parasite house
1
0
123
@justinjaffray
Justin
5 months
This week I picked a couple query optimizations arbitrarily and checked if DuckDB, CockroachDB, Postgres, and Sqlite did them or not:
Tweet media one
5
18
125
@justinjaffray
Justin
2 years
A Gentle(-ish) Introduction to Worst-Case Optimal Joins
5
24
93
@justinjaffray
Justin
1 year
we did it team
Tweet media one
5
3
89
@justinjaffray
Justin
2 years
*first contact with an alien* me: hey btw can you guys do SAT in polynomial time <alien jeff👽 has sent > me: is this c++? them: yeah just run make me: it says im missing something called "libyorbo" them: oh really? thats required for posix here
3
10
83
@justinjaffray
Justin
26 days
today is the actual anniversary of the first NULL BITMAP, and so I wanted to share a couple of my favourite issues from the first year, in no order
Tweet media one
1
6
82
@justinjaffray
Justin
13 days
tree bf lsm gf
Tweet media one
0
5
77
@justinjaffray
Justin
3 years
wrote a post on some broad strokes differences between push vs. pull query engines
4
18
73
@justinjaffray
Justin
5 months
NULL BITMAP: My First Distributed System
Tweet media one
1
2
61
@justinjaffray
Justin
7 months
My tweet about Chaudhuri's 1998 paper was weirdly popular so here is a small sampling of some other query planning related papers that I really like
3
10
60
@justinjaffray
Justin
6 years
paxos made simple
Tweet media one
0
26
55
@justinjaffray
Justin
4 months
NULL BITMAP: I wrote down some thoughts on the problems you run into when trying to represent non-treelike expressions for query languages, and some of the solutions I've seen:
2
7
53
@justinjaffray
Justin
2 years
it requires such an enormous brain to market your database saas like its an iphone. in awe
@PlanetScale
PlanetScale
2 years
We are doing something that’s never been done before…
Tweet media one
48
50
910
1
5
53
@justinjaffray
Justin
5 months
@TylerGlaiel born too early to use the app store. born too late to fall for email scams. born just in time to know how to use a filesystem
0
1
52
@justinjaffray
Justin
3 years
wrote a post about compaction, from the perspective of comparing the behaviour of CockroachDB's Pebble with that of Differential Dataflow:
5
9
52
@justinjaffray
Justin
4 years
Today is my first day at @MaterializeInc ! I also have a new blog post—in preparation for starting, I read some of the papers for the tech underlying the system, which led me to an interesting problem which I wrote about here:
2
5
51
@justinjaffray
Justin
7 years
been a while since a good ol' fashioned celeste gif: you can get the berry on 1400m without ever dashing cc @baldjared_
0
4
48
@justinjaffray
Justin
2 years
Functional Dependencies and Orders:
3
7
49
@justinjaffray
Justin
9 months
my take these days is that nobody actually cares about database correctness ~at all. 98% of people who say they like jepsen actually just like snark
9
1
48
@justinjaffray
Justin
11 months
This week I wrote a bit about some of the ways I have seen columns represented in query optimizers, in particular a nonobvious (IMO) way that is vastly superior (IMO) to the obvious way:
2
4
47
@justinjaffray
Justin
3 years
ceci n'est pas une jpeg
@rachelmillman
rachel
3 years
there is an incredible slapfight happening over on Wikipedia over whether or not to classify NFTs as art
10
39
414
2
7
44
@justinjaffray
Justin
6 years
Tweet media one
0
2
33
@justinjaffray
Justin
3 months
NULL BITMAP: a very brief intro to some fundamentals of join ordering:
Tweet media one
1
4
44
@justinjaffray
Justin
10 months
this week i wrote about a reductive but helpful (to me) way of thinking about how datalog works. and also followed up on some threads from last week. i hope you like it
Tweet media one
1
4
41
@justinjaffray
Justin
11 months
Tweet media one
0
0
42
@justinjaffray
Justin
1 year
I really enjoyed @TylerGlaiel 's post the other day, and while it wasn't the point, I thought his pathfinding problem was interesting enough that I should write down some thoughts on it:
Tweet media one
Tweet media two
0
6
41
@justinjaffray
Justin
9 months
The Little Planner Chapter 4: A Pushdown Party
Tweet media one
1
3
37
@justinjaffray
Justin
3 years
what the heck is a 'redo log.' what the heck is a 'memtable.' all this and more in my latest post
6
12
38
@justinjaffray
Justin
1 year
@nkulw this is so funny lol
Tweet media one
1
0
34
@justinjaffray
Justin
6 years
I wrote about (exactly) what can go wrong with Snapshot Isolation: What Does Write Skew Look Like?
4
7
37
@justinjaffray
Justin
4 years
new post: query optimizer cost models are notoriously complex, what does this mean and how can we alleviate it?
1
4
36
@justinjaffray
Justin
7 years
got something real goofy in the pipeline #pico8
2
6
32
@justinjaffray
Justin
4 years
bloom filters be like "i might know a place"
0
1
35
@justinjaffray
Justin
1 year
good morning it’s my birthday
Tweet media one
13
0
34
@justinjaffray
Justin
2 years
Unfortunately, this same unnamed friend has just gotten fired for unsportsmanlike conduct during a company water polo game. As a result I can no longer verify the validity of these claims
1
2
34
@justinjaffray
Justin
2 years
me: can you just explain the algorithm them (getting flustered): oh uh well i haven't done this since college man. <alien jeff👽 has sent > me: this is getting an index out of bounds when i run it them: im not used to doing this without my IDE
1
0
32
@justinjaffray
Justin
2 years
just had a very productive call with dijkstra. goto is back on the table
2
0
31
@justinjaffray
Justin
5 months
NULL BITMAP: The Geometry of SQL
Tweet media one
0
2
32
@justinjaffray
Justin
1 year
hello... the first issue of my newsletter NULL BITMAP is out and we are starting off with a classic but surprising issue that comes up with implementing SQL: the halloween problem. you can read it and give me your email (🔫) here
6
4
31
@justinjaffray
Justin
2 years
@steveklabnik you have to be so deep in the startup sauce to be confused about this lol
0
0
30
@justinjaffray
Justin
3 years
fixing a typo in the readme of a github repo with 35 stars and then putting Coder | Dreamer | Open Source Evangelist Location: ✈️ -> The World in my twitter bio
0
0
31
@justinjaffray
Justin
10 months
i used to work at a company where the IT staff would regularly send out fake phishing emails and you'd get a talking to if you clicked on one. this was my favourite one they ever sent
Tweet media one
3
0
30
@justinjaffray
Justin
21 days
NULL BITMAP: I wrote up a little demonstration of the way that the naive way of constructing a database benchmark can be misleading
0
6
30
@justinjaffray
Justin
2 years
I saw @irfansharifm at a Go meetup in Toronto today. I told him how cool it was to meet him in person, but I didn’t want to bother him and ask him for photos or anything. He said, “Oh, like you’re doing now?” and went back to making his slides.
Tweet media one
1
0
28
@justinjaffray
Justin
2 years
DB VENDORS: you still have to handle aborts and issue retries at lower isolation levels, right? so it shouldnt matter if theyre more frequent at serializable DEVELOPERS: well the way we handle retries is to display an error and tell the user “something went wrong”
Fascinating disconnect I’ve seen on this one: - academic researchers: SERIALIZABLE isn’t the default? But everyone enables it first thing, right? - database users: SERIALIZABLE exists?
17
19
141
0
3
28
@justinjaffray
Justin
6 months
This week I wrote some quick thoughts about sorts of problems that resist abstraction because they don't compose:
Tweet media one
0
5
28
@justinjaffray
Justin
3 months
today on NULL BITMAP...we are unraveling an international database benchmarking conspiracy
Tweet media one
1
0
27
@justinjaffray
Justin
2 years
btw i work at datadog now
4
0
27
@justinjaffray
Justin
10 months
engineers: you know, declarative languages. like sql. mathematicians:
Tweet media one
3
0
26
@justinjaffray
Justin
5 years
happy to share that i will be joining @MaterializeInc starting in april! super excited to work with this team!
@frankmcsherry
Frank McSherry
5 years
Big news! Like, REALLY big news. We're popping the lid on @MaterializeInc today. You can check out our sweet new web page: , and click through to the first in a series of blog posts: There will be more in the coming days, but ...
16
69
274
1
1
27
@justinjaffray
Justin
3 years
HELLO!!! for the month of february i decided i was going to make a ZINE. so I made a strategy guide for a game that doesn't exist. i hope you enjoy FISHERGIRL
Tweet media one
Tweet media two
11
5
26
@justinjaffray
Justin
3 years
important annoucement: i have written a program that solves the halting problem. annoyingly, my little brother Bungo unplugged my mac so i am currently powering it back on. luckily i ran fsync on the source file before i lost power
3
1
26
@justinjaffray
Justin
5 years
hey ✌️ this is my last week at cockroach labs. excited for something new, but sad to be leaving. it's been a true privilege to work with some of the smartest, most thoughtful people i've known
1
0
26
@justinjaffray
Justin
3 months
NULL BITMAP: In Codd we Trust
Tweet media one
2
7
25
@justinjaffray
Justin
5 months
i hope you're all happy with yourselves. my good friend jia tan has been inconsolable
2
0
25
@justinjaffray
Justin
3 months
new york is beautiful in the summer
Tweet media one
Tweet media two
Tweet media three
5
0
25
@justinjaffray
Justin
1 year
got 15th at the sacred torch premodern tournament w this 👍 great event
Tweet media one
2
3
24
@justinjaffray
Justin
1 year
it's monday!!! time for NULL BITMAP issue #5 : some thoughts on Unity and also some thoughts about a couple more papers I liked from VLDB:
2
2
23
@justinjaffray
Justin
6 months
I wrote up some thoughts about the process of generating SQL queries for testing. It includes a plea for ideas on how to unify semantic analysis and query generation!
0
6
23
@justinjaffray
Justin
1 year
it’s too bad query languages don’t really seem to capture people’s imagination like programming languages do. it would be cool to have a lot more random crappy half baked hobby query languages floating around (sincere)
9
1
24
@justinjaffray
Justin
1 year
don't make me point at the twitter bio
Tweet media one
0
2
23
@justinjaffray
Justin
3 years
silicon valley babey
Tweet media one
4
0
22
@justinjaffray
Justin
2 years
are there any languages that have type-level debuggers? like if you have some nontrivial trait/template level stuff, some way to step through unification?
12
4
22
@justinjaffray
Justin
3 years
guy emails me to say he likes my blog, offers a chat with an eng about their product. im not looking right now but i hop on the call anyway to see whats up. its with a recruiter instead. they ask why they dont have my resume, i say because i never applied. 2 weeks later:
Tweet media one
5
0
22
@justinjaffray
Justin
2 years
leetcode/interview prep culture is like the most joyless possible interpretation of programming. it makes me very sad
1
0
21
@justinjaffray
Justin
2 years
i love sql
Tweet media one
Tweet media two
Tweet media three
3
2
22
@justinjaffray
Justin
3 years
*guy who has had two decades of in-office work to make industry connections and friendships voice* yeah i dont see why we should ever go back into the office, really. remote is the future
2
0
22
@justinjaffray
Justin
3 years
lol i deleted this tweet because it started getting random likes which weirded me out and i just found out it was because it was in a guardian article
Tweet media one
3
0
22
@justinjaffray
Justin
5 years
if i were a query optimizer i would simply accurately compute the size of each intermediate result set
0
1
21
@justinjaffray
Justin
9 months
db correctness bugs: 0.001% of my data validity errors hardware problems: 0.01% of my data validity errors application logic: 99% of my data validity errors someone who is good at applications please help me budget this my software is dying
0
1
21
@justinjaffray
Justin
6 years
Data Stuff is a new weekly newsletter about databases by @narayanarjun and me (and is not affiliated with any similarly named newsletters)
1
4
21
@justinjaffray
Justin
9 years
Here's my little 10-level Celeste mod for #pico8 : Arielle
Tweet media one
3
2
21
@justinjaffray
Justin
3 years
hello, one more life update, as of this month i am a "research software engineer" working with some cool people at Sutter Hill. please update your spreadsheets
3
0
20
@justinjaffray
Justin
1 year
i've been informed that i am once again on god's favourite website
Tweet media one
3
0
21
@justinjaffray
Justin
4 years
this man is unstoppable
@RiggerManuel
Manuel Rigger
4 years
We introduce Ternary Logic Partitioning (TLP), a general, effective approach for finding logic bugs in DBMS. It nicely complements our work on PQS and NoREC. TLP already found 175 bugs in widely-used DBMS, and can detect bugs in a wide range of features.
Tweet media one
1
18
79
1
2
19
@justinjaffray
Justin
10 months
sql quiz!!!
Tweet media one
6
2
19
@justinjaffray
Justin
9 years
Finished my #pico8 #LD33 game: http://t.co/MUCCuQ3pxi awesome speedy snail action http://t.co/CBwZiJhOnH
0
4
20
@justinjaffray
Justin
5 months
Using overly technical language in communication can be alienating. Here are some jargon terms nerds love to use that I think are problematic: "Computer" instead of "thingy" "Program" instead of "thingy" "Project" instead of "thingy" "Office" instead of "thingy"
4
0
18
@justinjaffray
Justin
8 years
1600m TAS: 2016
2
2
19
@justinjaffray
Justin
4 months
NULL BITMAP: Another non-databases topic, a strategy for playing a game that I think wasn't actually intended to be played
Tweet media one
0
1
19
@justinjaffray
Justin
2 years
this is a banger of an opening paragraph imo
Tweet media one
2
0
19
@justinjaffray
Justin
2 years
CODD DEFINED "RELATIONALLY COMPLETE" TO MEAN "EQUIVALENT TO RELATIONAL CALCULUS" DESPITE NOT EVEN HAVING A NOTION OF RECURSION, IF YOU ASK ME, DATALOG IS A MUCH MORE NATURAL STARTING POINT,
Tweet media one
1
1
19
@justinjaffray
Justin
1 year
if they had put FROM before SELECT in the sql grammar it would be a whole different ballgame out there i tell you what
4
0
19