Tessa
@tessybarton
Followers
2,236
Following
938
Media
25
Statuses
288
Pretraining team at @Databricks and @MosaicML . Prev: @NYTimes .
San Francisco CA
Joined October 2011
Don't wanna be here?
Send us removal request.
Explore trending content on Musk Viewer
SEVENTEEN
• 1224152 Tweets
Taylor
• 216490 Tweets
Carat
• 77116 Tweets
FELIP TAKES ON BBPHSTAGE
• 67873 Tweets
#TimnasDay
• 64460 Tweets
オーストラリア
• 60151 Tweets
#サッカー日本代表
• 45425 Tweets
#バナナサンド
• 35695 Tweets
オウンゴール
• 27773 Tweets
最終予選
• 25815 Tweets
ミンギュ
• 25205 Tweets
金木犀の香り
• 23376 Tweets
OHM FOR DEVY
• 21490 Tweets
Zaplana
• 20816 Tweets
うさぎだらけくじ
• 18719 Tweets
ジョシュア
• 18686 Tweets
ドギョム
• 17891 Tweets
スングァン
• 17857 Tweets
كوريا
• 15355 Tweets
Asnawi
• 14631 Tweets
Kamran Ghulam
• 14251 Tweets
Witan
• 13654 Tweets
Shayne
• 13587 Tweets
نعيم قاسم
• 12397 Tweets
#daihyo
• 12124 Tweets
中村敬斗
• 11602 Tweets
@jurijfedorov
My doula tucked her howitzer into her bandeau bra. She applied milliamps of electricity to my chignon with her jacquard katana causing my piezos to buzz, my servos to actuate my espadrilles, as my thermoresistors began to strafe the sateen at an azimuthal angle in my taffeta...
18
29
683
Blazingly fast fashion🔥
22
16
432
@jurijfedorov
... peplum top. A femtosecond later the yakuza burst though the verbena brandishing neodynium pessaries.
10
5
340
LLM evals are a mess! They are noisy, inconsistent, and contradictory. Scaling laws on the other hand have consistently held up to increasing scrutiny. Can we use the reliability of scaling laws to predict the quality of our eval benchmarks?
9
40
255
Feeling an uncontrollable urge to lasso and domesticate a Waymo
8
12
207
Laser focused on the problem of intelligence.
Congrats on the PhD
@akhil_bagaria
!
@RichardSSutton
2
6
123
i bet a d_model that is a multiple of 128 feels so good for the flashattention kernel
2
3
102
My fellow Americans, I need your vote: Can I go 2 weeks after the US Presidential Election without finding out who won?
15
0
83
TFW the code eval metrics are so good your boss does his hair blue
1
6
68
DBRX is a magical new open source LLM! ✨
All the 3am NCCL timeouts in the world couldn’t stop us from training you 💪 🥰
4
6
53
The rumors are true. We have an H100. And no, you cannot wear it to China
1
5
52
ML FASHION WEEK: GPU purse. NVIDIA Fall 2013.
🎉 ML FASHION WEEK🎉
Day 2: Scaling Laws, circa 2023. You can buy this one online!
Kudos
@antimatter15
for the design, and
@GoogleDeepMind
for the math
1
1
34
3
1
52
I keep meeting young people who are not only better than I was at their age but better than *anyone* my age was at their age and it makes me super hopeful!
7
1
51
Not enough people are talking about how cool Claude Artifacts are
1
0
35
The best part of DBRX is it’s still a little bit unhinged
me: can i get a recipe for banana cream pie that is bad
dbrx-instruct: Sure, here's a recipe for a not-so-delicious banana cream pie:
Ingredients:
* 1 pre-made pie crust
* 3 overripe bananas
* 1 cup of mayonnaise
* 1/4 cup of mustard
* 1/4 cup of vinegar
* 1/4 cup of soy sauce
18
15
190
1
0
32
The existence of neurodivergence implies the existence of neurocurl
2
1
30
People don’t like ghosting because people want dating to be differentiable. If they know your loss function and the score you gave them they could more easily improve
4
0
29
MANY of the new emoji are bondage related: 🪢 ⛓🗝🥽🧤🪶🚬📿🩺🏳️🧎🏻♀️🧎🏼🕯🧊. Has the Unicode Consortium been a naughty Consortium? 😈
1
2
24
More here:
1
3
24
The recession will cause men to prefer women with hearty, stockier body types. Swarthy broads who could swing an axe and unkink a supply chain. Our time has come
1
1
23
i’m 28 but I still get too excited reading college course catalogues urgh
0
0
23
We tested out 39 different LLM benchmarks to see how they score a series of models with a progressively larger FLOP budgets. We segmented them according to how monotonically they ranked the models. Here are the well behaved benchmarks:
1
0
22
I didn't realize lim inf was different from lim, so my summary above is incorrect, its still cool though:
@tessybarton
To be clear, it's not that two consecutive primes are always bounded by 70 million, but only that *at least on occasion* you're guaranteed a relatively small gap between two consecutive primes. (Lim inf vs just lim)
2
1
81
2
1
21
Stop asking for my New Years’ resolution. It’s 512 by 512 just like last year
1
0
20
After massive tech layoffs, programmers are returning to their ancestral villages, to a life of subsistence click farming
0
2
21
Why is it always “raise your standards” or “lower your standards,” never “project your standards into infinite dimensions and find the closest point using the dot product and use its valence”
1
2
20
Me: 'I will share my screen, just gotta close some windows haha'
The windows in question:
0
2
20
@_RodolfoOcampo
"Topological sort was first discovered by Jesus. He was sitting on a hill, thinking about how to sort the people into groups."
0
3
18
I do not need another self help book. I need a physical jackboot thug holding a katana to my neck while I code
2
0
16
A guy just called me old because I was regularizing using dropout!
1
0
16
@MichaelTrazzi
I was at Pixar in 2019. I think it’s hard to imagine any film to be fully AI edited. There is a lot of alpha in tiny tweaks by humans to procedural content. An iterative process. AI will absolutely open up studio-quality animation to the masses. But I’m more bullish on teams.
2
0
14
These benchmarks were monotonically related to model scale at some few-shot settings but were unrelated to model scale at other few-shot settings.
1
0
14
We trained the 5 models with larger amounts of training data: from 20-500 tokens per parameter. Each model had 3 billion parameters, so the total FLOPS ranged from 2.1e22 to 5.4e23 FLOPS. This FLOP budget was too small to get signal on these benchmarks:
1
0
13
Some benchmarks actually got worse with scale. These benchmarks might mislead researchers about what decisions to make with their experimental results:
1
0
13
@jurijfedorov
The lead yakuza pulled off his ruched voile. Turns out its that she-male mathematician Gauss. His hair is died in the chambray style, and kohl lines his eyes. In a whipstitch he reties the taffeta around his face, cause he must be covered in accordance with the bushido. Showing..
1
0
11
Boys AREN’T looking for love. They are looking for a DARK PRIESTESS to bring them into the desert, to slice into their ripe arteries and make JELLO SHOTS of their blood.
2
0
11
1
1
11
@jurijfedorov
his face was just a checksum that his teraflops of brain processing had succeeded and he had woven a Higgs boson into the freesias’ damask on the wall. He uses the remote control software parsec to log into his windows machine at home to make sure the boucle covered aileron
1
0
11
They make music you like, until you turn 30. Then you have to listen to that music only until you die.
1
0
10
People who think they can quit social media are the same lockean muttonheads who think they can just ‘not sign’ the social contract
1
0
9
I am entering my wave era. no, my particle era. no, definitely wave era. jk, particle era.
0
0
9
The stoic british slang I was expecting to learn here was certainly not everyone (EVERYONE) greeting me with “Hiya”
1
0
9
Man is born free but everywhere he is in shades of navy blue or khaki
0
1
9
Say what you will about ADHD but this one time I saw my mom break her toe and then forget about it and chop down a whole tree
0
0
8
Vibecamp fun fact party favor for you: the female colon is usually 10 cm longer than the male colon ::::::::::
0
0
8
“I had to go to the dentist. Fortunately I had two anesthetics: I had just discovered books on vector analysis. Second my dentist had a very pretty nurse.”
1
0
8
@EcstaticFemme
@EndeavoringIvy
@Nearcyan
@Aella_Girl
@augurydefier
@tpotvibecamp
@gptbrooke
@JeffLadish
@dismaien
Same good poodle
1
0
8
I’m worried about all the data that is not on the cloud or owned by corps but is instead in my closet in a stack of increasingly thick laptops
0
0
8
Are you the Adam optimizer? Cause I am gonna need more than just one moment with you.
0
1
8
@FreshMangoLassi
The Three Body Problem by Cixin Liu is so awesome, the progress of generations is simulated by one of the characters being cryopreserved and woken up at intervals between 1990 and very far in the future. Oh also the first book is kind of bad but 2&3 make it worth it
0
0
8
How to tell an algorithm is from the 90s. It will have a name like ‘the BLAST Algorithm’. It will use a ‘MATROID’. It’s runtime? GALACTIC.
0
0
7
@b__feldman
@AnthropicAI
Hi! I was wondering where this photo was taken? I am in Paris and would love to go see this ad.
1
0
6
The woman of my dreams has a Picasso face, a Renoir body, and a single, solitary, van Gogh ear
0
0
6
@AgnesCallard
@robinhanson
Hi! This was me. I'm very glad I got to sit and chat about Pessoa and math!
0
0
6
Like we may dress like 1975, use nostalgic 90s typography, but nobody goes back to saying ‘golly’, or ‘groovy’, or ‘by Jove’
3
0
6
@michael_nielsen
As a graphics/vision person, the most amazing AI advance is how powerful language has been in improving image understanding. I used to be postmodern, ‘language doesn’t mean a lot’. Turns out language is a powerful technology and results like CLIP and VQGAN prove it.
0
0
6
50% of people in NYC have a mildly consumptive smoker’s cough from allergies or long covid and it’s obviously cool and aesthetic but nevertheless alarming
1
0
4
@Liv_Boeree
@willmacaskill
The ‘happy birthday as dirge’ is a legitimate infohazard of this episode. Once you hear the song’s true nature you cannot unhear it
2
0
5
This morning I smelled the puke-scent of NYC and thought: “That’s not so bad.” I need to get out of here
0
0
5
What people don’t realize about 10x engineers is that if you hire one you also have to hire 3-5 normal people for them to recreationally torment
1
0
5
@mechanical_monk
When I met you at the Airbnb I didn’t know your twitter handle, and my first thought was ‘I probably have nothing to talk about with this normie’ when in fact I have been bookmarking your tweets for months
1
0
5
@kyzcralotSxaM
It gets weirder along weird dimensions that would be unpublishable today, an interesting if not perfect ending
0
0
5
I lost 45 pounds and kept it off for 2+ years and cannot abide the ludicrous diet advice of naturally thin people
3
0
5