Alex Stein
@alex_stein0
Followers
54
Following
12
Statuses
14
Getting my PhD in Machine Learning at @umdcs, advised by @tomgoldsteincs and @johnpdickerson
Joined June 2023
Come to poster 2907 tomorrow at 11 am to check out our work on getting LLMs to do math at #NeurIPS2024
Introducing 🧮Abacus Embeddings, a simple tweak to positional embeddings that enables LLMs to do addition, multiplication, sorting, and more. Our Abacus Embeddings trained only on 20-digit addition generalise near perfectly to 100+ digits. 1/n
1
1
3
RT @SeanMcleish: Why is addition hard for next token predictors? Come hear about our fix for this at #NeurIPS! We’re presenting Abacus Embe…
0
11
0
RT @neeljain1717: Excited to present “Be Like a Goldfish: Don’t Memorize!” led by @ahans30 at NeurIPS, East Building #4709. In this work, w…
0
7
0
This work was done in collaboration with @umdcs and @CapitalOne. @SharpeWordz @cbbruss @johnpdickerson @tomgoldsteincs @micahgoldblum đź”— Read the full paper here: đź”— GitHub repository:
0
0
5
RT @tomgoldsteincs: Transformers can learn arithmetic with the right embeddings. Models trained on 20-digit addition can generalize to 100…
0
32
0
RT @SeanMcleish: Introducing 🧮Abacus Embeddings, a simple tweak to positional embeddings that enables LLMs to do addition, multiplication,…
0
123
0
RT @twimlai: Today We're Joined by @jonasgeiping to discuss: "Coercing LLMs to Do and Reveal (Almost) Anything". We explore the risks of de…
0
5
0