Demystifying Attention, Transformers, LLMs, and how GPT was built (semi-technical, to the point, no BS) A thread🧵 (1/n)

Older tweet

@Teunemansvb @seatedro What are you using it for?

Safe to say I'm not particularly thrilled with ChatGPT recently

@Kaushik04916594 @seatedro Don't knock it till you try it

@yacineMTB Never say that ever again🥲

Having a terrible time today Relied too heavily on a relatively new framework (since its the only one that supports input types that I am aiming at) and its started to break things I was so wrong, major L

Huggingface + pytorch + tqdm is beautiful dude...

It's pretty stupid how ChatGPT implements multithreading - you can't just run multiple threads and run a barrier/rendevouz for all of them - you need to enable freed up threads I wish there was better data to tune GPT for these use cases

RT @srikosuri: It’s been a tough few weeks. My 10yo daughter was diagnosed with a very rare, aggressive cancer called interdigitating dendr…

@noah_anyname @seatedro for when you screw up, and have to delete the distro

@kimmonismus A bit of a correction - #1 best __competitive__ coder Pretttty cool though - competitive coding is a lot like chess - lots of pattern matching

@willccbb thanks will, will look into it🫡

@zoink This website and it's addiction to Civ, AoE 😩

@jamievoynow Cool story 🫡

@WadeGrimridge straight from the go wade

@yacineMTB nvm