How does Mamba fare in the OthelloGPT experiment ? Let's compare it to the Transformer 👇🧵

@makwana_da51149 yes the training was done in pytorch, it takes 1 or 2 minutes to compile them and then you can use them very easily in torch

@cloneofsimo thankks 🫶

@Muhtasham9 @sksq96 don't even talk about moutain car

+link to the kernel (not that hard to read actually if you focus on the compute and IO parts, the beauty of TK)

@arankomatsuzaki @francoisfleuret

@shxf0072 (and it was shown to perform a bit better)