![Oleksii Halahan πΊπ¦ Profile](https://pbs.twimg.com/profile_images/963853765215387648/WXj2SP5A_x96.jpg)
Oleksii Halahan πΊπ¦
@raspbfox
Followers
80
Following
32K
Statuses
2K
Senior SE, making a TTRPG and a TTRPG online asset shop, trying to create a sane corner of Twitter πΊπ¦π«πͺπΊ
Poland
Joined April 2012
@DimitrisPapail Amazing, exactly what I was saying so much, why wasn't anyone studying 100% correct arithmetic modeling? This gives me trust in transformers! Did you experience an "aha" moment where it just started getting arbitrary length arithmetic?
0
0
0
@BlinkDL_AI It's fine, rwkv 7 is super exciting as well! Do your best, my man! Meanwhile, can you explain how **you** see it, assuming R1 has 37B active parameters per token (~37GB at Q8) and an NVMe RAID0 with 60GB/s, how can one expect more than 60/37 (~1.7) token/s?
0
0
1
@ENDESGA I like that Linus coldly put it into the kernel and forces people to be reasonable about it. As the result, some cool people made great drivers for the kernel! Also, I believe the initial Rust push was partly due to the C crowd treating Rust fans as "impure" on social media
0
0
1
RT @ClementDelangue: Our science team has started working on fully reproducing and open-sourcing R1 including training data, training scripβ¦
0
547
0
@MLSophist No, they are rock stars! We need more artisans like that, there should be no billionaires, just well paid artisans.
0
0
2