Ying Zhang
@ipiszy
Followers
93
Following
58
Statuses
6
Software Developer @ Meta, LLAMA infra developer Past projects: FlashAttention3, AITemplate, TorchInductor
39.912987,116.46175
Joined June 2008
@DarioAmodei Gosh. Do you really think that it wil be either uni-polar or bi-polar? Why cannot it be multi-polar?
0
0
0
Super excited to be part of the FlashAttention3 crew. Please check out our results!
FlashAttention is widely used to accelerate Transformers, already making attention 4-8x faster, but has yet to take advantage of modern GPUs. We’re releasing FlashAttention-3: 1.5-2x faster on FP16, up to 740 TFLOPS on H100 (75% util), and FP8 gets close to 1.2 PFLOPS! 1/
0
1
31
@shaKe_Kura34 This is amazing! I spent over 4 hours to go through all mazes, really enjoying it. Thanks you so much for sharing!
0
0
1
@CaltransDist3 is there any chance that 80 will open today? Do you suggest us taking route 50 instead? Thank you!
0
0
0
RT @CaltransDist3: We will be reopening I-80 EB only to vehicles single file at 9 pm due to the I-80 mudslide at Baxter. WB lanes remain cl…
0
15
0