Roshan Sumbaly
@rsumbaly
Followers
2K
Following
4K
Statuses
780
Director of AI, @AIatMeta - Llama & Movie Gen Prior life @coursera, @linkedIn, @stanford
Joined January 2009
Welcome to Meta @_arohan_ - super excited to work together (after 15 years!)
And here we go as the secret is out: I will be joining @AIatMeta ‘s Llama team next month to work on the next generation of llama models. And yes, I already have some llama puns ready before the next set of algorithms and it’s fun!🦙 🚀 And very happy to be on a path to general intelligence and opportunity to contribute to a healthier ecosystem where innovation benefits everyone! 💌
1
0
31
Early Christmas gift that we wanted to share with the community - last one for the year and a nice way to say good bye to Llama 3. 2025 will be the year of Llama 4!
Introducing Llama 3.3 – a new 70B model that delivers the performance of our 405B model but is easier & more cost-efficient to run. By leveraging the latest advancements in post-training techniques including online preference optimization, this model improves core performance at a significantly lower cost, making it even more accessible to the entire open source community 🔥
0
1
28
When we wrote the first research proposal for Movie Gen 6 months back we had two goals in mind: 🎬 First, accelerate creative expression for everyone - from production studios to the 100s of millions of content creators on Meta 📜Second, accelerate research in media generation foundation models, akin to what we've done with Llama We're just getting started on #1 - we worked with filmmakers like @aneeshchaganty and @CaseyAffleck123 and got to learn so much about the artistic process. Super excited to share Aneesh's work with the world. We're also open-sourcing evaluation sets with over 1K videos, that we hope will move the field forward and enable the next generation of foundation models -
A few weeks ago, i was given early access to movie gen from @Meta. My only instructions were to make something with it. As always, a very special thank you to my mom, who digitized over 100 hours of home video footage to make this story possible.
0
2
20
And not just the paper, early next week we'll be releasing our full evaluation sets - the field of media generation would really benefit from having canonical benchmarks. Stay tuned!
yes, Meta released a full scientific paper on MovieGen, with a lot of details that'll help the field move forward.
1
7
64
Back to the lab to create the next Llama and Movie Gen foundation models...
1
0
5
We're still baking the next herd of Llamas - stay tune and keep sharing us feedback! 🦙🦙🦙🦙
0
0
3
This is an exciting moment not just for the Llama community, but also the wider AI space. Having an open weight model that is competitive is important for us to move the field forward. Thank you @lmsysorg for bringing this up so fast and @anyscalecompute for hosting!
Exciting news! @metaai's Llama-3.1 results are here🔥 The Llama-3.1 series, extensively tested over the past week, has gathered over 10K community votes. Now, Llama-3.1-405B has climbed to #3 on the Overall Arena leaderboard, marking the first time an open model has ranked in the top 3! Huge congrats to @metaai for this incredible launch & milestone in AI! We also thank @anyscalecompute for hosting the Llama-3.1 models for us. More category breakdown below👇
1
4
18
Great to see the community moving fast to adapt Llama 3.1 to their needs. This is the beauty of open-source and key part of why we're going to share more of our system-level thinking with Llama Stack. Great work @vllm_project and @neuralmagic folks - let's find more ways to work together on this for the next Llama release!
vLLM now supports deploying Llama-3.1-405B on a single 8xH100 or 8xA100 node, making inference much easier and cheaper! This is a huge feat by Neural Magic’s engineers who contributed 3 crucial features to enable immediate, FP8 deployments of the 405B model in vLLM: (1/5)
1
5
17
We’re just getting started. Llama Herd of models and system has more exciting updates coming - stay tuned! 🦙🦙🦙🦙🦙🦙🦙
0
0
0