Copilot Arena
@CopilotArena
Followers
585
Following
92
Statuses
72
evaluating llms and code. download now on VSCode! | maintained by @iamwaynechi @valeriechen_
Pittsburgh, PA
Joined September 2024
Our 🎁 to you this holidays is the Copilot Arena live leaderboard!
📣 @CopilotArena leaderboard is now live on We have collected over 15k votes on 11 models (2 new models since our last blogpost release). Congrats @deepseek_ai🥇and @AnthropicAI🥇!
0
0
9
While Copilot Arena updates are brewing, check out the latest repochat results!!
RepoChat Blog & Dataset Release! 🚀 Since launching in Nov, RepoChat has collected 11K+ conversations and 4K+ votes—allowing users to chat with your GitHub repos! Our blog dives into: 📌 How users interact with RepoChat 📌 Leaderboard results (both retriever & answer models) 📌 RepoChat pipeline & implementation 📌 Key takeaways & deep analysis We're also releasing a 4K battle dataset on Hugging Face + a Colab notebook to reproduce analysis & leaderboard results! 🔗 Links in the thread!
0
0
3
Downloading Copilot Arena is as easy as clicking this link:
0
0
1
0
0
0
Amazing news: @CopilotArena is featured on the VSCode Extension Store! Can you help us reach 10K downloads? Try the extension today at
0
3
11
RT @lmarena_ai: News from @CopilotArena: Code Editing Leaderboard is now LIVE! We have collected over 3.7k votes on 6 models. Congrats @An…
0
14
0
Exciting update: we just released a leaderboard + blogpost comparing how models compare on code editing! Check out the 🧵below for more details
News from @CopilotArena: Code Editing Leaderboard is now LIVE! We have collected over 3.7k votes on 6 models. Congrats @AnthropicAI Claude 3.5 Sonnet on a 1st place rank!🥇 Blog analysis below👇
0
1
10
0
0
0
RT @b_roziere: I'm glad to announce that we released an updated version of Codestral today! Codestral-2501 targets completion in IDEs. • t…
0
2
0
@DimaGM1 @MindAcrobatic @lmarena_ai @MistralAI gemini 2 flash results are coming soon! we’ll look into adding the other models. we’re working on more in depth analysis of the data which we’ll release in a paper (~end of month) and hopedully incorporate into the live leaderboard as cool visualizations!
1
0
3
0
0
3
RT @arthurmensch: Codestral 25.01 is not only on top of the Copilot Arena leaderboard, it's also 2x faster than the first Codestral -- that…
0
34
0
@simonw @lmarena_ai @MistralAI Great point, we will update the leaderboard to include license information!
0
0
2
RT @lmarena_ai: Exciting news from @CopilotArena! The latest Codestral 25.01 release is now topping the Copilot Arena leaderboard (joint #…
0
57
0
1
0
1
Thank you to @MistralAI for letting our users try out the model pre-launch... turns out people really like this new model 🙌 Try it out today!
Exciting news from @CopilotArena! The latest Codestral 25.01 release is now topping the Copilot Arena leaderboard (joint #1, +12 points over previous Codestral!). Congrats to @MistralAI🎆 Try out the new model today in the @CopilotArena VSCode extension.
0
2
11
DeepSeek V3 w/ FIM, directly in VSCode Available to everyone in Copilot Arena for free.
DeepSeek V3 is now live in the Arena🔥 Congrats @deepseek_ai on the impressive release, matching top proprietary models like Claude Sonnet/GPT-4o across standard benchmarks. Now it's time for the human test - come challenge it with your toughest prompts at lmarena and stay tuned for leaderboard release!
0
5
34
@Tabby_ML @lmarena_ai @deepseek_ai @AnthropicAI Definitely! Your leaderboard was helpful inspo for us when building Copilot Arena 🙌
0
0
2
This wraps up our short round-up of recent Copilot Arena updates! If you've made it this far, then head over to to download the extension and get coding today 🧑💻
0
0
1