![Sumanth Profile](https://pbs.twimg.com/profile_images/1677558976270180352/lJZNQUf8_x96.jpg)
Sumanth
@sumanthd17
Followers
3K
Following
5K
Statuses
1K
PhD’ing @iitmadras @AI4Bharat, Google PhD Fellow, Past life - @GoogleAI @Mila_Quebec @IIITSC
Joined November 2018
🚨 Paper Alert!! 🚨 #LLMs are evolving fast, but how do we evaluate their performance accurately across multiple languages? 🌍 Introducing CIA: Cross-lingual Auto Evaluation—a comprehensive framework designed to evaluate multilingual LLMs with HERCULE, a specialized evaluation model. 🦸♂️ 📄 Paper: 💻 Code: 🏋️♂️Models: [1/N]
4
30
108
RT @danish037: The logic here: "Since we can't improve wages of EVERY single student, let's not do it for ANY one." There are several pr…
0
4
0
RT @paraschopra: I'm starting something soon. Join me in making state-of-the-art AI models for the world from 🇮🇳India.
0
1K
0
RT @MiteshKhapra: @pratykumar Brilliant vision! We at AI4Bharat have been laying the foundation with datasets for Indian languages, which w…
0
9
0
RT @ihsrahedid: Ever wondered which instruction selection strategy to choose for your custom setup? The answer might just be random samplin…
0
14
0
RT @simi_97k: Still on the lookout for relevant summer '25 internship opportunities! Please feel free to check out my website ( https://t.co…
0
11
0
RT @NithishKannen: Today, we have open-sourced the complete code for CUBE, including i) cube extraction code, ii) cultural diversity evalua…
0
8
0
RT @KrishnaPillutla: Calling all potential MS & PhD students! 📢 @iitmadras has a solid and growing community of international students. L…
0
9
0