Doing a PhD after publishing many papers is a wild ride. One screen: launching an experiment on 64 H100s GPUs for an 8B VLM. Other screen: coding a tiny CNN for MNIST.....for a course assignment. Truly living in two eras at once 😅 but it's a nice refresh 😉

RT @PerouzT: 🚀 We just released the 3rd test split of our #RepLiQA dataset! 🎉 A unique QA dataset with reference documents that have never…

I just came across two nice articles from LG AI Research and MarketTechPost featuring our work on ChartInstruct (ACL 2024) and ChartGemma (Coling 2025) 📊🚀

@iScienceLuvr Thanks for sharing our work! 😃 You can find the key highlights in this thread:

📢 Our codes and model weights will be publicly available soon! Huge thanks to our amazing collaborators! 🙌@ServiceNowRSRCH @YorkUniversity @Mila_Quebec

3️⃣ We're introducing the AlignVLM models, by training Llama 3.2 1B, 3B, and 8B using our connector. We've also benchmarked it against a range of models! 📊 AlignVLM outperforms all Base VLMs trained under similar configurations! 📈 We also noticed that our models perform competitively against Instruct VLMs of similar sizes. 🚀

1️⃣ Aligning visual features with language embeddings is a major bottleneck in Vision-Language Models (VLMs). Existing connectors often introduce noise, hurting performance. ❌ We propose AlignVLM, a novel method that maps vision features into a weighted average of LLM text embeddings, ensuring they remain in a space the LLM can effectively interpret. 🎯✅

@CSProfKGD unless you have another paper submission coming in a few days 😂

@CSProfKGD Yes, I know that latex comments are accessible to the public on arXiv. But manually cleaning the overleaf project was always a nightmare to me. I used to spend hours doing that.😅 I will try this tool this time instead! 😀

Conference Travel ✅️ ICML Submission ✅️ Workshop proposal ✅️ Time to focus on the ACL submission 🫡 and the projects proposals for the courses 🤕

@ShinDehghani Indeed, we get to travel and meet a lot of people! Also, research is very fulfulling and satisfying!

@dhadfieldmenell Thanks! I will definitely take some time off to avoid getting burnt out.

@GalarnykMichael Indeed, finishing the classes reduces the workload a lot, but I am sure we will have other things to stress out about :)

@RajeswarSai Thanks so much for the support, Sai! I am sure the journey will be worth it in the end 😄