Agentic AI Meets Medicine!!! 🔬 Excited to announce MedRAX: a groundbreaking Medical Reasoning Agent for Chest X-ray interpretation, now on arXiv! Paper: Code: What is MedRAX? MedRAX is the first versatile AI agent that seamlessly integrates state-of-the-art chest X-ray analysis tools and multimodal large language models into a unified framework, enabling dynamic reasoning for complex medical queries without additional training. 🎯 Why MedRAX? While specialized AI models excel at specific chest X-ray tasks, they often operate in isolation. Medical professionals need a unified, reliable system that can handle complex queries while maintaining accuracy. MedRAX bridges this gap! 🛠️ Integrated Tools: - Visual QA: CheXagent & LLaVA-Med - Segmentation: MedSAM & ChestX-Det - Report Generation: CheXpert Plus - Classification: TorchXRayVision - Grounding: Maira-2 - Synthetic Data: RoentGen 💡 Key Features: - Unified Framework: Seamlessly integrates specialized medical tools with multimodal large language model reasoning. - Dynamic Orchestration: Intelligent tool selection and coordination for complex queries. - Clinical Focus: Designed for real-world medical workflows and deployment. 📊 Introducing ChestAgentBench: We're also releasing ChestAgentBench, a comprehensive medical agent benchmark built from 675 expert-curated clinical cases, featuring 2,500 complex medical queries across 7 categories. Check it out: 🎉 Results speak for themselves: - 63.1% accuracy on ChestAgentBench - State-of-the-art performance on CheXbench - Outperforms both general-purpose and specialized medical models 🙏 Huge shoutout to @adibvafa, Jun Ma (@JunMa_11), AlifMunim, and Hongwei Lyu for their exceptional work on this project! @VectorInst @UHN_Research @UofTCompSci @UofT_LMP