🤖 Can LLMs effectively assist in cognitive behavior therapy (CBT)? 🔗New paper: We present the first systematic benchmark to evaluate LLMs' efficacy for CBT. We include three levels of tasks: basic CBT knowledge acquisition, cognitive model understanding, and therapeutic response generation, with five new datasets. These tasks encompass key aspects of CBT that could potentially be enhanced through LLM assistance while also outlining a hierarchy of capability requirements. ✨ We find that larger LLMs are better at answering CBT knowledge questions. However, they fall short of analysis of complex cognitive structures. LLMs generally follow a rigid logical reasoning process but lack a crucial skill in psychotherapy—thinking and guiding from the patient’s perspective to respect their autonomy and build rapport. These findings underscore the substantial limitations of LLMs in practical psychotherapy, offering important directions for future work. Thanks to @_Guuuuuuuu_ and @Qnolan4 for leading the effort, and @XZ1023_ , Travis Labrum, @imjamiechiu, Shaun M. Eack, @fangf07, @WilliamWangNLP.

It's a wrap! Last panel omof #cpconf2024 on computational mechanisms of depression and treatment: @imjamiechiu @bari_bilal @ZhihaoW20376062 Isabel Berwian

Excited to announce that 110 languages got added to Google Translate today! Time for context on these languages, especially the communities who helped a lot over the past few years, including Cantonese, NKo, and Faroese volunteers. Also, a 110-language youtube playlist. 🧵

💡Introducing Patient-Ψ: 🧠🤖 We integrate cognitive modeling with Large Language models to simulate patients with mental health disorders, creating a new framework for training professionals. 📄 Paper: Based on a user study of 33 mental health experts and trainees, our simulated patient exhibits high fidelity to real patients, showing strong promise for mental health professional training. #NLProc #MentalHealth #AIMentalHealth #AIHealthcare #AIForGood #LLM