RT @srahmanidashti: The workshop will focus on models, techniques, data collections, and methodologies for information retrieval evaluation…

RT @srahmanidashti: Organiser: @srahmanidashti, @cnsiro, @maliannejadi, @nickcr, @claclarke, @guglielm0f, @UnderdogGeek, @pt_ir , and @emin…

RT @srahmanidashti: The call for papers is now open for the second workshop of #LLM4Eval: 💡 See CFP: 🗓 Submission…

RT @srahmanidashti: 🔊 The second workshop on Large Language Models for Evaluation in IR (#LLM4Eval), co-located with #WSDM2025, is now acce…

RT @srahmanidashti: 📢 Thrilled to announce that, "SynDL: A Large-Scale Synthetic Test Collection for Passage Retrieval" is publicly availab…

RT @guglielm0f: Great panel discussion with @ian_soboroff, @lauradietz99, @claclarke, Michael Ekstrand moderated by @UnderdogGeek at @llm4e…

Currently, ongoing interesting discussion on the LLM Challenge from participants. #Sigir

RT @srahmanidashti: Could large language models (LLMs) replace humans for relevance judgment tasks? #LLMJudge aims to explore this question…

RT @hortonhearsafoo: Excited for the afternoon keynote by @metzlerd at @llm4eval! Looking forward to insights on 'LLMs as Rankers, Raters,…

RT @UnderdogGeek: Next up in the #LLM4Eval workshop, overview of the LLMJudge shared task by @nick_craswell. #SIGIR2024

Second keynote of the day from @metzlerd on LLMs as Rankers, Raters and Rewarders.

Booster session ongoing with @lauradietz99. Join us during the poster presentation from 11:30 am to discuss with the authors.

RT @guglielm0f: @ian_soboroff inspiring us with his keynote on "A Brief History of Automatic Evaluation in IR" at the @llm4eval workshop. #…

The First Workshop on Large Language Models (LLMs) for Evaluation in Information Retrieval (#LLM4Eval) - Panelists @claclarke, @ian_soboroff, @lauradietz99, @elehack

The First Workshop on Large Language Models (LLMs) for Evaluation in Information Retrieval (#LLM4Eval) - 2nd Keynote Speaker (@metzlerd)

The First Workshop on Large Language Models (LLMs) for Evaluation in Information Retrieval (#LLM4Eval) - 1st Keynote Speaker

The First Workshop on Large Language Models (LLMs) for Evaluation in Information Retrieval (#LLM4Eval) -- Program Organizers: @srahmanidashti, @cnsiro, @maliannejadi, @nick_craswell, @claclarke, @guglielm0f, @UnderdogGeek, @pt_ir, and @emine_yilm

Join #LLM4Eval to hear @ian_soboroff discuss "A Brief History of Automatic Evaluation in IR." #SIGIR2024 @SIGIRConf #IR #LLM #Evaluation

The First Workshop on Large Language Models (LLMs) for Evaluation in Information Retrieval (@llm4eval) at @SIGIR2024 is happening now. Come to enjoy an interesting and dense program! The full detailed program is available on our website:

📢 Exciting News! The #LLMJudge deadline has been extended by one week! You now have until 🗓️ July 07, 2024, to submit your results. @llm4eval #LLMJudge #Evaluation #LLMs #IR #Judgments