Daniel Ramos
@danieltrt7
Followers
110
Following
1K
Statuses
66
SWE Researcher. PhD Student
Pittsburgh, PA
Joined June 2020
🚨 Are Large Language Models Memorizing Bug Benchmarks? 🚨 There’s growing concern that LLMs for SE are prone to data leakage, but no one has quantified it... until now. 🕵️♂️ We measured leakage in benchmarks like Defects4J, and SWEBenchLite. Findings👇
2
8
31
RT @paulg: Apparently EU users don't get new AI versions till several months after US users, because AI companies have to get regulatory si…
0
506
0
RT @Kush_D_Jain: Thrilled to announce our new work TestGenEval, a benchmark that measures unit test generation and test completion capabili…
0
10
0
RT @JAldrichPL: Looking for students! @johny_dry and I proposed Meerkat, a live, distributed, reactive PL, in an Onward! vision paper this…
0
7
0
RT @pmorvalho: 🚀 Curious about GitSEED accepted @SIGCSE_Virtual and how it’s transforming programming education? Check out my full thread o…
0
2
0
(4/4) 📈 Llama 3.1 (70B)—trained on far more data—shows less leakage than older and smaller models like CodeGen and CodeLlama. Its higher NLL and lower 5-gram match show limited signs of leakage. Read the preprint: #AI #SoftwareEngineering #DataLeakage
0
0
3
RT @ccarolcarreira: Do you work with Ansible? We want to hear from you! 🎯 This study is led by a joint team from @CarnegieMellon and @iste…
0
7
0
RT @TDurschmid: I am on the #SoftwareEngineering #Teaching Job Market! After co-creating & co-instructing two software engineering courses…
0
14
0
RT @pcanelassantos: Excited to announce that I will present our work "Understanding Misconfigurations in ROS: An Empirical Study and Curre…
0
10
0
It’s tomorrow at #PLDI2024 in Iceland/Denmark at 10:40 AM! 📅 Check out the proceedings online:
Excited to present our work "A Lightweight Polyglot Code Transformation Language" next week at @PLDI2024! Are you dealing with large-scale refactoring/migrations? Is your codebase multilingual? We’ve got something for you! 🧵👇 [1/n]
0
2
5
RT @joshsunshine: Are you an undergraduate interested in doing research at @SCSatCMU this summer? Then sign up to join our information se…
0
29
0