Niloofar Mireshghallah Profile Banner
Niloofar Mireshghallah Profile
Niloofar Mireshghallah

@niloofar_mire

Followers
4,904
Following
1,283
Media
157
Statuses
2,516

Postdoc @uwcse - @uwnlp , Ph.D. from @ucsd_cse /Privacy, ML, NLP, @winlpworkshop chair, NAACL 2025 D&I chair, ex @MSFTResearch

Seattle, WA
Joined May 2013
Don't wanna be here? Send us removal request.
Explore trending content on Musk Viewer
Pinned Tweet
@niloofar_mire
Niloofar Mireshghallah
1 year
Defended 🤺 my thesis “Auditing safety risks of large language models” today! It’s been a bumpy ride, with covid, having to change advisors and *drum roll 🥁* getting Guillain Barré syndrome & hospitalized in the UAE after EMNLP in December 🏁 Slides:
Tweet media one
Tweet media two
Tweet media three
Tweet media four
95
20
606
@niloofar_mire
Niloofar Mireshghallah
2 months
When talking abt personal data people share w/ @OpenAI & privacy implications, I get the 'come on! people don't share that w/ ChatGPT!🫷' In our @COLM_conf paper, we study disclosures, and find many concerning⚠️ cases of sensitive information sharing:
Tweet media one
6
56
217
@niloofar_mire
Niloofar Mireshghallah
4 years
A reviewer has said that for the camera-ready version of the paper, we need to: Fix the typos, such as “optimiser”-> “optimizer”, “minimise”->” minimize”, “optimisation”->“optimization” I did not know British spelling is considered a typo 🤔
28
17
682
@niloofar_mire
Niloofar Mireshghallah
3 years
I just finished my thesis proposal on how large language models can be *Leaky*, *Sneaky* and *Creepy*, and I'm now a PhD Candi🍬...date📅! Special thanks to my amazing committee: @BergKirkpatrick , @sameer_ , Julian McAuley, Molly Roberts and Lawrence Saul!
Tweet media one
Tweet media two
Tweet media three
Tweet media four
41
13
349
@niloofar_mire
Niloofar Mireshghallah
4 years
When people ask me when I'm gonna graduate @phdlife @AcademicChatter
12
18
320
@niloofar_mire
Niloofar Mireshghallah
3 years
Happy to share the work done during my internship @MSFTResearch is accepted at @NAACLHLT 🎉! "Privacy Regularization: Joint Privacy-Utility Optimization in Language Models" We propose privacy mitigations for the LM training data memorization problem:
Tweet media one
16
18
270
@niloofar_mire
Niloofar Mireshghallah
2 years
No longer an Alien 👽🟩 After 4 yrs of waiting, anxiety and not seeing my Mom I finally got my green card. Can’t wait to see what having basic human rights (like the right to TRAVEL lol) feels like. I think they were holding on to it to give it to me on my birthday lol 🎂
Tweet media one
39
0
248
@niloofar_mire
Niloofar Mireshghallah
3 years
Now that we are approaching the grad school/lab selection season, I wanted to write a thread 🧵on some unconventional advice about choosing which #PhD program to join (especially for #international students who are usually more under pressure because of Visa/immigration):
1
51
208
@niloofar_mire
Niloofar Mireshghallah
6 months
Was this sequence in the training dataset or not?? In new paper, we study why membership inference attacks show *near-random performance* on LLMs!! We also release a Python package for seamless MIA evaluation!! Paper: Repo:
Tweet media one
Tweet media two
3
28
200
@niloofar_mire
Niloofar Mireshghallah
5 months
Of all the things I could have gotten quoted for LOL
Tweet media one
9
4
199
@niloofar_mire
Niloofar Mireshghallah
10 months
🔐Can GPT-4 keep secrets & understand privacy? We study a new critical failure mode of LLMs on reasoning about privacy at inference-time through our ConfAIde benchmark. We find that GPT-4 reveals secrets 39% of the time, which only worsens with CoT! 🧵
Tweet media one
1
38
192
@niloofar_mire
Niloofar Mireshghallah
8 months
ICLR #Spotlight !! 🎉 1. LLMs have knowledge of privacy norms and primitives but cannot effectively *apply* it 2. Composing multiple pieces of information with different sensitivity levels makes it harder 3. CHAIN OF THOUGHT DOESN’T HELP! Paper:
Tweet media one
Tweet media two
Tweet media three
@niloofar_mire
Niloofar Mireshghallah
10 months
🔐Can GPT-4 keep secrets & understand privacy? We study a new critical failure mode of LLMs on reasoning about privacy at inference-time through our ConfAIde benchmark. We find that GPT-4 reveals secrets 39% of the time, which only worsens with CoT! 🧵
Tweet media one
1
38
192
7
19
186
@niloofar_mire
Niloofar Mireshghallah
4 years
Starting my "virtual" internship at @MSFTResearch AI's Knowledge Technologies and Intelligent Experience (KTX) group, where I'll help design #private and #ethical ML algorithms!
Tweet media one
10
6
184
@niloofar_mire
Niloofar Mireshghallah
9 months
Made it here last minute!! Hmu if u wanna talk privacy/memorization, or just wanna chat🤷‍♀️
Tweet media one
Tweet media two
2
5
177
@niloofar_mire
Niloofar Mireshghallah
4 months
Got some photos from @genlawcenter at DC, where I talked about Differential privacy, what it is and what it’s not! Talk slides:
Tweet media one
Tweet media two
@niloofar_mire
Niloofar Mireshghallah
5 months
I will be talking about what differential privacy is, what it is not and what some common misconceptions are in privacy for generative AI in a couple hours @genlawcenter in DC! Join us on the live stream: Slides:
Tweet media one
1
11
79
5
6
178
@niloofar_mire
Niloofar Mireshghallah
5 months
Can we uncover memorization of pre-training data in LLMs, using other LLMs? Our iterative prompt optimization method finds prompts that propel an LM to output training data using other LMs. We show higher avg. data reconstruction & extract 1.4X more PII!
Tweet media one
Tweet media two
Tweet media three
6
28
171
@niloofar_mire
Niloofar Mireshghallah
4 years
Checkout our #CCS2020 #PPMLP paper w/ @sahib_me @iamtrask @openminedorg : "Neither Private Nor Fair" where we dig deeper into the effects of differentially private deep learning on fairness. Paper: Code:
Tweet media one
3
44
167
@niloofar_mire
Niloofar Mireshghallah
5 months
Checkout our #EACL2024 paper: "Smaller LMs are Better Machine-Generated Text Detectors", where we compare ALL models of different sizes against each other and show GPT2-small (120M) can detect ChatGPT generations better than a 7B GPTNeo model!
Tweet media one
5
20
163
@niloofar_mire
Niloofar Mireshghallah
3 years
When reading text, we sometimes form an opinion about the author just by the style of the text, and this opinion might bias our perception of the text itself. In our #emnlp2021 paper, we study and try to mitigate these biases: code:
Tweet media one
Tweet media two
6
25
155
@niloofar_mire
Niloofar Mireshghallah
2 years
35k trained models on @huggingface , yet whenever we want to generate text w/ given attributes, we train new models/clsfrs. In our #ACL2022 paper, we enable using ANY arbitrary (even non-differentiable) expert for controllable generation, w/o ANY TRAINING!
Tweet media one
Tweet media two
Tweet media three
2
17
153
@niloofar_mire
Niloofar Mireshghallah
4 years
Call for papers🚨 We are accepting submissions for our @iclr_conf workshop, Distributed and Private ML (DP-ML). The scope includes, but is not limited to: Federated Learning, Differential Privacy for ML, FAT ML, Privacy in COVID era. Papers due Feb 25th.
3
47
151
@niloofar_mire
Niloofar Mireshghallah
2 years
Finally got to see the @MSFTResearch campus after my 4th internship with them haha.
Tweet media one
Tweet media two
Tweet media three
1
0
146
@niloofar_mire
Niloofar Mireshghallah
1 year
I bought a sun lamp, swapped my umbrella for rain pants and moved from SD to sunny Seattle! I have joined @uwcse as a postdoc where I am extremely lucky to continue working on #privacy & #NLP with @YejinChoinka & @tsvetshop ! PS no, I still don't have a Subaru! Sorry pnw!
Tweet media one
Tweet media two
Tweet media three
Tweet media four
9
0
146
@niloofar_mire
Niloofar Mireshghallah
3 years
There have been 70 Turing award winners since 1966, and only 3 of them have been women 🤯
6
6
140
@niloofar_mire
Niloofar Mireshghallah
4 years
Best parts of @iclr_conf : we don't have to run from hall to hall, we can easily engage in live conversations and ask questions at poster sessions without having to squeeze through and we didn't have to leave a huge carbon footprint to attend! Kudos to the organizers👏
1
4
140
@niloofar_mire
Niloofar Mireshghallah
2 months
📢Anyone who talked to me in the past year heard my rant of *LLM memorization is beyond form* & output overlap! ©️Reproducing similar series of events, or character traits also has copyright issues. 👩‍⚖️In new work we look at non-literal copying in LLMs!
Tweet media one
3
19
141
@niloofar_mire
Niloofar Mireshghallah
1 year
I had to sneak a sword to commencement for this. Thank god for the baggy robes lol
11
1
130
@niloofar_mire
Niloofar Mireshghallah
2 years
It’s a wrap for me 🎬 #NeurIPS22
Tweet media one
Tweet media two
Tweet media three
@niloofar_mire
Niloofar Mireshghallah
2 years
How do you #privately #compress large models ( #LLMs ), given the existing pre-train and fine-tune paradigm? In our #NeurIPS paper we try to answer this question and provide a DP framework for compression. Drop by our poster on Tuesday @11 :30, Hall J #107 !
Tweet media one
4
15
122
4
0
124
@niloofar_mire
Niloofar Mireshghallah
1 year
I will present our work on differentially private data synthesis for domain adaptation of semantic parsers at #ACL2023 . We model parse trees as intermediate variables to capture the distribution of user data. w/ @adveisner @tatsu_hashimoto @ysu_nlp @rshin
Tweet media one
Tweet media two
Tweet media three
0
13
125
@niloofar_mire
Niloofar Mireshghallah
4 months
See u in Vienna next week, but also in July!! 🇦🇹 #ICML2024
Tweet media one
@niloofar_mire
Niloofar Mireshghallah
7 months
TFW you ask ChatGPT a question and think ‘well that cant be the only right answer…’ In new work we look into how LLM alignment impacts pluralism and ability to reflect diverse opinions (it decreases it), and make an argument for pluralistic evaluations!
Tweet media one
Tweet media two
Tweet media three
0
6
64
5
8
125
@niloofar_mire
Niloofar Mireshghallah
2 months
Our work on challenges and inconclusiveness of membership inference attacks on LLMs has been accepted to @COLM_conf !! This work has instigated new directions and many conversations on MIA evaluations, I will list them here in this thread, add to it!
@niloofar_mire
Niloofar Mireshghallah
6 months
Was this sequence in the training dataset or not?? In new paper, we study why membership inference attacks show *near-random performance* on LLMs!! We also release a Python package for seamless MIA evaluation!! Paper: Repo:
Tweet media one
Tweet media two
3
28
200
4
10
124
@niloofar_mire
Niloofar Mireshghallah
4 months
In🇦🇹this week @iclr_conf to present: 1⃣Privacy-preserving in-context learning with DP few-shot generation 🖼️Tue 10:45 B-229 2⃣Can LLMs Keep a Secret? Testing Privacy Implications via Contextual Integrity 🖼️ Wed 16:30 B-215
1
20
123
@niloofar_mire
Niloofar Mireshghallah
2 years
How do you #privately #compress large models ( #LLMs ), given the existing pre-train and fine-tune paradigm? In our #NeurIPS paper we try to answer this question and provide a DP framework for compression. Drop by our poster on Tuesday @11 :30, Hall J #107 !
Tweet media one
4
15
122
@niloofar_mire
Niloofar Mireshghallah
5 months
Lmao this was NOT planned.
Tweet media one
@niloofar_mire
Niloofar Mireshghallah
6 months
I'll be @uclanlp tmw & @ucsbNLP the next day to talk about how the "emergent" capabilities of LLMs create emergent inference-time privacy risks, and how membership inference attacks can be inconclusive in current setups! Hit me up if you wanna chat!
Tweet media one
5
17
114
2
2
119
@niloofar_mire
Niloofar Mireshghallah
8 months
I have been working on some course material for privacy in LLMs, and the recent survey by @SethInternet has been so helpful, great systemization of knowledge! I definitely recommend giving it a read if you want to get an overall idea of the field!
5
15
116
@niloofar_mire
Niloofar Mireshghallah
1 year
Can the shape of the loss around a sequence tell us if it was part of the training data? YES! I will present our #ACL2023 work where we propose an MIA based on the loss curvature w/ @MatternJustus @ZhijingJin @mrinmayasachan @bschoelkopf @BergKirkpatrick
Tweet media one
1
18
117
@niloofar_mire
Niloofar Mireshghallah
6 months
I'll be @uclanlp tmw & @ucsbNLP the next day to talk about how the "emergent" capabilities of LLMs create emergent inference-time privacy risks, and how membership inference attacks can be inconclusive in current setups! Hit me up if you wanna chat!
Tweet media one
5
17
114
@niloofar_mire
Niloofar Mireshghallah
3 years
Excited to be giving a talk about my research on privacy and fairness of deep learning at the the Alan Turing institute next Wednesday! You can register here:
@prisec_ml
prisec_ml
3 years
Next Wednesday at 3pm (UK time), Fatemeh Mireshghallah @limufar (UCSD) will present "Low-overhead techniques for privacy and fairness of DNN training and inference" Register: Or watch the livestream:
0
4
20
4
17
111
@niloofar_mire
Niloofar Mireshghallah
1 year
I’m visiting MPI, University of Saarland and CISPA this week, reach out if you wanna chat! I will be giving a talk on Privacy and LLMs @CISPA on Friday! Also I will be vacationing in Istanbul, Amsterdam and Berlin the upcoming weeks, hmu if you wanna hangout and NOT research LOL
Tweet media one
Tweet media two
Tweet media three
Tweet media four
7
4
104
@niloofar_mire
Niloofar Mireshghallah
3 years
Just finished my remote presentation at #EMNLP2021 , have fun to all the folks who are there in person in the Dominican Republic 🌴! (Photo by @ZexueHe 📸)
Tweet media one
Tweet media two
@niloofar_mire
Niloofar Mireshghallah
3 years
When reading text, we sometimes form an opinion about the author just by the style of the text, and this opinion might bias our perception of the text itself. In our #emnlp2021 paper, we study and try to mitigate these biases: code:
Tweet media one
Tweet media two
6
25
155
8
0
103
@niloofar_mire
Niloofar Mireshghallah
1 year
I'm going to be in Hawaii for ICML! DM me if you wanna chat privacy, ethics and large language models! Also join us for our generative AI and Law (GenLaw) workshop on the 29th! We have a line up of amazing speakers/panelists from law, privacy, ML and HCI!
Tweet media one
Tweet media two
Tweet media three
0
11
102
@niloofar_mire
Niloofar Mireshghallah
3 years
Join us for an exciting program at the Distributed and Private Machine Learning (DPML) workshop @iclr_conf , happening tmw at 8:30AM PT. Invited speakers are Gauri Joshi, Graham Cormode, @UdacityDave and Lalitha Sankar!
Tweet media one
1
16
100
@niloofar_mire
Niloofar Mireshghallah
3 years
Now that conferences are virtual, why should the registration fee for a conference as an author be 268 euros? @TheWebConf They also don’t allow submitting talk videos before registration, and I won’t be reimbursed by my former advisor with whom I’ve authored the paper 😕
3
6
99
@niloofar_mire
Niloofar Mireshghallah
28 days
It was a pleasure to talk at the National Academies Forum about our recent works on sensitive disclosures in human-ChatGPT interactions and journalists' use of AI in the wild! Talk slides: Papers:
Tweet media one
Tweet media two
@yoshi_kohno
Tadayoshi (Yoshi) Kohno
28 days
Great talk from @niloofar_mire from @uwcse at the @theNASEM Forum on Cyber Resilience meeting, where she talked about LLMs, security, privacy, and "oversharing"
Tweet media one
0
3
41
3
15
99
@niloofar_mire
Niloofar Mireshghallah
4 years
Tom's talk for our paper: "Neither Private Nor Fair: Impact of Data Imbalance on Utility and Fairness in Differential Privacy" is up! Drop by at #ppmlp if you're attending #ccs , for Q&A. Paper: @openminedorg @sahib_me @iamtrask
Tweet media one
@niloofar_mire
Niloofar Mireshghallah
4 years
Checkout our #CCS2020 #PPMLP paper w/ @sahib_me @iamtrask @openminedorg : "Neither Private Nor Fair" where we dig deeper into the effects of differentially private deep learning on fairness. Paper: Code:
Tweet media one
3
44
167
0
12
93
@niloofar_mire
Niloofar Mireshghallah
2 years
Fill out this form if you'd like to receive feedback on your CS #gradschool application material (SOP, CV, ...)! If you're interested in helping me w/ this voluntary&independent effort, sign up here so we can help more students!
1
25
90
@niloofar_mire
Niloofar Mireshghallah
5 years
Reminds me of encryption :))
Tweet media one
3
15
86
@niloofar_mire
Niloofar Mireshghallah
2 years
Safari summarized my life for me:
Tweet media one
3
1
83
@niloofar_mire
Niloofar Mireshghallah
3 years
Thank you so much @trustworthy_ml 😊
@trustworthy_ml
Trustworthy ML Initiative (TrustML)
3 years
1/ In this week’s TrustML highlight, we are excited to feature Fatemehsadat Mireshghallah @limufar 🎉🎉⭐️⭐️ Fatemehsadat is a third-year CS PhD student at @ucsd_cse
Tweet media one
1
8
48
0
3
81
@niloofar_mire
Niloofar Mireshghallah
4 months
Vienna was fun! See u again in July @icmlconf lol
Tweet media one
Tweet media two
Tweet media three
Tweet media four
@niloofar_mire
Niloofar Mireshghallah
4 months
In🇦🇹this week @iclr_conf to present: 1⃣Privacy-preserving in-context learning with DP few-shot generation 🖼️Tue 10:45 B-229 2⃣Can LLMs Keep a Secret? Testing Privacy Implications via Contextual Integrity 🖼️ Wed 16:30 B-215
1
20
123
0
2
81
@niloofar_mire
Niloofar Mireshghallah
4 years
Check out our survey on Privacy in Deep Learning, where we have collected and categorized attacks and mitigations. Please let me know if there are any missing citations! This is a joint work with @proneat , @tremblerz , @raskarmit and @mktaram .
Tweet media one
Tweet media two
Tweet media three
Tweet media four
8
24
76
@niloofar_mire
Niloofar Mireshghallah
2 years
I will be presenting 2 papers @emnlpmeeting tmw, both on #privacy and #memorization in LLMs: 1. Poster session 1 @ 11AM: Quantifying privacy risks of #MLMs 2. Ethics Oral @ 2PM Hall B: Memorization in NLP Fine-tuning
Tweet media one
Tweet media two
Tweet media three
1
19
81
@niloofar_mire
Niloofar Mireshghallah
4 years
Check out our new pre-print on *Semantic Segmentation Interpretability* w/ @teddykoker @GKaissis @openminedorg ! Paper: Code:
Tweet media one
@teddykoker
Teddy Koker
4 years
New paper with @galaxygarden23 , Tom Titcombe, @GKaissis at @gridai_ @openminedorg We train a model to dynamically apply noise to images, learning which pixels of the image are necessary for downstream performance Paper: Code: 1/n
1
4
18
3
13
78
@niloofar_mire
Niloofar Mireshghallah
5 months
I will be talking about what differential privacy is, what it is not and what some common misconceptions are in privacy for generative AI in a couple hours @genlawcenter in DC! Join us on the live stream: Slides:
Tweet media one
@katherine1ee
Katherine Lee
5 months
So excited to announce an event @genlawcenter has been working on! We're discuss the misconceptions b/w the technical capabilities of evaluating generative AI, and what policymakers and civil society want... April 15th @GtownTechLaw , and live on zoom:
Tweet media one
9
37
135
1
11
79
@niloofar_mire
Niloofar Mireshghallah
3 years
If you are interested in Privacy in ML internships definitely apply to PAI @MSFTResearch , great opportunity to work with amazing mentors 😊 (this is coming from someone who interned with them twice lol)
@HuseyinAInan
Huseyin A. Inan
3 years
Privacy in AI team at Microsoft Research is looking for interns for Summer 2022 to be working on privacy-preserving ML and/or Federated Learning projects. Help spread the word please 🙂
3
44
128
1
9
75
@niloofar_mire
Niloofar Mireshghallah
2 years
Are masked language models prone to memorization? Yes! In our new preprint, we study the privacy risks of MLMs using our reference-based membership inference attack, w/ @rzshokri , @BergKirkpatrick , @kartik_goyal_ , & @ArchitUniyal3 .
Tweet media one
1
14
72
@niloofar_mire
Niloofar Mireshghallah
3 years
I agree with the advice given, but many students (e.g. Iranians) cannot go to visit days. Also, the burden of investigation should not be only on the student, universities SHOULD provide ACCOUNTABILITY measures for the faculty they hire. Like ratemyprofessor but for research!
@vj_chidambaram
Vijay Chidambaram
3 years
@heyelbs Good point! Its why you should talk to ex-students if you can. And visiting students should learn to read between the lines and take a lack of enthusiasm as a cause of concern.
1
0
4
5
1
72
@niloofar_mire
Niloofar Mireshghallah
4 years
Our first research scientists' meeting🎉 We are working on #privacy and systems solutions here at @openminedorg , join our community if you are interested! Checkout our latest blog post on recommender system privacy:
Tweet media one
3
13
72
@niloofar_mire
Niloofar Mireshghallah
2 years
Every morning we wake up to the news of another innocent soul’s execution. Being Iranian gets more painful everyday. Will this ever end?
1
4
69
@niloofar_mire
Niloofar Mireshghallah
4 years
Super excited to talk about privacy-preserving NLP and language models! You can find a list of related papers here: Please let me know if there are papers that are missing so I'll add them 😊
@openminedorg
OpenMined
4 years
PhD student at UC San Diego, @galaxygarden23 is joining #PriCon with the talk: Privacy-preserving Natural language processing Join us on 26.09.2020 - 27.09.2020 There is still time to register for a ticket:
Tweet media one
1
7
51
0
12
67
@niloofar_mire
Niloofar Mireshghallah
5 months
@jxmnop For prototyping pipelines that need differentially private fine-tuning T5 is really good, its small enough + there are existing DP-SGD implementations for it.
2
0
70
@niloofar_mire
Niloofar Mireshghallah
4 years
I have a joke about adversarial examples, but I'm sure you'll get it wrong :))
@thegautamkamath
Gautam Kamath
4 years
This joke was attacked by data poisoning which is why it's not actually funny.
0
1
38
2
4
69
@niloofar_mire
Niloofar Mireshghallah
3 years
Design: UX:
Tweet media one
Tweet media two
1
3
67
@niloofar_mire
Niloofar Mireshghallah
5 months
Wanna use #private data as part of in-context examples to an LLM? Checkout our #ICLR2024 differentially private few-shot sample generation, which is already deployed for #RAG in @llama_index !! Great collaboration w/ @XinyuTang7 & @MSFTResearch !
Tweet media one
Tweet media two
Tweet media three
@llama_index
LlamaIndex 🦙
5 months
Doing In-Context Learning Without Leaking Private Data 🔐 Few-shot demonstrations are crucial to improve the performance of any LLM/RAG app. But the issue with very private datasets (e.g. patient clinical reports), is that they can easily be leaked/jailbroken by malicious users.
Tweet media one
1
42
221
1
5
67
@niloofar_mire
Niloofar Mireshghallah
15 days
Excited to talk about privacy and memorizations in LLMs @ml_collective tomorrow!! Join us at 10am PT!
@ml_collective
ML Collective
15 days
Join us tomorrow at 10 AM PDT for an insightful DLCT session with @niloofar_mire ! We'll explore "Privacy in LLMs: Understanding how data is imprinted in language models, what data is imprinted, and how it might surface!" Don’t miss it! #AI #Privacy #LLMs
Tweet media one
1
2
8
2
8
67
@niloofar_mire
Niloofar Mireshghallah
1 month
👩‍⚖️I will be @icmlconf Wed-Saturday, co-organizing the 2nd @genlawcenter workshop and would love to chat about all things privacy, policy and LLMs! DM me or find me July 27th in Lehar 2!!
0
4
64
@niloofar_mire
Niloofar Mireshghallah
6 months
Happening now!! 🙈🙉🙊 Livestream link available on our website:
Tweet media one
@niloofar_mire
Niloofar Mireshghallah
6 months
Join us tmw for the 5th PPAI workshop @RealAAAI , to discuss Generative AI, Privacy & Policy! We have a line-up of amazing speakers & panelists talking about all things LLMs, regulation and why we should care about privacy: w/ @nandofioretto @JubaZiani
Tweet media one
Tweet media two
Tweet media three
2
5
53
1
0
64
@niloofar_mire
Niloofar Mireshghallah
7 months
TFW you ask ChatGPT a question and think ‘well that cant be the only right answer…’ In new work we look into how LLM alignment impacts pluralism and ability to reflect diverse opinions (it decreases it), and make an argument for pluralistic evaluations!
Tweet media one
Tweet media two
Tweet media three
@ma_tay_
Taylor Sorensen
7 months
🤔How can we align AI systems/LLMs 🤖 to better represent diverse human values and perspectives?💡🌍 We outline a roadmap to pluralistic alignment with concrete definitions for how AI systems and benchmarks can be pluralistic! First, models can be…
Tweet media one
2
57
243
0
6
64
@niloofar_mire
Niloofar Mireshghallah
3 years
This is like saying apples are better than oranges. People choose their specialization based on what they like. I appreciate the effort put into this but I think this type of categorization is more harmful in the long term and it's detrimental to diversity and equity.
Tweet media one
@ameerrahmati
Amir Rahmati
3 years
Application review season is coming up! If you are a CS faculty trying to review Iranian applicants, here is a quick guide on how to gauge them: #AcademicChatter
77
7
107
2
1
59
@niloofar_mire
Niloofar Mireshghallah
4 months
If you are attending @iclr_conf and are interested in privacy regulations, especially in EU, join us on May 11th at the 'Privacy Regulation and Protection in' workshop! Location: Schubert 3, Messe Wien Exhibition and Congress Center
Tweet media one
Tweet media two
Tweet media three
3
6
62
@niloofar_mire
Niloofar Mireshghallah
4 years
Check out our new preprint on protecting attribute privacy by learning differentially private perturbations. The image shows representations generated by our framework that protect the utility of smile detection while obfuscating excessive information!
Tweet media one
1
13
62
@niloofar_mire
Niloofar Mireshghallah
4 years
Join us at our @WiMLworkshop breakout session "Feminist Perspectives for ML & CV" held within @icmlconf where we will discuss data feminism, diversity and inclusion and talk about examples where classification has gone wrong. Find out more:
2
16
61
@niloofar_mire
Niloofar Mireshghallah
5 years
"Differentially Private Machine Learning: Theory, Algorithms, and Applications" Slides: Talk video: A two hour comprehensive tutorial on differential privacy by @kamalikac and @ergodicwalk from @NeurIPSConf 2017.
0
16
61
@niloofar_mire
Niloofar Mireshghallah
2 years
What can we, as [international] Iranian students outside do to help other students? w/ @ucsd I'm trying to raise awareness, get application fee waivers, TOEFL score submission postpones and help for SOP and CV writing. What are other things we could do?
2
8
60
@niloofar_mire
Niloofar Mireshghallah
3 years
In most forms that ask for ethnicity, #middle_easterners get classified as white, which I find culturally inaccurate, particularly for diversity and inclusion purposes. Are there other ethnic groups that you feel get misrepresented in such forms? (Working on some #DEI surveys)
6
6
59
@niloofar_mire
Niloofar Mireshghallah
5 years
امروز دقیقا یکسال شد اومدم و به جای این خطبه های کسشر احساسی فقط میخوام بگم تاحالا یه غذا ام نپختم و هنوز قابلمه ام ندارم و زنده ام. پس از غذا پختن بلد نبودن نترسید‌+ هنوز بعصی اوقات حس میکنم ای واای روسریم افتاده میام درستش کنم که یهو به خودم میام و یه لبخندی میزنم مث کسخلا:))
3
0
57
@niloofar_mire
Niloofar Mireshghallah
2 years
Count the BERTs ☠️ (There’s more than there should be lol)
Tweet media one
Tweet media two
Tweet media three
@niloofar_mire
Niloofar Mireshghallah
2 years
I will be presenting 2 papers @emnlpmeeting tmw, both on #privacy and #memorization in LLMs: 1. Poster session 1 @ 11AM: Quantifying privacy risks of #MLMs 2. Ethics Oral @ 2PM Hall B: Memorization in NLP Fine-tuning
Tweet media one
Tweet media two
Tweet media three
1
19
81
0
1
59
@niloofar_mire
Niloofar Mireshghallah
5 months
Super excited to give a talk on what differential privacy is, what it is not and to clarify common misconceptions when it comes to privacy @genlawcenter in DC!! Thanks to the amazing organizers @katherine1ee @afedercooper @HodaHeidari @grimmelm @mbogen @paulohm @AlexReeveGivens
@katherine1ee
Katherine Lee
5 months
So excited to announce an event @genlawcenter has been working on! We're discuss the misconceptions b/w the technical capabilities of evaluating generative AI, and what policymakers and civil society want... April 15th @GtownTechLaw , and live on zoom:
Tweet media one
9
37
135
2
4
53
@niloofar_mire
Niloofar Mireshghallah
6 months
Join us tmw for the 5th PPAI workshop @RealAAAI , to discuss Generative AI, Privacy & Policy! We have a line-up of amazing speakers & panelists talking about all things LLMs, regulation and why we should care about privacy: w/ @nandofioretto @JubaZiani
Tweet media one
Tweet media two
Tweet media three
2
5
53
@niloofar_mire
Niloofar Mireshghallah
5 years
This is why we need fair and unbiased AI! Based on my Google history, Google ads has deduced that I am male. You can go through the ads setting in your Google account and see Google's deductions about yourself, and turn settings on and off:
Tweet media one
5
10
53
@niloofar_mire
Niloofar Mireshghallah
14 days
When all you do is test limits of capabilities in LLMs its easy to lose sight of how they can be useful! Nicholas Carlini’s blog () Got me to try them in daily code/writing and I can’t believe how my barrier to do boring work is lowered! (I use Claude!)
1
4
53
@niloofar_mire
Niloofar Mireshghallah
5 years
یه کره ای توی لبمون هست منو وقتی اونورم صدا میکنه Niloo far بعد نزدیک که میشم میگم چیه میگه Now you're Niloo close :))))))) 22 سال و کسی تاحالا اینو کشف نکرده بود
1
0
52
@niloofar_mire
Niloofar Mireshghallah
2 years
Hi, I'm Fatemeh and I "don't use my brain". (feedback I received from a recent graduate of my lab/mentor with whom I was collaborating, during my first quarter as a PhD student)
@bariskasikci
Baris Kasikci
2 years
Hi I am Baris! I should just just stop working on my research/thesis, because my ideas are just bad. (From a review of my first paper submission).
1
0
55
3
1
51
@niloofar_mire
Niloofar Mireshghallah
5 years
@kongaloosh @hardmaru Luckily, lately many company's have stopped putting students who apply for research internships through time-consuming coding evaluations. I had really good interview experiences for research positions this year with MSR, Google, Avast and Fujitsu without coding questions!
5
3
52
@niloofar_mire
Niloofar Mireshghallah
9 months
We would sit by the gutter next to it and have sandwiches LOL Those were the days
Tweet media one
@abeirami
Ahmad Beirami
9 months
Using only a restaurant, tell us where you went to college
Tweet media one
1
2
59
2
0
51
@niloofar_mire
Niloofar Mireshghallah
5 years
Excited to be presenting "Shredder" at the #ICML2019 workshop on Security and Privacy of Machine Learning next week!
Tweet media one
2
10
50
@niloofar_mire
Niloofar Mireshghallah
4 months
Happening now in Schubert 3!! Join us for the privacy regulation and protection workshop!
Tweet media one
Tweet media two
Tweet media three
@niloofar_mire
Niloofar Mireshghallah
4 months
If you are attending @iclr_conf and are interested in privacy regulations, especially in EU, join us on May 11th at the 'Privacy Regulation and Protection in' workshop! Location: Schubert 3, Messe Wien Exhibition and Congress Center
Tweet media one
Tweet media two
Tweet media three
3
6
62
1
1
50
@niloofar_mire
Niloofar Mireshghallah
4 years
Honored to be selected as an #NCWITAiC20 collegiate award recipient this year, for my project Shredder! 🎊🎉 . @ucsd_cse @NCWIT @NCWITAIC
@NCWITAIC
NCWITAIC
4 years
CONGRATULATIONS to the #NCWITAiC20 Collegiate Award Recipients! This award recognizes outstanding technical contributions to projects by women, genderqueer, and nonbinary undergrad and graduate students. Learn about the winning projects here: .
Tweet media one
2
8
24
11
2
49
@niloofar_mire
Niloofar Mireshghallah
12 days
Super pumped to be speaking at the Red Teaming workshop @NeurIPSConf !
@niljanaakpinar
Nil-Jana Akpinar
16 days
📣 Very excited to announce our Neurips 2024 workshop on Red Teaming GenAI: What Can We Learn from Adversaries? Submission are open now with deadline September 14, 2024! Website:
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
24
80
0
2
49
@niloofar_mire
Niloofar Mireshghallah
4 years
This is an example of how something that might seem harmless to one population, can actually cause damage to another population!
1
18
47
@niloofar_mire
Niloofar Mireshghallah
5 years
با ادوایزرم رو ویدیو چت بودیم ول کرد رفت، منم داد زدم گوگل هومشو صدا زدم همه مردم آزاری های ممکن رو دارم انجام میدم=)) کلی آلارم ست کردم :))))
2
0
48
@niloofar_mire
Niloofar Mireshghallah
9 months
I was supposed to present 2 papers in 🇸🇬 here is the tldr; 1/ Non-Parametric Temporal Adaptation w/ Retrieval: Efficient adaptation + Right to be forgotten ( #GDPR ) 2/ A block MH sampler for controllable generation from
Tweet media one
Tweet media two
Tweet media three
@niloofar_mire
Niloofar Mireshghallah
9 months
This is me every December lol Have fun in Singapore 🇸🇬 folks! (I think @emnlpmeeting hates me I get sick every year!!)
5
0
18
1
4
49
@niloofar_mire
Niloofar Mireshghallah
4 years
The deadline for the Distributed and Private ML workshop @iclr_conf is in less than a week: Use the promo code #dpml at submission time for a 10% higher chance of acceptance [jk 😂]
@niloofar_mire
Niloofar Mireshghallah
4 years
Call for papers🚨 We are accepting submissions for our @iclr_conf workshop, Distributed and Private ML (DP-ML). The scope includes, but is not limited to: Federated Learning, Differential Privacy for ML, FAT ML, Privacy in COVID era. Papers due Feb 25th.
3
47
151
3
9
47
@niloofar_mire
Niloofar Mireshghallah
5 years
واسه اولین بار بهش زنگ زدم که از دلتنگی گریه کنم. اون ولی خیلی قوی تر از منه، همش میگفت "گریه کن مامان خالی شی، ولی زندگی همه الان همینه، تو که نمیدونی چی میشه شاید تا دو سه سال دیگه همه چی فرق کرد و تونستم بیام پیشت" تا حالا گریشو ندیدم، با این حال که اونه که الان تنهاست، نه من
1
0
44
@niloofar_mire
Niloofar Mireshghallah
3 years
Submit your work to our Privacy-preserving Machine Learning workshop at MICCAI 2021! Deadline is June 25th
@GKaissis
Georgios Kaissis
3 years
I'm happy to announce our Privacy-Preserving Machine Learning Workshop and Tutorial at MICCAI 2021 organised by @TU_Muenchen , @BioMedIAICL and @openminedorg ! Check out for more information. Details and paper deadlines will follow soon! 1/2
2
18
83
0
8
47
@niloofar_mire
Niloofar Mireshghallah
9 months
Checkout our GenLaw report on the discussions regarding generative AI, law and policy!!
@katherine1ee
Katherine Lee
9 months
3 exciting updates from Generative AI + Law ( @genlawcenter )! 1: We’ve written a report on the state of the field: 2. GenLaw → we’re becoming an official nonprofit! 3. GenLaw 2 coming soon – centering policy and policymakers More below!
Tweet media one
6
46
252
0
5
46
@niloofar_mire
Niloofar Mireshghallah
1 month
This got me curious to snoop the memorization analysis more carefully and I found they cited our recent memorization paper too! Thorough discussion/analysis from the Llama Team @AIatMeta ! tldr; we optimize prompts to maximize data extraction:
Tweet media one
@gowthami_s
Gowthami Somepalli
1 month
Pleasant surprise while reading Llama 3 paper! It’s my memorization paper. 🙂 #llama3
Tweet media one
22
18
936
3
4
46
@niloofar_mire
Niloofar Mireshghallah
2 years
Come join us at the EthiCS workshop @NDSSSymposium next Monday, where I’ll give a keynote on Large Language Models and how much we can trust them!
Tweet media one
Tweet media two
Tweet media three
Tweet media four
@kengiter
Kangjie Lu
2 years
We are excited to announce that EthiCS 2023 has three exciting and timely keynotes! Please check out the details here:
1
2
10
0
4
43
@niloofar_mire
Niloofar Mireshghallah
5 years
تو لوور از راهنما پرسیدم بخش ایران قدیم کجاست، به فرانسوی گفت امروز بسته است، منم فرانسوی جواب دادم ما این همه راه اومدیم حالا میگی را نمیدی؟ :)))) دلم یکم خنک شد:))
2
0
41