I finally wrote a blog detailing our recent work on using model merging to mitigate backdoor attacks in NLP models, which has been accepted for presentation at ACL 2024. Let me know your thoughts! 🙃 #NLP #AISafety #ACL2024 #backdoor

@wangbin579 Yes!

RT @jordihays: Companies should do NBA style trade deals. I want to see OpenAI trade its COO and CFO to Anthropic in exchange for their C…

@Sentdex Does OpenAI use any watermarking algorithms? I'm not sure if they even work at all for such big models.

RT @kohjingyu: Adding \vspace{-0.00352} beneath a figure caption so that 2 extra lines get moved up, section 3.5 flows onto the previous pa…

@mrsiipa I would love to get into CUDA and kernels. Been following your work for some time now. What should be my starting point?

@shhrreeyyy Academic research is something the country never invested in. Getting jobs is the prime motive and it should be. But doing a masters or a PhD being seen as a way to delay unemployment tells a lot about the research culture. Then come the stipends which can barely keep one afloat.

RT @altryne: POV: A chinese company drops a powerful open source reasoning AI model competitive with o1 that neither of your companies have…

RT @Sentdex: how it feels watching a training run as loss falls

@gan_chuang Professor, what is your advice on Master's students trying to break into corporate R&D labs? What skills are useful to get in and what should a decent resume look like?

@guohao_li @CamelAIOrg Hi Mr. Li. I sent a DM a few weeks ago. I would really appreciate you giving it a look. Thanks!

@boonafterboon @karpathy I choose you

@prajdabre1 Another example could have been a mega transformer (the robot one).

@prajdabre1 This work explores another aspect of model merging rather than focusing on just increasing model capabilities. I think this did not receive much attention as it is an unconventional approach to the problem: (This is my first published work too. 😁)

@prajdabre1 Recently, we also published some work which shows model merging can be used to mitigate backdoor attacks!

RT @GRITCULT: Gm

@iraqnarok @Rheiji1 @sporadicalia Valid point. So, if there is a WW3 with reliance on major tech components to win, a "Non-American" engineer hired from an ally helps with a major breakthrough. Then their future generations should be allowed on the soil?

RT @miniapeur:

@DonnieLH14 @conspicuous21 @sporadicalia I can only talk from a tech pov. Tech progress of countries highly depends on the tech from international hubs, with open access being mostly produced in the US (I might be wrong here). I'd like technological advancement anyway with or without me. What do you say?

@ChonelolaCactus @sporadicalia That is a valid point. What would your immigration policy look like?