Lechao Xiao Profile
Lechao Xiao

@Locchiu

Followers
987
Following
523
Statuses
138

Research Scientist @GoogleDeepMind / Google Brain. Tackle scaling, along the path to AGI.

New York, NY
Joined September 2009
Don't wanna be here? Send us removal request.
@Locchiu
Lechao Xiao
2 days
@andrewgwils Industry does do quite a lot of fundamental research. The frontiers of fundamental research (in ML) and practice have merged, but only very few people can see and understand this. Eg, Imho, pretraining is the frontier of the most fundamental research in machine learning .
1
3
13
@Locchiu
Lechao Xiao
10 days
@Ar_Douillard solid paper. 14 pages reference 🤣
1
0
2
@Locchiu
Lechao Xiao
10 days
@sfrei_ @GoogleDeepMind Welcome! Glad to have you joined us!
1
0
2
@Locchiu
Lechao Xiao
11 days
Very cool! Congrats and thanks for trusting our codebase!+ @peterjliu (creator of nanodo), @ARomanNovak ,@_katieeverett (pre-)lead of the codebase.
@Ar_Douillard
Arthur Douillard
11 days
Engineering shoot-out to Nanodo & Drjax for making it possible. Nanodo ( is a great jax open-source codebase from @Locchiu @Mitchnw et al. DrJax ( allow us to efficiently parallelize training. Look at their paper (, those guys were already training distributed training at 8B scale last year!
1
0
11
@Locchiu
Lechao Xiao
12 days
It’s extremely exciting to see the frontiers of science and practice merge, yet equally disheartening to see when they become frontier of geopolitics. What wisdoms do AI offer to human?
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
0
6
@Locchiu
Lechao Xiao
12 days
@kellerjordan0 @adamlerer @mobav0 Congrats and thanks for your inspiring work to the community!
1
0
4
@Locchiu
Lechao Xiao
2 months
@spteotia Possible if I live long enough
0
0
3
@Locchiu
Lechao Xiao
2 months
@spteotia L5 is certainly asi level ; l6 may be solving several of them
1
0
1
@Locchiu
Lechao Xiao
2 months
@BrandoHablando Sth likes several good results that each can be published in a top tier 2 math journal (eg transaction of American mathematical society), top journal in a subfield (eg analysis and pde); ~ a good phd thesis in a top 20 phd program
0
0
0
@Locchiu
Lechao Xiao
2 months
@dmdohan any thoughts about how the difficulty levels (low, medium, high) distributed across the 25% of problems that have been solved?
0
0
1
@Locchiu
Lechao Xiao
2 months
@cloneofsimo fyi, this particular problem was in the high difficulty category of the dataset; there are low/medium difficulty problems, presumably easier; see appendix A.1
0
0
16
@Locchiu
Lechao Xiao
2 months
@jasondeanlee not research problems; sth more like (hard) GTM exercises
0
0
3
@Locchiu
Lechao Xiao
2 months
“勿以恶小而为之,勿以善小而不为。惟贤惟德,能服于人” ("Do not do evil just because it is small; do not ignore doing good just because it is small. Only by being virtuous and moral can one be respected by others.") learned this in middle school, never forgot, passed it to my kids
@sunjiao123sun_
Jiao Sun
2 months
Mitigating racial bias from LLMs is a lot easier than removing it from humans! Can’t believe this happened at the best AI conference @NeurIPSConf We have ethical reviews for authors, but missed it for invited speakers? 😡
Tweet media one
0
0
21
@Locchiu
Lechao Xiao
2 months
@_arohan_ You will be missed and thanks for your many contributions.
1
0
4
@Locchiu
Lechao Xiao
2 months
@hyhieu226 Why not coscale it with #params?
2
0
2
@Locchiu
Lechao Xiao
2 months
@giffmana @__kolesnikov__ @XiaohuaZhai This should be 0. lol . Sad to c u leave , congrats oai
0
0
2
@Locchiu
Lechao Xiao
3 months
@Grad62304977 Xlable: step
0
0
2
@Locchiu
Lechao Xiao
3 months
RT @alemi: If you miss the NYTimes needle, especially one that is statistically uniform (, you can use this page: h…
0
1
0
@Locchiu
Lechao Xiao
4 months
Lgtm
@_arohan_
rohan anil
4 months
Two amazing accounts with high signal I have been impressed by recently on this app is: @cloneofsimo and @kellerjordan0 Just unprompted thought :)
0
0
4