Dan Goldstein
@dggoldst
Followers
11K
Following
30K
Media
971
Statuses
9K
Senior Principal Research Manager at Microsoft Research NYC. Economics and Computation Group. Distinguished Scholar at Wharton.
New York
Joined October 2007
If you see a graph like this, I don't think you should conclude people are "really bad" at estimating something (like where they sit in the income distribution or the size of groups in America), unless you truly believe they're "really bad" at estimating everything. 1/4
16
96
473
Okay so this is wild. I'm using this ticket machine in Japan and it malfunctions and doesn't give me my change. Suddenly, a panel in the wall opens in the wall and a guy appears and tells me to hold on and then gives me my change.
234
4K
126K
@ON_LIGHT_fr In France the man says that the machine has already worked 32 hours this week and gets to take a break.
9
28
7K
To do something about the high price of gas, Germany has introduced a €9 ticket that lets you travel all around the country. Basically free transit for an entire month. I'm here for 3 days and bought one.
68
633
5K
What are some debunked things that a lot of reasonably well-informed people don't know are debunked?.
529
90
1K
Suppose f is a real-valued function defined on the interval [a, b] and integrable in the sense of Lebesgue. Now suppose I was lying about that. Do you feel betrayed?.
29
86
898
One person I feel who is insufficiently appreciated is Hadley Wickham. The results of his work are everywhere, every journal and conference I know. He changed the history of science.
12
110
746
Do people who do research on counterfactuals think about what it would be like if they chose another topic?.
24
76
639
Professors, don't be mean to job candidates, they remember it the rest of their lives. Source: remembered it the rest of my life.
8
34
565
At the breakfast bar and wondering if having everybody touch the same pair of tongs in the same place is proven to be better than having everybody simply pick up their own piece of bread.
29
76
595
Econ academics will spend eight days polishing a 20 page reply-to-reviewers letter and then go to the FTC and present something they slapped together on the train. This is said without exaggeration.
4
19
460
Nobel Prize 2030. Peace - Claude Xo.3.Literature - Gemini Prime'+.Physics - Copilot 15X Enterprise.Chemistry - PaLM 52.1 Fusion.Medicine - GPT7 UltraMax.Economics - Stata 19.
7
51
464
Covariance can be visually represented with the areas of rectangles formed by the origin and each point. From Wagenmakers,Godmann, de Ruiter, van Doorn. Visualizing the Equation for the Sample Correlation Coefficient.
8
83
428
AI writes the paper. AI reviews the paper. AI rejects the paper. AI sends to paper to another AI. New AI says revise and resubmit. AI revises and resubmits. AI accepts paper. AI tweets about the paper. 1/.
13
59
403
Want to help your students write impactful articles? Share this tip. Round your darn numbers! . We've got empirical evidence by not rounding:. -Readers are much less likely to recall (even roughly) your findings. -Readers are much less able to apply your findings. 1/
13
67
365
Kids are hard to understand. Our 8 year old:.- made a fake German passport.- made herself unemployed.- made the city of issue Bielefeld. We have no idea why
16
18
293
🎇 PhD student internships in Computational Social Science at Microsoft Research NYC 🎇. These are 12 week, in person internships with some combo of Dan Goldstein, Jake Hofman, & David Rothschild . Early (January - April) start dates somewhat preferred .
4
74
289
I know a person who runs lots of field experiments. Literally prize winning stuff. Their estimate of how likely it is for a field experiment to happen successfully once a partner firm or organization agrees:. 10%. (Success here means actually carried out, correctly).
14
34
268
"Under attack for decades, rational choice theory finally died in 2020 when a majority of economists admitted it could not explain their own use of STATA.".
6
37
257
It was the best of times. It was the worst of times. I NEVER SAID IT WAS THE BEST OF TIMES! #TrumpBookReport.
0
82
238
It will go on at least 3 months for 9 Euros a month. A transit econometrician's dream.
7
12
222
Microsoft Research New York City (MSR-NYC) and Microsoft Research New England (MSR-NE in Cambridge MA) will do calls for postdocs in:. Computational Social Science.Economics and.Econ-CS (Economics+Computer Science). I will tweet and toot these announcements as they come.
4
51
230
I propose a regression appreciation day on which we call it extraordinary least squares.
4
19
221
🎉🎉🎉.The Computational Social Science group at @MSFTResearch New York City is now accepting applications for PhD student interns for 2023!. Internships are:.- Paid!.- 12 weeks!.- In person in NYC! (w/ up to 50% work from home!). 1/4.
1
67
220
P-hacking can be time consuming and tedious. Proud to open source this efficient base R routine. - Runs in < 500 nanoseconds (per microbenchmark).- Easily parallelizable.- Output preserves monotonicity and linear scalability in its defined domain
7
10
211
Please note that there is a huge debate whether the first version is an error given conversational norms. The second one is more clearly an error and reflects current difficulties in getting these things to do mathematical reasoning.
5
0
183
I'm writing a screenplay about a social psychologist who risks it all to build a spice market called Motivated Seasoning.
14
10
177
🚨Postdoc Alert 🚨 . The Computational Social Science group at Microsoft Research NYC (@jakehofman, @DavMicRot, @dggoldst) is hiring a postdoc!. Deadline: December 20, 2024.
4
74
188
Imagine you:. Take a random sample of 100 observations from a standard normal distribution (mean 0, standard deviation 1). Take another. Do a t-test on the two samples and record the p value. Repeat the above 10,000 times. A histogram of the 10,000 p values will look like a.
20
33
177
Do people who do research on counterfactuals think about what their life would be like if they did research on something else?.
10
17
173
Are there readings or decision trees to help students learn how to choose a mixed-effects (random effects) model specification?. There's much written on syntax, less on the principles. Something with examples of both (and newer than Gelman & Hill) would be great!.
13
19
153
If you're interested in this, read this paper by Miller and Sanjurjo. I once interviewed Miller on how they figured something out that people studying the hot hand had missed for decades.
The correct answer is “Bob.” Congrats to the 10% who got it right — those few brave dreamers.
6
21
160
so many Twitter bios say "opinions are my own" instead of "opinions are shaped by norms, values, and ideologies imparted by family, education, peers, media, and culture".
14
13
154
econ programs choosing film school grads over predocs because they're better at reel analysis.
A Harvard economics student Wesley Wang spent 2+ years making a short film in high school and posted it online. Darren Aronofsky saw it & emailed him. After a bidding war, TriStar Pictures bought the rights. Wang will adapt it to film to be produced by Aronofsky’s Protozoa firm.
6
10
150
"Success stories cause false beliefs about success". New from: George Lifchits, Ashton Anderson (Toronto), Daniel G. Goldstein, Jake M. Hofman (Microsoft Research), Duncan J. Watts (Penn). . @glifchits @ashton1anderson @dggoldst @jakehofman @duncanjwatts
2
51
143
I wrote up a gotcha that can get you when designing experiments. It's in the intro of the 2022 Behavioral Economics Guide. Reviewers have described it as "outstanding" and "cracking." . I would be happy if you read it!. Direct link (PDF pages 7-22):
6
30
146
People should not be sued for speaking up about irregularities in published scientific papers. I just contributed $1,000 to Data Colada's legal defense.
4
18
136
🚨 RESEARCH ASSISTANT POSITION AT MICROSOFT RESEARCH NYC 🚨. Ideal for those who wish to go to PhD programs in Computer Science or Computational Social Science. Strong front-end and R programming skills required.
4
62
149
RESEARCH ASSISTANT POSITION AT MICROSOFT RESEARCH NYC. Ideal for those who wish to go to PhD programs in computational social science. Front-end programming skills required. No guarantees but our last 5 RAs *all* got into great grad schools!.
1
107
142
The artist actually made 40 different versions of this drawing but only this one caught on
4
5
145
It's funny to see praise for these university endowment portfolio managers who did *checks notes* the same as or worse than the S&P 500 while charging hefty fees.
10
12
133
Screen time is associated with lower well-being about as much as regularly eating potatoes is. Putting "variance explained" into perspective from h/t @jakehofman
3
51
134
Microsoft Research NYC has 12 week internships in Computational Social Science (my group). Goal is to crush a project that we (incl you) find interesting and that is also interesting to academic and general audiences. @dggoldst. @jakehofman @DavMicRot.
5
71
132
I wonder if published p = .06 results replicate more often than published p = .04 results.
3
7
126
Watching the upper right cell makes me feel guilty about how I've been fooled in the past, angry about the time I've wasted in misguided talks, and relieved that those days are over.
1
37
120
Every so often, a little known figure who claims to have proven a longstanding problem actually has proven it.
A famous conjecture linking geometry, probability theory and statistics has been proved at last:
1
69
122
🚨Microsoft PhD internship alert🚨. PhD students: The Microsoft Research NYC Computational Social Science group is really good. Apply to do a 12 week project of mutual interest with @jakehofman @davmicrot & @dggoldst . Winter / spring starts encouraged!.
3
45
124
I predict that LLMs will be used to flood the internet with pages containing plausible-sounding but worthless answers to vast numbers of search queries. Why? For traffic. Search engines will spend a lot fighting this. People will waste a lot of time reading nonanswers. 1/2.
9
16
122
You know all those surveys showing how people overestimate the percentage of immigrants in their country? . This working paper shows that if you drop people who are clearly rounding (5, 10, 15, . ) you end up with highly precise estimates!.
4
14
125
I was once designing a study with an econ colleague. -Econ: Aren't we worried about selection there?.-Me: No, because randomization.-Econ: I'm so used to worrying about that I sometimes forget to not worry about that.
4
7
118
Microsoft's Computational Social Science group may have the opportunity to hire one researcher. Senior: 0-3 yrs post PhD. Principal: 3+ yrs post PhD. Please note: our ability to hire this season is not certain.
2
48
124
Statistical significance and even sign can be a distraction when effect sizes are tiny. Effect sizes matter. People's understanding of effect size matters.
4
19
120
Never seen someone so touchy about being fact checked. He'd really hate the peer review process.
4
13
112
Next Level Science. Good: Results somewhat unlikely to occur by chance. Better: Results very unlikely to occur by chance. Best: Results impossible. 1 /🧵.
4
20
113
I love probability distributions. They're just really pleasing to think about.
14
8
112
Behavioral science is over a century old, spans many fields, and shaped modern statistics, experimentation, and machine learning . I keep hearing people dismiss all of behavioral science because of recent fraud in one subfield.
10
8
111
I weighed some eggs over the weekend. "Extra large" eggs weigh 14% more than "large" eggs but cost only 4% more. That's how they get ya.
15
2
108
You will see a bunch of Meta / Facebook papers drop today and soon after. Hats off to the academic researchers, but also to the internal Meta researchers. The whole idea of doing collaborations with academics was theirs. They invested years of tireless effort to get to today.
3
11
115
Accepted Paper Alert 🚨. Our experiment on LLM search, designed before we knew Microsoft or Google would go into LLM search, was just accepted at CHI.
5
19
115
Also "loss aversion is more prevalent in people with high cognitive ability". This is big!.
Are most people really loss-averse? Not really!. Around 50% of the US population is loss-tolerant and many people accept negative expected-value gambles. Fascinating new paper by Chapman, @snowberg, Wang & @CFCamerer that completely changed my priors:.
6
14
109
Distrust of algorithms growing in the US. Three most dangerous according to a recent poll:.3. Cross multiplication.2. Long division.1. The FOIL method.
7
25
111
Here's a paper that explains the difference between standard errors and standard deviations:. Here's our paper, which shows that experts (doctors, professors, data scientists) mix them up:.
0
34
107
We are hiring a postdoc in Computational Social Science at Microsoft Research-New York City. Application deadline December 8, 2019. RTs appreciated.
2
100
110
An argument between our kids prompted an investigation. Believe it or not, we seem to be in possession of a loaded dreidel.
6
2
101
Periodic reminder that this pattern shows up in just about all perception studies of just about everything .
People in the lowest IQ quartile overestimate their IQ; people in the highest IQ quartile underestimate theirs. (SEI = self-estimated intelligence.)
5
5
108
I am going on Shark Tank with a business plan to convert manuscriptcentral login failures into a form of renewable energy.
4
1
95
Just saw on TV a character playing Ariely say "one of the easiest ways to get more [organ donation] sign ups is to change the default to donating". Someone replies "wait a minute, you're *that* professor!". Thing is, "that professor" is actually @ProfEricJohnson and me
6
6
103
Microsoft Research NYC is hiring a postdoc in "Machine Learning + X," where X is in the set of: AI for Systems, Computational Social Science, Econ-CS, FATE. Deadline: Dec 15th, 2021. RTs appreciated by the person who gets the job because of you.
0
63
106
Are we alone in the universe?. What caused the Big Bang? . How do you cluster standard errors?.
2
8
99
Interesting that. "I expected more from you"."I expected less from you".and."I expected as much from you". are all insulting.
8
3
98
IF you are a CS major or skilled front-end programmer. AND you are looking to go to grad school in CS, Psych, Econ, or Business. THEN you should take a year and work with us. (No guarantees but our last 3 RAs got into MIT & Stanford).
5
30
98
Funny how the magnifying glass means "search for text" and the text means "change the magnification"
4
2
99
This is a pan and plate scraper. I use it daily. Lasts forever. Hygienic. Dishwasher safe. Won't scratch. Big. Feels good in the hand. Makes sponges mostly irrelevant. I gave one to my parents, put one in the tool box, drilled a hole in one and hung it in the workshop. $1.82
12
2
95
I'm easy to impress in talks. If you use the terms "percent difference" and "percentage point difference" correctly I'm already rooting for you.
4
9
97
NYC undergrads: Want to learn data science this summer from Microsoft researchers?. Each student gets a $5k stipend & a laptop to keep. As we are committed to diversity in computer science, we strongly encourage women, minorities, and individuals with disabilities to apply.
attn nyc undergrads: applications are open for this year's data science summer school at microsoft research nyc!. apply here:
2
54
95
That feeling when you older than 20 and read an article on cognitive decline:
5
2
88
I regret the time I spend scrolling around on Twitter so I'm quitting for the rest of the year. Account will stay up and blog autoposts will continue. Apologies in advance for not giving the ❤️s my counterfactual self would have given.
6
1
91