![Anne T. Griffin Profile](https://pbs.twimg.com/profile_images/1713047070037172224/UHsVoylU_x96.jpg)
Anne T. Griffin
@annetgriffin
Followers
5K
Following
139K
Statuses
41K
Product leader building human-first AI & emerging tech | Coach for ambitious founders & PMs | Teaching AI on @OReillyMedia | Insights in @RollingStone
NYC
Joined February 2009
“Higher confidence in GenAI’s ability to perform a task is related to less critical thinking effort.”
🚨 Studies are starting to show what many of us feared: AI use might lead to overreliance and human disempowerment. Below is the SHOCKING conclusion of this particular study [download for future reference]: "1. We surveyed 319 knowledge workers who use GenAI tools (e.g., ChatGPT, Copilot) at work at least once per week, to model how they enact critical thinking when using GenAI tools, and how GenAI affects their perceived effort of thinking critically. Analysing 936 real-world GenAI tool use examples our participants shared, we find that knowledge workers engage in critical thinking primarily to ensure the quality of their work, e.g. by verifying outputs against external sources. 2. Moreover, while GenAI can improve worker efficiency, it can inhibit critical engagement with work and can potentially lead to long-term overreliance on the tool and diminished skill for independent problem-solving. 3. Higher confidence in GenAI’s ability to perform a task is related to less critical thinking effort. 4. When using GenAI tools, the effort invested in critical thinking shifts from information gathering to information verification; from problem-solving to AI response integration; and from task execution to task stewardship. 5. Knowledge workers face new challenges in critical thinking as they incorporate GenAI into their knowledge workflows. 6. To that end, our work suggests that GenAI tools need to be designed to support knowledge workers’ critical thinking by addressing their awareness, motivation, and ability barriers." - ➡️ Comments: - It would be interesting to see more studies like this, especially with larger samples and focusing on different occupations, demographics, and use patterns; - The paper focuses on Generative AI; it will be interesting to see a similar study focused on advanced AI agents, especially as their popularity grows. 👉 Download & read the full paper "The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers" by @hankhplee @AdvaitSarkar, Lev Tankelevitch, @iandrosos, @seanrintel, Richard Banks & Nicholas Wilson below. 👉 NEVER MISS my AI governance updates, including must-read research papers like this one: join 51,800+ people who subscribe to my weekly newsletter (below).
0
0
3
RT @shreyas: One assumption people implicitly make in today’s world is that everything is supposed to be meant for everyone. And if that is…
0
8
0
RT @shreyas: As AI capabilities continue to advance, most product people’s best defense over the next few years will be to go back to the b…
0
25
0
RT @drgurner: A very real, and very important question to ask yourself: How are you thinking about & planning for AI to continue to move i…
0
6
0
RT @petergyang: "You just skipped the PM part!" Here's a clip of Amjad (Replit CEO) showing me how his AI agent turns a 1-line request int…
0
54
0