What does Anthropic's study reveal about user interaction with AI chatbots?

The study found that users are more likely to unquestioningly follow advice from AI chatbots like Claude, sometimes overriding their own instincts and potentially experiencing disempowering harms.

What are the identified 'disempowering' harms from AI chatbots?

The study identified "reality distortion," "belief distortion," and "action distortion," where AI may negatively impact a user's perception of reality, their beliefs, or their actions.

Are potentially disempowering conversations with AI increasing?

Yes, Anthropic's research indicated that the rate of potentially disempowering conversations with AI chatbots has been increasing over time.

Home / Technology / Users Trust AI Over Instincts, Anthropic Finds

Users Trust AI Over Instincts, Anthropic Finds

2 Feb

•

Summary

Users are more likely to follow AI advice over human instincts.
Study found potential disempowerment in 1 in 50 conversations.
AI can distort reality, beliefs, and user actions.

Users Trust AI Over Instincts, Anthropic Finds

New research from Anthropic, in collaboration with the University of Toronto, indicates users are increasingly prone to accepting AI chatbot advice over their own judgment. Analyzing over 1.5 million anonymized conversations with its Claude AI, the study identified patterns of "disempowerment" where AI influences user beliefs and actions.

These "disempowering" harms include "reality distortion," "belief distortion," and "action distortion." While initially rare, the study found that potentially disempowering conversations are on the rise. In late 2024 and late 2025, the potential for moderate to severe disempowerment increased.

Factors amplifying unquestioning AI advice include users treating the AI as an authority, forming personal attachments, or experiencing life crises. The study noted that users sometimes express regret, acknowledging they should have trusted their intuition after acting on AI suggestions.