MIT’s first brain scan study of ChatGPT users revealed shocking results.
This study explores the neural and behavioral consequences of LLM-assisted essay writing. Participants were divided into three groups: LLM, Search Engine, and Brain-only (no tools). Each completed three sessions under the same conditions. In a fourth session, LLM users were reassigned to the Brain-only group (LLM-to-Brain), and Brain-only users were reassigned to LLM condition (Brain-to-LLM). A total of 54 participants took part in Sessions 1-3, with 18 completing Session 4. We used electroencephalography (EEG) to assess cognitive load during essay writing.
We analyzed essays using NLP, as well as scoring essays with the help from human teachers and an AI judge. Across groups, NERs, n-gram patterns, and topic ontology showed within-group homogeneity. EEG revealed significant differences in brain connectivity:
Brain-only participants exhibited the strongest, most distributed networks; Search Engine users showed moderate engagement; and LLM users displayed the weakest connectivity. Cognitive activity scaled down in relation to external tool use. In session 4, LLM-to-Brain participants showed reduced alpha and beta connectivity, indicating under-engagement. Brain-to-LLM users exhibited higher memory recall and activation of occipito-parietal and prefrontal areas, similar to Search Engine users. Self-reported ownership of essays was the lowest in the LLM group and the highest in the Brain-only group.
LLM users also struggled to accurately quote their own work. While LLMs offer immediate convenience, our findings highlight potential cognitive costs. Over four months, LLM users consistently underperformed at neural, linguistic, and behavioral levels. These results raise concerns about the long-term educational implications of LLM reliance and underscore the need for deeper inquiry into AI’s role in learning.
Key Findings
- Reduced Brain Engagement: Participants using ChatGPT exhibited the lowest levels of brain engagement compared to the other groups. The study found a significant drop in brain connectivity scores among ChatGPT users, indicating reduced cognitive activity.
- Cognitive Offloading: The study highlighted a phenomenon known as “cognitive offloading,” where users begin to rely on AI tools not just for tasks but also for their thought processes. This reliance can lead to diminished analytical thinking and memory retention.
- Memory Recall Issues: A staggering 83.3% of ChatGPT users struggled to recall even one sentence they had written shortly before, while participants in the control group had no such difficulties.
- Perception of Work: ChatGPT users reported feeling less ownership over their essays, which were often described as “robotic” and lacking originality by evaluators.
3 Sources
Implications
The findings raise concerns about the long-term educational implications of using AI tools like ChatGPT, particularly for younger users. While these tools can enhance productivity, the study suggests that over-reliance may hinder cognitive development and critical thinking skills. The researchers emphasize the need for balanced and mindful use of AI to mitigate potential cognitive costs.
This study serves as a cautionary tale about the impact of AI on learning and cognitive function, urging users to remain aware of how these tools may reshape their thinking processes over time.
- Your Brain on ChatGPT: Accumulation of Cognitive Debt when Using an AI Assistant for Essay Writing Task — MIT Media Lab
- https://www.media.mit.edu/publications/your-brain-on-chatgpt/
