PapersSelected73°

Mentalization in Humans and Language Models

Assessing mentalization in humans and large language models

Why we picked it

The study reveals significant differences in mentalization capabilities across major LLM providers, with GPT-5 outperforming humans in adaptive reasoning tasks.

Researchers tested 2,099 LLM agents from DeepSeek, GPT-4.1, GPT-5 and Gemini 2.0 Flash across two economic games. The study used cognitive computational modeling to analyze mentalization strategies in these models compared to 251 human participants. GPT-5 agents demonstrated superior adaptive reasoning capabilities, flexibly adjusting their recursive depth against sophisticated opponents.

Original · arXiv: DeepSeek

Assessing mentalization in humans and large language models

Mentalization - the ability to infer others' beliefs and intentions to guide one's own choices - is a key cognitive function underlying human social interactions. Large language models (LLMs) demonstrate behaviour consistent with humans on theory-of-mind tasks, yet whether these models can guide adaptive behaviour through mentalization is unknown. Here we use two economic games with cognitive computational modeling to uncover the latent strategies underlying mentalization in LLMs. We tested individual LLM agents across four model families, DeepSeek, GPT-4.1, GPT-5 and Gemini 2.0 Flash (N = 2,099), against opponents of varying sophistication and examined whether a prompting strategy designed to elicit strategic reasoning improved performance. We benchmarked results against human participants (N = 251) as a comparative measure. Across both games, LLMs showed clear behavioural and computational signatures of mentalizing that differed markedly by model provider and size. Strategic prompting generally improved performance by inducing more sophisticated reasoning, yet the extent of the benefit differed across the two tasks. Last, GPT-5 agents flexibly adapted their recursive depth of reasoning to increasingly sophisticated opponents, demonstrating superior performance to human participants. Collectively, we demonstrate different capacities for mentalization across LLMs, and highlight cognitive computational modeling as a formal method for assessing comparative intelligence across humans and machines.