Research Shows Humans Expect Rationality and Cooperation from AI in Strategic Games
A new study explores how humans behave when playing strategic games against **Large Language Models (LLMs)**. The research indicates that people tend to adjust their strategies, often expecting rationality and even cooperation from their AI opponents, particularly in scenarios with monetary incentives.
Interesting research has emerged titled "Humans expect rationality and cooperation from LLM opponents in strategic games," available as a pre-print on arXiv.
[https://arxiv.org/pdf/2505.11011](https://arxiv.org/pdf/2505.11011)
### Key Findings
The abstract highlights a fascinating dynamic:
> As Large Language Models (LLMs) integrate into our social and economic interactions, we need to deepen our understanding of how humans respond to LLMs opponents in strategic settings. We present the results of the first controlled monetarily-incentivised laboratory experiment looking at differences in human behaviour in a multi-player p-beauty contest against other humans and LLMs. We use a within-subject design in order to compare behaviour at the individual level. We show that, in this environment, human subjects choose significantly lower numbers when playing against LLMs than humans, which is mainly driven by the increased prevalence of βzeroβ Nash-equilibrium choices. This shift is mainly driven by subjects with high strategic reasoning ability. Subjects who play the zero Nash-equilibrium choice motivate their strategy by appealing to perceived LLMβs reasoning ability and, unexpectedly, propensity towards cooperation. Our findings provide foundational insights into the multi-player human-LLM interaction in simultaneous choice games, uncover heterogeneities in both subjectsβ behaviour and beliefs about LLMβs play when playing against them, and suggest important implications for mechanism design in mixed human-LLM systems.
This suggests that individuals with strong strategic reasoning skills are more likely to anticipate logical play from AIs, even to the point of expecting cooperative behavior. This expectation influences their decision-making within the game environment.
Tags: academic papers, **AI**, games, **LLM**, trust