Skip to content
arXiv Board & Classic Game AI· Will Beaumaster·· 2026-10-14PickAI score40

Why accuracy fails to certify theory of mind in multi-agent teams

Smart Alone, Blind Together: Why Accuracy Fails to CertifyTheory of Mind in Multi-Agent Teams

AI summary

The paper argues that modules in multi-agent cooperation that infer actions from teammates should not be certified on accuracy alone, because the cost of errors and the correlation between errors change the acceptable accuracy threshold. The authors tested this in task allocation, Level-Based Foraging and Hanabi, finding that accuracy fails in both directions. In Hanabi, where errors compound, it approved a harmful LLM deployment.

Why it matters

The paper shifts the certification standard for theory-of-mind modules from predictive accuracy to deployment cost and error dependence, offering a direct reference for evaluating whether collaborative AI can be released.

Source: arXiv Board & Classic Game AI · arxiv.org