How Maia-2 simulates human play across skill levels
Playing Dumb: How a Chess Transformer Simulates Users Across Skill Levels
The paper studies how the chess Transformer Maia-2 simulates players of different levels through skill conditioning, and, holding the chess position and model weights fixed, analyzes the positions where its prediction shifts from a blunder to the best move. The researchers trained probes to predict from Maia-2's internal states whether 172 chess concepts are present; probe accuracy was nearly unchanged across skill conditions, and a probe trained at one level transferred accurately to other levels.
The paper uses probes and last-layer fine-tuning to disentangle the effect of skill conditioning on Maia-2, offering a reference for player modeling that separates knowledge retention from behavioral expression.
Source: arXiv Board & Classic Game AI · arxiv.org