arXiv Board & Classic Game AI· Phurinat Polasa·· 2026-10-19PickAI score34
Researchers propose SPOKE, training poker agents with strategic preference optimization to reach the lowest average exploitability on Kuhn and Leduc
Teaching AI Agent to Play Poker Strategically Through Preference Optimization
AI summary
The researchers propose SPOKE (Strategic Preference Optimization with KL-anchored Equilibrium). Across three runs of the SmallThinker-4B-A0.6B policy, it achieved the lowest average exploitability of 0.213 on Kuhn and 1.081 on Leduc, with a six-player table top-1 agreement rate of 0.775.
Why it matters
The paper compares SPOKE against SFT, DPO, GRPO and GSPO and reports average exploitability figures on Kuhn and Leduc, letting readers judge how the method differs from other policy optimization approaches.
Source: arXiv Board & Classic Game AI · arxiv.org