Skip to content
arXiv Board & Classic Game AI· Conrad Flick·· 25 d agoPickAI score35

arXiv paper tests the stability of opening rankings with 17,400 Stockfish self-play games

Opening Rankings from Engine Self-Play Are Less Certain Than They Look: Sampling Error, Draws, and Strength Dependence in Strength-Limited Stockfish Games

AI summary

An arXiv study had strength-limited Stockfish 15.1 play 17,400 self-play games under three strength settings, comparing ten white first moves and ten black replies to 1.e4, and found that the leading openings change with the strength setting, with two of them separated by only a single game.

Why it matters

Drawing on 17,400 self-play games, the paper quantifies the uncertainty of opening leaderboard leaders when the number of games is small, which can inform evaluation design.

Source: arXiv Board & Classic Game AI · arxiv.org