arXiv Game AI· Bizhe Bai·· 4 d agoPickAI score60
3D GameDev Arena released: benchmarking coding agents with 108 from-scratch 3D browser game tasks
3D GameDev Arena: Benchmarking Coding Agents That Plan, Build, and Playtest extreme Long-Horizon Browser Games
AI summary
The authors propose 3D GameDev Arena, a long-horizon benchmark for building 3D browser games from scratch, covering 108 tasks across 14 genres. Given only text specifications and UI/UX reference images, agents build self-contained games through an automated plan, implement, test, and fix pipeline, averaging about 1,000 LLM calls per run, with the longest run using 14,407 calls, 2.13B tokens, and 608 assets.
Why it matters
The benchmark uses 108 from-scratch 3D browser game tasks to chain long-horizon planning, implementation, and playtesting into a single evaluation pipeline for coding agents.
Source: arXiv Game AI · arxiv.org