Skip to content
arXiv Game AI· Yijun Zhou·· 27 d agoPickAI score48

UnityBench-Mini3D: Evaluating LLM agents for Unity 3D game development

UnityBench-Mini3D: Evaluating LLM Agents for 3D Game Development in Unity

AI summary

Researchers propose UnityBench-Mini3D, which uses 77 project-level Unity tasks to evaluate the 3D game development capabilities of LLM coding agents. Each task comes with 1,178 hand-written milestone tests that award partial credit and pinpoint where failures occur. Across tests of 21 models and 9 coding frameworks, the average pass rate was 80.9% on easy tasks, dropping to 35.2% on hard tasks, with an overall rate of 57.7%.

Why it matters

Existing game development benchmarks mostly target Godot and rely on LLM judges. This work instead evaluates Unity tasks with deterministic in-engine milestone tests, offering a methodological counterpoint.

Source: arXiv Game AI · arxiv.org