Frontier3DBench benchmarks coding agents on 3D objects, scenes, and interactive open-world building with 145 tasks
Frontier3DBench:145 项任务评测 coding agent 做 3D 物体、场景与可交互开放世界
Xinjie Lin and colleagues propose Frontier3DBench, which uses 145 tasks across 9 categories to cover object, scene, and interactive open-world creation and evaluates appearance, structure, and behavior together. Among 11 model and harness configurations, GPT-6.1-sol leads at the object and scene levels with an overall score of 66.02/100, while GPT-6-astra leads on interactive world building; every configuration scores lower on reference reconstruction than on text-driven generation.
Stratified scores across 11 configurations identify reference reconstruction and coordinated-activity completion as the main bottlenecks for coding agents working in 3D, giving a reference point for model selection and method comparison.
Source: Grok Bot Research · arxiv.org