OverSeer: Multi-agent world models beyond what agents see
OverSeer: Multi-Agent World Models Beyond What Agents See
OverSeer is a multi-agent world model that adds fixed-position auxiliary camera views beyond each agent's first-person view, improving temporal and cross-agent consistency in multi-agent video generation. It uses a delta-VAE that encodes only changes relative to a near-static reference image, reducing the number of tokens needed to process the auxiliary views. Experiments in Minecraft and Doom show improved world and agent consistency, and qualitative results on real-world multi-camera capture indicate the method does not depend on a game engine.
Multi-agent video world models struggle to stay consistent across viewpoints; this work uses a fixed auxiliary viewpoint as a proxy for world state, which is a useful reference for multi-view generation.
Source: arXiv Game AI · arxiv.org