PAWA: Panoramic action-conditioned world modeling for multiple agents
PAWA: Panoramic Action-conditioned World Modeling for Multiple Agents
PAWA presents a synchronized POV and panoramic video dataset and framework for action-conditioned multi-agent world modeling in multiplayer Minecraft scenarios. The model uses a two-tower structure to jointly predict two video streams, and cross-attention aligns tokens facing the same direction in a shared world coordinate system. The paper reports that its POV prediction quality outperforms existing multiplayer world models while also generating high-fidelity panoramic predictions. The dataset and collection pipeline are open-sourced.
The paper fills a gap with synchronized POV and panoramic video data for multiplayer settings, making it a useful reference for readers focused on building datasets for multiplayer world models.
Source: arXiv Game AI · arxiv.org