Skip to content
arXiv Game AI· Jihai Zhang·· 2026-10-20PickAI score69

Matrix-Game 4.0 harnesses video models to build real-time playable game worlds

Matrix-Game 4.0: Harnessing Video Models for Real-Time Playable Game Worlds

AI summary

Matrix-Game 4.0 separates game execution from visual generation. A lightweight game engine maintains the world state and executes interaction rules, while an autoregressive video model turns low-polygon rendered frames into detailed images. The paper reports real-time 480p gameplay at 60 FPS on a single NVIDIA RTX5090, with a key-press-to-display latency of 112 ms. Single-step generation sustains 83 FPS throughput, with peak GPU memory usage of 18.2 GiB.

Why it matters

This work hands world state and interaction rules to an executable engine and leaves image generation to a video model, offering a useful reference for the engineering split in playable world models.

Source: arXiv Game AI · arxiv.org