Matrix-Game 4.0 harnesses video models to build real-time playable game worlds
Matrix-Game 4.0 separates game execution from visual generation. A lightweight game engine maintains the world state and executes interaction rules, while an autoregressive video model turns low-polygon rendered frames into detailed images. The paper reports real-time 480p gameplay at 60 FPS on a single NVIDIA RTX5090, with a key-press-to-display latency of 112 ms. Single-step generation sustains 83 FPS throughput, with peak GPU memory usage of 18.2 GiB.
Why it matters: This work hands world state and interaction rules to an executable engine and leaves image generation to a video model, offering a useful reference for the engineering split in playable world models.