CtrlCache: Training-Free Control-Aware Caching Accelerates Interactive Video World Models
CtrlCache: Accelerating Interactive Video World Models with Control-Aware Caching
The authors propose CtrlCache, a training-free control-aware caching framework for accelerating chunk-by-chunk autoregressive generation in interactive video world models. It exploits the fact that control signals arrive before denoising, labeling each video chunk as initial, transition, turning, or steady-state; full computation is retained only for initial and transition chunks, while turning and steady-state chunks reuse the transformer residuals from the most recent full computation step within the same chunk, and a frequency-mixed historical prior reuses the low-frequency structure of the previous clean latent.
The paper uses control signals ahead of time for cache reuse decisions, achieving 1.21x to 1.41x inference speedup on three world models without training.
Source: arXiv Game World Models & Generation · arxiv.org