Skip to content

Fields

World models latest news

Interactive generative environments and world models: playable worlds generated in real time, physics and consistency, and what they mean for game engines.

92 picks47 in the last 30 days123 collected in all

Updated

Picks archive · Page 2

Nov 7Sat21–40
  1. QbitAI49

    Moxin Technology releases general 4D world model MoWorld 2.0, with 70 FPS inference on Ascend NPUs

    On November 4, Moxin Technology released its next-generation general-purpose 4D world model MoWorld 2.0 at the World Internet Conference in Wuzhen, folding more than ten physical elements — including gravity, elasticity, buoyancy, lighting, soft bodies, fluids, rigid bodies and thermodynamics — into a single model.

    Why it matters: The original article lays out a unified modeling approach for more than ten physical elements, plus 70 FPS inference on Ascend NPUs and a 30% cost comparison against GPU setups, which readers can use to gauge the conditions for putting physics simulation into practice.

Nov 6Fri
  1. Grok Bot Research44

    Frontier3DBench benchmarks coding agents on 3D objects, scenes, and interactive open-world building with 145 tasks

    Xinjie Lin and colleagues propose Frontier3DBench, which uses 145 tasks across 9 categories to cover object, scene, and interactive open-world creation and evaluates appearance, structure, and behavior together. Among 11 model and harness configurations, GPT-6.1-sol leads at the object and scene levels with an overall score of 66.02/100, while GPT-6-astra leads on interactive world building; every configuration scores lower on reference reconstruction than on text-driven generation.

    Why it matters: Stratified scores across 11 configurations identify reference reconstruction and coordinated-activity completion as the main bottlenecks for coding agents working in 3D, giving a reference point for model selection and method comparison.

  2. arXiv Game AI71

    PlayGen2: Learning real-time playable worlds with explicit 3D state

    The authors propose PlayGen2, a real-time interactive world model that separates learned 3D state evolution from neural rendering, using a volumetric occupancy grid and an identity-indexed 3D state to maintain persistent world memory. Tested on Doom, the model learned world dynamics including geometry-aware player movement and player-NPC interaction, and the full simulation and rendering pipeline runs at about 160ms backend latency on a MacBook Pro with an M4 Pro chip.

    Why it matters: The paper splits a playable world into explicit 3D state evolution and neural rendering, and reports measured latency and zero-shot transfer results, making it easier to judge whether such world models can support real-time interaction.

  3. Grok Bot Research60

    LiveFoley: a real-time video-to-audio model for interactive worlds with 156 ms end-to-end latency on a single A800

    Monash University, Nanjing University, Shengshu Technology and other institutions proposed LiveFoley, a streaming video-to-audio (V2A) model that generates sound effects from real-time video streams, with an end-to-end latency of 156 ms on a single A800 GPU.

    Why it matters: The paper reports 156 ms end-to-end latency on a single A800 and alignment metrics, which can help assess whether streaming sound effects can be integrated into game engine rendering.

Nov 3Tue
  1. arXiv Game World Models & Generation34

    Isekai3D SDG proposes a synthetic gameplay visual data platform built on an Unreal Engine plugin

    A research team proposes Isekai3D SDG, a platform built on reusable environment and character assets and an Unreal Engine plugin for simulating and collecting synthetic 3D gameplay visuals, aimed at research on vision and world models, neural graphics, and game agents.

    Why it matters: The two-stage pipeline separates game simulation from visual capture, so the same stretch of gameplay can repeatedly produce multiple outputs, making it easier to judge the integration cost of the data pipeline.

Oct 31Sat
  1. Hyper3D Rodin56

    Hyper3D Rodin launches Agentic Mode for WorldGen

    Hyper3D by Deemos announced that WorldGen's Agentic Mode is live, generating a complete 3D scene mesh from a single image, including lighting, materials and individual object meshes, all editable. The author says every asset can be exported directly to DCC tools such as Blender with lighting preserved, for uses including game development, design and robotic Sim2Real. Try it at https://hyper3d.ai/workspace/rodin?feature=worldgen.

    Why it matters: The original post says WorldGen's Agentic Mode can turn a single image into a complete, editable 3D scene and export it to DCC tools such as Blender.

Oct 30Fri
  1. arXiv Game World Models & Generation58

    Wizard: Manipulate any world in real time via agentic control

    The paper proposes Wizard, an agentic game world model that can precisely control character actions in real time and achieve zero-shot generalization to new scenes, characters, and actions. The authors built a dataset covering 750 scenes and 178 characters, using skeleton and geometry information as structured representations to condition a video generation model, and introduced an adaptive masking mechanism to improve the consistency between the conditioning signal and the generated video. A companion agent framework explicitly maintains and updates game state, letting players freely configure virtual worlds and control character actions at fine granularity.

    Why it matters: The paper presents a dataset of 750 scenes and 178 characters and a structured agentic conditioning scheme, offering a look at an implementation path for real-time controllable world models.

  2. arXiv Game World Models & Generation58

    Algebraic World Model: Turning game environment interactions into Lean 4-provable mathematical models

    Researchers propose the Algebraic World Model (AWM), which turns interactions with unfamiliar environments into executable Python hypotheses, then organizes them into typed objects and shared rules, simplifies the structure with category-theory-guided transformations, and finally formalizes it in Lean 4 to prove reachability and impossibility.

    Why it matters: The paper presents a pipeline that turns interactions with unfamiliar game environments into Lean 4-checkable mathematical models, letting readers understand how formal proofs can be used to determine level unreachability.

  3. arXiv Game AI58

    Fight World Model: Customizable combat through visual interaction proxies

    The authors propose Fight World Model (FWM), which separates rule-constrained combat execution from video rendering: an executable engine maintains state and resolves interactions, and a deterministic compiler then encodes the results into spatiotemporally aligned interaction proxies.

    Why it matters: The paper separates rule execution from video rendering, letting readers understand how a programmable combat world model keeps hit and health states consistent.

  4. arXiv Game AI53

    Fight World Model: customizable combat through visual interaction proxies

    The researchers propose Fight World Model (FWM), separating rule-driven combat execution from video rendering, with an executable engine maintaining state and resolving interactions. A deterministic compiler encodes resolution results and attempted actions into spatiotemporally aligned interaction proxies, aligning actions with skill windows, brief hit reactions, and continuous health by character identity and time; the model is trained on the FightWorld Corpus, which covers 52 skill effects, 187 character appearance variants, and 15 arenas.

    Why it matters: The paper separates combat rule execution from video rendering and passes state through interaction proxies, showing an approach that applies new rules such as damage scaling and lifesteal without modifying the renderer.

  5. Tencent Hunyuan58

    Tencent Hunyuan releases Hy-Nomas technical report and evaluation set

    Tencent Hunyuan has released a technical report for Hy-Nomas, an open-source interactive video world model, and open-sourced its evaluation set, Hy-Nomas-Bench. The authors also used Hy-Nomas to reproduce examples from Genie 4 and attached comparison videos. The cited release notes say the model supports free interaction between text prompts and camera trajectories, and offers long-horizon generation with world memory.

    Why it matters: The authors open-sourced the evaluation set and reproduced Genie 4's examples, so readers can compare the public videos and judge the interactivity and long-horizon generation quality for themselves.

  6. arXiv Game World Models & Generation60

    Algebraic world model AWM proposes a framework from environment exploration to Lean 4 formal proofs

    The research team proposes the Algebraic World Model (AWM), which turns interaction with an unknown environment into a mathematical model that can be formally reasoned about in Lean 4. On two unsolvable game levels, six AWM runs all produced kernel-verified, closed Lean proofs ruling out every valid winning sequence, whereas Claude Opus 5.5 and GPT-6 Astra, equipped with programming tools, failed to produce a proof in twelve baseline runs.

    Why it matters: Reaching a kernel-verified unreachability conclusion on levels that cannot be completed shows how formal reasoning can be applied to modeling game environments.

  7. arXiv Game World Models & Generation58

    AWM: an algebraic world model that turns unfamiliar game environments into Lean-provable mathematical models

    Researchers propose the Algebraic World Model (AWM), which turns interactions with unfamiliar environments into explicit mathematical models that support formal reasoning, and proves reachability and unreachability in Lean 4.

    Why it matters: The paper presents a pipeline for turning unfamiliar game environments into checkable mathematical models and uses Lean to prove levels unreachable, helping readers understand how formal reasoning can enter game agents.

  8. arXiv Game World Models & Generation58

    Wizard: Manipulate any world in real time via agentic control

    The paper proposes Wizard, an agentic game world model that can precisely control character actions in real time and achieves zero-shot generalization to new scenes, characters, and actions. The researchers built a dataset covering 805 scenes and 178 characters, using skeleton and geometry information as structured proxies to condition video generation, and supporting character-aware adaptive masking and world-anchored spatial conditions through explicit tracking and updating of game state.

    Why it matters: The paper provides a dataset of 805 scenes and 178 characters along with the WBench evaluation, offering a concrete reference for comparing existing world models on real-time controllable generation.

Oct 28Wed
  1. arXiv Game World Models & Generation37

    GameVerse: a minute-scale gameplay dataset for long-horizon interactive world modeling

    GameVerse is a minute-scale gameplay video dataset for long-horizon interactive world modeling, aimed at easing the problem of overly short clips in existing data. It contains 69.7K clips, 1655 hours and 349.6 million frames, of which 1358 hours are continuous two-minute sequences. Each clip comes with a camera trajectory that stays coherent across minutes, and captions aligned to event boundaries that distinguish static scenes from dynamic foreground events. Experiments show that training on it extends the temporal span of interactive world models.

    Why it matters: Addresses the data bottleneck of short game video clips and rough subtitles by offering a minute-scale dataset and an event-level annotation approach, which can be compared with how long-horizon world models build their data.

  2. arXiv Game World Models & Generation39

    BoxWorld: Let World Engines Control and Video Generators Render

    BoxWorld hands user-defined interaction rules to the Box World Engine, then has the Box-State generative renderer autoregressively render a real-time interactive video world from the object states. The paper says it clearly outperforms end-to-end world models on evaluations including PairedStateBench and remains competitive on several public benchmarks. Training has three stages: learning object localization and state transitions from automatically annotated open-domain and game videos, then rollout distillation on self-generated histories.

    Why it matters: Separating interaction reasoning from generative rendering, and comparing it with end-to-end video world models, offers one way to divide the work in controllable game worlds.

  3. Google DeepMind53

    DeepMind unveils next-generation world simulation model Genie 4

    Google DeepMind has unveiled Genie 4, a next-generation world model that generates interactive simulated worlds in real time, with native audio and conversational interaction. Users can change the weather or camera angle, or add characters and objects, using natural language, and Gemini adjusts prompts to keep the scene coherent. It is currently available as a research preview to trusted testers. Google AI Ultra subscribers and early Gemini API partners will gain access in the coming weeks, though visual detail and object persistence may still drift over time.

    Why it matters: It puts native audio, real-time steering, and Gemini reasoning into a single world simulation, offering a look at viable paths for interactive world models.

Oct 27Tue
  1. arXiv Game World Models & Generation37

    GameVerse releases minute-scale gameplay video dataset for long-horizon interactive world modeling

    Researchers released GameVerse, a minute-scale gameplay video dataset for long-horizon interactive world modeling, containing 69.7K videos, 1,655 hours and 349.6 million frames, covering first-person and third-person gameplay. Of this, 1,358 hours are continuous two-minute sequences, an order of magnitude longer than previous datasets; each video comes with a camera trajectory that stays consistent across minutes, plus annotations aligned to event boundaries that distinguish static scenes from dynamic foreground events. The paper states that training on this dataset can significantly extend the time horizon of interactive world models.

    Why it matters: The dataset extends usable sequences to the two-minute range and compares it with existing public datasets on scale and annotation, making it easier to judge the training-data gap for long-horizon world models.

  2. arXiv Game World Models & Generation54

    GameVerse releases minute-scale gameplay video dataset for long-horizon interactive world modeling

    Researchers released GameVerse, a minute-scale gameplay video dataset for long-horizon interactive world modeling, containing 69.7K videos, 1,655 hours and 349.6 million frames, covering first-person and third-person gameplay. Of this, 1,358 hours are continuous two-minute sequences, an order of magnitude longer than previous datasets; each video comes with a camera trajectory that stays consistent across minutes, plus annotations aligned to event boundaries that distinguish static scenes from dynamic foreground events. The paper states that training on this dataset can significantly extend the time horizon of interactive world models.

    Why it matters: The dataset extends usable sequences to the two-minute range and compares it with existing public datasets on scale and annotation, making it easier to judge the training-data gap for long-horizon world models.

  3. arXiv Game World Models & Generation37

    GameVerse releases minute-scale gameplay dataset for long-horizon interactive world modeling

    GameVerse is a minute-scale gameplay video dataset for long-horizon interactive world modeling, containing 69.7K clips, 1,655 hours, and 349.6 million frames, of which 1,358 hours are continuous two-minute sequences, an order of magnitude longer than previous datasets.

    Why it matters: The original text provides the dataset scale, annotation pipeline, and training experiments, letting readers assess the data bottleneck and feasible approaches for long-horizon world models.