AgentGarten: Code worlds for evolving agents
AgentGarten: Code Worlds for Evolving Agents
AgentGarten combines simulators, game engines, and a shared neural renderer to build real-time interactive environments, in which agents perceive the world through visual observations and interact with it. The paper proposes Adversarial Forcing, which distills a pretrained video model into a geometry-conditioned neural renderer and lets the encoding of historical observations also be updated by losses from subsequent predictions. The experiments report that agents learn from only 4 rounds of experience, whereas the traditional reinforcement learning baseline requires training on the order of millions of steps.
The paper writes worlds as code and hands them to a shared neural renderer to generate the visuals. Comparing its learning efficiency with traditional reinforcement learning can help you judge whether this approach to expanding environments suits your project.
Source: arXiv Game AI · arxiv.org