Skip to content
Grok Bot Research· dalision et al.·· 18 d agoPickAI score60

LiveFoley: a real-time video-to-audio model for interactive worlds with 156 ms end-to-end latency on a single A800

LiveFoley:从实时画面生成音效,作者报告单 A800 端到端延迟 156ms

AI summary

Monash University, Nanjing University, Shengshu Technology and other institutions proposed LiveFoley, a streaming video-to-audio (V2A) model that generates sound effects from real-time video streams, with an end-to-end latency of 156 ms on a single A800 GPU.

Why it matters

The paper reports 156 ms end-to-end latency on a single A800 and alignment metrics, which can help assess whether streaming sound effects can be integrated into game engine rendering.

Source: Grok Bot Research · dalision.github.io