Grok Bot Research· dalision et al.·· 18 d agoPickAI score60
LiveFoley: a real-time video-to-audio model for interactive worlds with 156 ms end-to-end latency on a single A800
LiveFoley:从实时画面生成音效,作者报告单 A800 端到端延迟 156ms
AI summary
Monash University, Nanjing University, Shengshu Technology and other institutions proposed LiveFoley, a streaming video-to-audio (V2A) model that generates sound effects from real-time video streams, with an end-to-end latency of 156 ms on a single A800 GPU.
Why it matters
The paper reports 156 ms end-to-end latency on a single A800 and alignment metrics, which can help assess whether streaming sound effects can be integrated into game engine rendering.
Source: Grok Bot Research · dalision.github.io