DirCast: live esports directing and commentary with a single streaming video-language model
DirCast: Live Esports Directing and Commentary with a Single Streaming Video-Language Model
DirCast is a single streaming video-language model that decides when to switch camera shots and provides live commentary for esports broadcasts at the same time. On a dataset of 27 professional Dota 2 matches, it outperforms rule-based and zero-shot directing methods, including GPT-5. Its win rate against GPT-4o in commentary is 29.2%, higher than the 19.4% of the strongest of eleven streaming commentary baselines that watch human-directed broadcasts.
The paper puts camera cutting and live commentary into a single streaming video-language model, and benchmarks it against human-directed broadcasts, offering a reference for automating esports broadcasts.
Source: arXiv Board & Classic Game AI · arxiv.org