Skip to content

Fields

Voice & music latest news

Voice and music AI in games: character voices and real-time TTS, lip sync, dynamic music and sound effects.

47 picks23 in the last 30 days72 collected in all

Updated

Picks archive · Page 3

Sep 30Wed41–47
  1. Inworld AI Blog51

    Inworld acquires realtime voice agent platform Ultravox

    Inworld has announced the acquisition of Ultravox, a realtime voice agent platform; the Ultravox team has joined Inworld and continues to develop the platform. The first update after the acquisition is that the built-in Inworld voice in Ultravox now uses Realtime TTS-2, existing voice IDs remain usable with no code changes, and the upgrade costs nothing extra.

    Why it matters: The acquisition brings voice understanding, reasoning and voice generation into one realtime inference infrastructure, letting readers judge how the voice agent stack is consolidating.

Sep 23Wed
  1. NVIDIA GameDev39

    NVIDIA announces this month's updates for RTX game developers, including DLSS 5, ACE upgrades and RTX Kit 2026.3

    NVIDIA announced this month's updates for RTX game developers, including DLSS 5 with 3D-Guided Neural Rendering controls, speech pipeline extensions and inference framework updates for NVIDIA ACE, and RTX Kit 2026.3, which includes RTX Mega Geometry 2.0. The official tweet links to the developer blog post for this update; capabilities and integration details are in the original on developer.nvidia.com.

    Why it matters: The official post lines up DLSS 5, NVIDIA ACE and RTX Kit updates side by side, so developers can compare integration priorities and upgrade order for their own projects.

Aug 31Mon
  1. Inworld AI Blog57

    Inworld AI releases Realtime TTS-2 realtime conversational voice model

    Inworld AI has released Realtime TTS-2, a new-generation realtime conversational voice model, now fully available in the Inworld API and the Inworld Realtime API.

    Why it matters: The original post covers multi-turn audio context, natural-language voice instructions and a first-audio latency of under 200ms, which readers can use to judge whether realtime voice conversation fits their own projects.

Aug 28Fri
  1. Inworld AI Blog56

    Inworld AI open-sources the TTS Open Evaluation Toolkit

    Inworld AI has open-sourced the TTS Open Evaluation Toolkit, a customizable TTS evaluation framework for sampling TTS systems, evaluating audio offline and generating comparable reports.

    Why it matters: The post explains why the same TTS model can produce different WER in different teams' hands, and covers how to run this evaluation tool and its first set of metrics.

Jun 15Mon
  1. Inworld AI Blog38

    Building conversational voice agents with Mastra and Inworld speech-to-speech

    Inworld Realtime API links STT, LLM, and TTS into a single WebSocket session, and the new Mastra package @mastra/voice-inworld-realtime can bind that session as an agent's voice.

    Why it matters: The article shows how to bring STT, LLM, and TTS into a single WebSocket session, and its approach to handling interruptions and tool calls can be compared with your own voice agent setup.

Jun 10Wed
  1. Inworld AI Blog40

    Inworld cuts prices across its voice and LLM stack, by more than half for most developers

    Inworld announced price cuts across its entire voice stack, with most developers seeing reductions of more than half at each layer of text-to-speech, speech recognition, LLMs and compute. The new prices are already in effect for all developers. Realtime TTS-2 drops to about $10/1M characters, speech recognition to about $0.10/hour, and Router can connect to 100+ models with no markup on third-party models.

    Why it matters: Inworld has lowered prices at every layer of its voice stack and published tiered per-unit rates for TTS, speech recognition and LLMs, which can be used to estimate inference costs for consumer-grade applications.

May 14Thu
  1. Inworld AI Blog49

    Inworld pairs Realtime TTS-2 with Stream Vision Agents for a realtime voice agent that can see and listen

    Inworld teamed up with Stream to build a reference implementation, Crashout Buddy, combining the latest speech model Realtime TTS-2 with Stream's open-source Vision Agents framework, so it can see facial expressions, hear speech and adjust its delivery in real time.

    Why it matters: The post shows how to turn visual signals and emotional context into speech delivery instructions, which readers can use to judge whether this realtime voice pipeline can be plugged into their own projects.