Inworld AI· inworld·· 2026-10-15AI score14
Inworld rebuilds model inference, with major performance gains
We rebuilt how each model is served:
AI summary
We rebuilt how each model is served: - Speculative decoding, with draft models tuned for each model - Custom attention kernels: verification up to 7.5x faster (Gemma 4 26B) - Fused MoE kernels: 3x faster time to first token (MiMo 2.6 Pro) - Tail-latency optimization: p99 time to first token about 10x faster (DS V4 Flash)
Source: Inworld AI · x.com