Skip to content
Inworld AI· inworld·· 2026-10-15AI score14

Inworld rebuilds model inference, with major performance gains

We rebuilt how each model is served:

AI summary

We rebuilt how each model is served: - Speculative decoding, with draft models tuned for each model - Custom attention kernels: verification up to 7.5x faster (Gemma 4 26B) - Fused MoE kernels: 3x faster time to first token (MiMo 2.6 Pro) - Tail-latency optimization: p99 time to first token about 10x faster (DS V4 Flash)

Source: Inworld AI · x.com