voice-ai realtime-api speech-to-speech grok ai-gateway

Grok Voice Think Fast 2.0 available on AI Gateway

Speech-to-speech model with parallel reasoning reduces latency by thinking while speaking; tool calls fire before agent finishes first sentence.

Summary

Eliminates reasoning latency in voice agents and handles real-world audio conditions (background noise, telephony compression) without transcription degradation. Fewer reasoning tokens means faster tool invocation in production voice flows.

Why it matters

Implementation verdict

Replaces previous Grok Voice for real-time voice applications. Requires short-lived token server (provided pattern) and AI SDK's realtime API integration. Ready now—deploy via `xai/grok-voice-think-fast-2.0` model identifier through Vercel AI Gateway.

Sources

1.The model reasons in parallel with speech, so it can think through a query while talking without adding latency.
2.tool calls fire sooner, often before the end of the agent's first sentence
3.Transcription holds up in real-world conditions, including background noise and telephony compression

Dev Signal

Get briefs like this in your inbox — free, every weekday.

100+ sources compressed into one 4-minute read. Ranked, cited, implementation-ready.

Read the full issue →All briefs