streaming-audio transcription voice-agents realtime ai-gateway

AI Gateway streaming transcription cuts latency live

Use `streamTranscribe()` to get transcript deltas in real-time as audio arrives, replacing batch-file workflows for live captioning and voice agents.

Summary

Developers building voice interfaces no longer wait for full audio upload before text arrives—critical for responsive live captioning and agent voice modes. Enables voice input to text-based agents without changing agent logic.

Why it matters

Implementation verdict

Replaces previous full-file batch transcription. Requires audio stream input and compatible model (OpenAI's gpt-realtime-whisper confirmed, cross-provider API via AI SDK). Beta status—ready to integrate now for production voice features, but expect API surface changes.

Sources

1.streaming transcription is in beta and available through the AI SDK's `streamTranscribe` function with any streaming-capable transcription model
2.Previously, transcription required a complete audio file and returned the full transcript in a single response
3.for await (const part of result.fullStream) { if (part.type === 'transcript-delta')
4.keeping latency low for uses like live captioning and voice input

Dev Signal

Get briefs like this in your inbox — free, every weekday.

100+ sources compressed into one 4-minute read. Ranked, cited, implementation-ready.

Read the full issue →All briefs