llm-inference moe-models vercel-ai-gateway agents function-calling

Ling 3.0 Tiny launches free on Vercel AI Gateway

1.3B active parameters, 256K context, native function calling — swap model string to `inclusionai/ling-3.0-tiny-free` in AI SDK for responsive agents.

Summary

Replaces Ling 3.0 Flash in the free tier with a smaller MoE model tuned for multi-turn conversation and function calling. Cuts latency for agent loops while preserving 256K context and 32K output tokens.

Why it matters

Implementation verdict

Ready now. Drop-in replacement via model parameter change in AI SDK. Free through 8/14, then paid. Requires no code restructuring if already on AI Gateway. Worth testing for cost-sensitive agent workloads, but benchmark performance against Flash on your use case first.

Sources

1.Ling 3.0 Tiny is a MOE model with 7.9B total parameters and about 1.3B active per token
2.a 256K token context window, and up to 32K output tokens
3.The model is built for responsive agents, instruction following, and multi-turn conversation, with native function calling and prompt caching
4.set `model` to `inclusionai/ling-3.0-tiny-free`
5.free to use till 8:00am PT on 8/14

Dev Signal

Get briefs like this in your inbox — free, every weekday.

100+ sources compressed into one 4-minute read. Ranked, cited, implementation-ready.

Read the full issue →All briefs