Route LLM inference through Baseten directly from HF SDKs using OpenAI-compatible client calls; billing passes through provider costs with no markup.
Summary
Developers can now call Baseten-hosted models (DeepSeek V4 Flash, GLM-5.2, Kimi K3) via standard HF authentication without provider setup, reducing integration friction. Billing flexibility—either direct to provider or routed through HF account—lets teams choose cost/control tradeoff.
Why it matters
Developers can now call Baseten-hosted models (DeepSeek V4 Flash, GLM-5.2, Kimi K3) via standard HF authentication without provider setup, reducing integration friction. Billing flexibility—either direct to provider or routed through HF account—lets teams choose cost/control tradeoff.
Implementation verdict
Replaces direct Baseten SDK integration for conversational/text-generation tasks. Requires huggingface_hub >= 1.26.1 (Python) or @huggingface/inference (JS) and HF_TOKEN. Ready now: drop-in replacement using OpenAI client with router.huggingface.co endpoint. Start with DeepSeek V4 Flash; support for other task types rolling out.
Sources
Dev Signal
Get briefs like this in your inbox — free, every weekday.
100+ sources compressed into one 4-minute read. Ranked, cited, implementation-ready.