.@DecagonAI cut voice agent cost per turn nearly 6x with Together AI.
They moved from closed models to fine-tuned open models, while keeping latency low enough for real-time voice:
→ <400ms p95 model latency per turn
→ custom speculators and prompt caching
→ optimized serving on NVIDIA Blackwell
→ weekly, sometimes daily model deployment velocity
This is the closed-to-open shift: more control, better tokenomics, and production performance without being locked into proprietary APIs.
 |
VOOZH | about |
