Post by NVIDIA

Software is the force multiplier behind AI infrastructure. Every optimization compounds → more throughput, lower cost per token, more value from hardware already in the field. Here's what that looks like when it's running in production: 5x lower token costs for DeepSeek V4 on Blackwell, unlocked through software optimizations in just one month. Baseten — 50% more tokens per second serving DeepSeek V4 Pro on Blackwell, using TensorRT-LLM with proprietary runtime optimizations across reasoning, coding, and long-context workloads. Cognition — scales reinforcement learning on NVIDIA Blackwell using Dynamo to manage the lifecycle of inference engines. DeepInfra — frontier open-source models, including DeepSeek V4, running on Blackwell from day zero. DigitalOcean & Hippocratic AI — 30% throughput increase, sub-half-second time to first response, across 10 million patient calls. Together AI — helped Cursor go from model optimizations to production endpoints for real-time coding, on Blackwell with TensorRT-LLM. The pattern is the same across all of them: NVIDIA full-stack inference software on Blackwell, compounding value with every update. Read the blog: https://nvda.ws/4fz2xhz

Video Content