vLLM's Oct 23 blog: on GB200 under DeepSeek's decode setup, decode throughput is within 6% of DeepInfer's published results at batch sizes 8-256; DeepInfer's numbers were read from its charts, not run side by side. On a GB300 NVL72 with P/D disaggregation and Wide-EP, vLLM hits 954K tokens/s per GPU on SemiAnalysis AgentX at P90 196 tokens/s per user, about $38.96 per GPU-hour at off-peak prices.
Why it matters: vLLM says it now matches DeepSeek's own DeepInfer engine on DeepSeek-V4.1-Flash decode.