#performance improvements

51 stories · 0 in 7 days · 0 in 30 days
Stories, products and papers tagged "performance improvements", newest first.
Oct 10
ProductsBuildersMulti-sourceSelected76°09:56
vLLM Adds NVIDIA Vera Rubin Support with 7.8x GB200 Throughput

A 7.8x per-node throughput jump means serving large mixture-of-experts models could get much cheaper per token once Rubin systems ship. Teams running inference infrastructure should track vLLM's Rubin maturity before planning their next GPU refresh, especially against GB200-based deployments. There is no ASEAN-specific angle here; the concrete comparison is Rubin versus GB200 in vLLM.

Event
Official accountvLLM@vllm_projectSource
Oct 3
Sep 29
Sep 11
Sep 10
Sep 3
Aug 27
Aug 26
Aug 25
Aug 24