Speed Demon: NVIDIA Blackwell Takes Pole Position in Latest MLPerf Inference Results

▤ Summary

The goal for AI factories is simple: deliver accurate answers to queries quickly, at the lowest cost and to as many users as possible. As AI models grow to billions and trillions of parameters to deliver smarter replies, the compute required to generate each token increases. Keeping inference throughput high and cost per token low requires rapid innovation across every layer of the technology stack, spanning silicon, network systems and software. This versatility means Hopper can run a wide range of workloads and keep pace as models and usage scenarios grow more challenging. The breadth of submissions reflects the reach of the NVIDIA platform, which is available across all cloud service providers and server makers worldwide.

▦ Linked Companies