IBM becomes first Cloud provider to use Intel Gaudi 3
Summary
By harnessing Intel Gaudi 3 on IBM Cloud, the two companies aim to help clients cost-effectively test, innovate and deploy generative AI (GenAI) solutions. The research found that GenAI is anticipated to have an impact across all areas of IT spending markets, predicting a future where AI technologies will become integral to busineses. “The ability to handle more data, and have higher performance, all of this is going to drive better adoption of AI for customers worldwide,” said Satinder Sethi, General Manager of IBM Cloud Infrastructure Services. New AI inferencing benchmark tests conducted by research firm Signal65, and commissioned by Intel, found Gaudi 3 is 92% more cost efficient (performance per dollar) than competition when running on Meta’s Llama-3.1-405B-Instruct-FP8 model with large context sizes. Performance gains are intended to lower the cost barrier for companies looking to deploy or fine-tune models, particularly as GenAI adoption grows.