Rapt AI and AMD GPUs to boost AI workloads and inference
Rapt AI has announced a strategic collaboration with AMD to redefine AI infrastructure management by improving AI inference and training workload management and performance on AMD Instinct GPUs.
As AI adoption accelerates, organisations are grappling with resource allocation, performance bottlenecks, and complex GPU management. Integrating Rapt’s intelligent workload automation platform with AMD Instinct MI300X, MI325X, and the upcoming MI350 series GPUs offers a scalable, high-performance, and cost-effective solution that allows customers to maximise AI inference and training efficiency across on-premises and multi-cloud infrastructures.
AMD Instinct GPUs, with their industry-leading memory capacity combined with Rapt’s intelligent resource optimisation, help ensure maximum GPU utilisation for AI workloads, with the added benefit of lowering total cost of ownership (TCO).
Rapt’s platform streamlines GPU management, freeing data scientists from spending valuable time on trial-and-error infrastructure configurations. By automatically optimising resource allocation for their specific workloads, it enables them to focus on innovation rather than infrastructure. It seamlessly supports diverse GPU environments (AMD and others, whether in the cloud, on-premises, or both) through a single instance, ensuring maximum infrastructure flexibility.
The Rapt platform optimises job density and resource allocation on AMD Instinct GPUs, resulting in better inference performance and scalability for production AI deployments. Auto-scaling capabilities further help ensure efficient resource use based on demand, reducing latency and maximising cost efficiency.
Furthermore, Rapt’s platform works out-of-the-box with AMD Instinct GPUs, ensuring immediate performance benefits. Ongoing collaboration between Rapt and AMD will enhance optimisation in areas such as GPU scheduling, memory utilisation, and more, ensuring customers are equipped with a future-ready AI infrastructure.
At AMD, we are committed to delivering high-performance, scalable AI that empowers organisations to unlock the full potential of their AI workloads.” said Negin Oliver, corporate vice president of business development, Data Center GPU Business at AMD. “Our collaboration with Rapt AI combines the cutting-edge capabilities of AMD Instinct™ GPUs with Rapt’s intelligent workload automation, enabling customers to achieve greater efficiency, flexibility, and cost savings across their AI infrastructure.
Charlie Leeming, CEO of Rapt, added, “Collaboration with AMD allows us to enhance our platform further, optimising it for the powerful AMD Instinct GPUs. This joint development is set to transform AI infrastructure management, driving better performance, cost efficiency, and faster time to value for our mutual customers.”
“As more organisations move to production AI, maximising infrastructure efficiency and cost-effectiveness becomes paramount,” said Anil Ravindranath, Rapt CTO. “Rapt AI, deeply integrated with powerful AMD Instinct™ GPUs, provides an intelligent, AI-powered platform that dynamically optimises resource allocation across the entire ML pipeline. This comprehensive approach delivers not only accelerated performance and lower latency, but also unprecedented GPU utilisation and simplified deployment, unlocking truly scalable and efficient production AI capabilities.”
If you enjoyed this article, you will like the following ones: don't miss them by subscribing to :
