Dell, Nvidia expand AI factory
Dell Technologies is adding technology from Nvidia to its AI Factory with new rack-based servers, edge devices, workstations and services.
This is part of the shift to AI infrastructure where the Nvidia Blackwell GPU is a key component, says Jensen Huang, CEO of Nvidia, and will be used by Dell for enterprise customers.
The Dell PowerEdge XE9680L supports up to eight Blackwell GPUs in a 4U form factor, smaller than the previous version. The server provides the highest rack-scale GPU density in an industry standard x86 rack, offering 33% more GPU density per node. The platform offers 20% more PCIe Gen. 5 slots and double the North/South network expansion capacity.
“We now have the ability to manufacture intelligence,” said Jensen Huang, CEO of Nvidia. “The last Industrial Revolution was the manufacturing of software; previously, it was manufacturing electricity — now we are manufacturing intelligence. Every company at its foundation is intelligence — fundamentally every company is an intelligence manufacturer.
Cooling is key for the AI factory, and direct liquid cooling (DLC) improves overall efficiency with greater cooling capacity for CPUs and GPUs. A turnkey rack-scale version include an air-cooled design supporting 64 GPUs in a single rack, or a liquid cooled format featuring 72 Blackwell GPUs in a single rack. This will be available fully configured with factory integration for rack-scale deployments and onsite installation.
The Dell server runs NativeEdge, the first edge orchestration platform that automates the delivery of Nvidia AI Enterprise software, including Nvidia NIM AI model distribution service. The Dell AI Factory uses Nvidia Tensor Core GPUs, Spectrum-X Ethernet networking fabric and Bluefield data professing units (DPUs).
The AI factory provides integrated capabilities or pre-validated, full stack implementations for AI use cases that require accelerated performance such as retrieval-augmented generation (RAG), model training and inferencing as well as the Metropolis AI video analytics and Riva speech and translation service.
“Generative AI requires a new type of computing infrastructure – an AI factory that produces intelligence,” said Jensen Huang, founder and CEO of Nvidia. “Together, Nvidia and Dell are providing the world’s industries with a full-stack offering – including computing, networking and software – that drives the copilots, coding assistants, virtual customer service agents and industrial digital twins of the digital enterprise.”
“Organizations are moving quickly to capture the AI opportunity, which is why our collaboration with Nvidia is so important,” said Michael Dell, founder and CEO, Dell Technologies. “Our expansion of the Dell AI Factory with Nvidia continues our joint mission – we’re making it easy for organizations to implement AI so they can move boldly into this next technological revolution.”
Dell PowerEdge XE9680L servers will be available in the second half of 2024 along with NativeEdge deployment blueprints.
If you enjoyed this article, you will like the following ones: don't miss them by subscribing to :
