Verizon and Nvidia have developed an edge AI system that runs on Verizon’s 5G private network with private Mobile Edge Compute (MEC).
The development brings together Verizon’s low-latency 5G private network and private MEC in the US with Nvidia’s silicon and NIM microservices to provide real-time AI services on premises for enterprise customers.
The 5G platform stack is designed to be plug & play so that third-party developers can add applications via the NIM microservices while accommodating future evolutions in AI computing and a variety of AI and connectivity applications. It supports multiple tenants for multiple use cases or customers and can scale as needed or provide services remotely via portable private network.
The stack is being built to handle compute-intensive apps including Generative AI Large Language Models and Vision Language Models, Video streaming, broadcast management, Computer Vision (CV), Augmented/Virtual/Extended Reality (AR/VR/XR), Autonomous Mobile Robot/ Automated Guided Vehicle (AMR/AGV), and IoT.
Verizon engineers will begin demonstrations of the 5G edge AI system in early 2025.
“Generative AI, with its predictive capabilities, is poised to be a critical component of digital transformation and future business growth in almost all industries,” said Srini Kalapala, Senior Vice President of Technology and Product Development at Verizon.
“We’re leveraging our network’s unique strengths including private networks and Verizon’s global industry leadership in private MEC, combined with Nvidia’s AI compute capabilities to enable real-time AI applications that require security, ultra-low latency, and high bandwidth. Our ongoing investment in our network infrastructure means we’re uniquely positioned to deliver these powerful AI services at scale, driving the digital transformation and fueling the future growth of businesses worldwide.”
“Enterprises everywhere are racing to integrate AI solutions that bring new value to their employees, partners and customers, and can also help them operate with extreme efficiency,” said Ronnie Vasishta, senior vice president of telecom at Nvidia. “Verizon’s integration of Nvidia’s full-stack AI platform into its new solution for running AI workloads on private 5G networks is a big step forward in helping enterprises of all sizes reach their business objectives faster with AI.”