NR1-P is NeuReality’s first implementation of the company’s AI-centric architecture, with other implementations to follow. The company is now focused on developing the NR1 system chip that is claims will bring a 15x improvement in performance per dollar compated to GPU-based inference engines.
The NR1-P is built in a 4U server chassis equipped with sixteen Xilinx Versal Adaptive Compute Acceleration Platform (ACAP) cards, highly integrated and fully software programmable compute platforms that can adapt to evolving and diverse algorithms and go far beyond traditional FPGAs. The NR1-P SoC leverages these capabilities to implement the AI-centric compute engine while fusing system and datapath functions and the neural network processing function.
Moshe Tanach, co-founder and CEO of NeuReality, saidin a statement that the company’s technology will be the only way to scale their deep learning usage while keeping the cost reasonable. “With NR1-P, customers can finally experience this new type of solution, leverage it in their solutions, and prepare to integrate our upcoming NR1 product once it is in production,” he added.
NeuReality claims the NR1-P prototype platform delivers more than a 2x improvement in total cost of ownership (TCO) compared to Nvidia’s CPU-centric platforms running disaggregated deep learning service. “Customers using large-scale use cases of image processing, such as object detection or face recognition, can already get 50 percent saving in the cost of the technology or twice the capacity for the same price when using NR1-P,” said Tanach.
The prototype paves the way towards further improvements that will be integrated into NR1, NeuReality’s flagship product.
“Combining the adaptability and low latency capabilities of Versal ACAP with NeuReality’s IP solves existing AI scalability challenges that currently inhibit the growth of the AI inference market,” said Sudip Nag, corporate vice president for software and AI products at Xilinx, in the same statement.
NeuReality was founded in 2019 by a team with experience in data centers architecture, system, and software. Its seed funding has been provided by Cardumen Capital, OurCrowd and Varana Capital. NeuReality has said its first AI platform is based on what it calls an AI server on a chip.
Related links and articles: