The company, whose technologies are built on SRI International’s machine learning (ML) methodology research on how to deploy computer-based systems in complex situations, announced the Latent AI Efficient Inference Platform (LEIP) and its first platform product, LEIP Compress, a quantization optimizer for edge devices that enables smart and efficient IoT applications. LEIP is designed to enable developers working on edge AI projects to optimize within compute, energy, and memory budget without requiring changes to existing AI/ML infrastructure, processors, or development frameworks.
“One of the major goals for Latent AI is to simplify and accelerate the AI workflow from training to deployment,” says Jags Kandasamy, CEO and Co-Founder of Latent AI. “With many thousands of compelling edge AI applications yet to be developed, we are helping make the development process as efficient and seamless as possible.”
The company’s underlying technology was initiated under DARPA projects and, says the company, represents a fundamental shift in the way AI is trained and computing resources are dynamically determined for highly resource-constrained hardware. It can compress large neural networks up to 90% with less than 1% accuracy loss.
In addition to the platform launch, the company announced it had recently closed a $3.5 million seed round of financing, led by Steve Jurvetson at Future Ventures and including industry leaders such as SRI International Ventures, Perot Jain. and Gravity Ranch.
Steve Jurvetson, who also serves on the Boards of Tesla, SpaceX, and D-Wave, adds, “With the internet of things, we are creating a sensory nervous system on the planet, with countless sensors and data collecting proliferating across the planet. All of this ‘big data’ would be a big headache but for machine learning to find patterns in it all and make it actionable, and edge computing to shift the processing to the periphery and avoid network overload.”
“The edge needs AI, and AI needs the edge. Latent AI integrates both with a portfolio of IoT edge compute optimizers and accelerators that bring an order of magnitude improvement to existing infrastructure. This is essential, as the majority of new software today is AI and most compute cycles will shift to the edge.”
Latent AI says it is working with top players in high-end consumer electronics, AR/VR, gaming, auto, drones, and robotics.