AI tool optimizes models, code for end devices

New Products |
By Rich Pell

Currently mainly focused on smartphones, XGen is offered as the first major milestone of the company’s efforts to clear the long-standing obstacles to AI deployment on end devices. The current important AI models, says the company, are mostly designed for cloud deployment, with billions of parameters and operations, relying on the cloud servers’ high computation power to run them.

Running the models on end devices requires times of reduction in both the model size and the model execution time. Existing tools have isolated solutions that either optimize the AI model size or the execution speed, leading to unsatisfactory results and leaving the AI capabilities largely locked out on devices.

XGen is offered as solving the challenge through its proprietary co-design technology in the AI model’s compression, compilation, and runtime. The technology compresses AI models in high ratio while still maintaining the model representation friendly for highly efficient code generation. It meanwhile tailors the generated code to best map and schedule the compressed model to the hardware.

With XGen, says the company, an input AI model can turn into a directly deployable code with large speedups, much smaller size, and significant power savings while keeping the model accuracy to users’ satisfaction. XGen is a low-code tool: Users just need to input their AI requirements through its intuitive user interface; XGen then automatically conducts the model and code co-optimization and generates the desirable code ready to be integrated into end applications.

In the first release, the tool supports the integration with applications of Android and iOS. Future releases will support more target platforms and systems. XGen also offers full controllability so that users can fully customize the optimizations as they desire.

The superior optimization capability of XGen, says the company, makes ubiquitous AI deployment possible on off-the-shelf devices without relying on dedicated hardware support.

“Through CoCoPIE XGen, businesses can significantly improve their AI capabilities on end devices,” says Dr. Xiao-Feng Li, Co-founder and CEO of CoCoPIE. “Smartphones are an essential part of consumers’ everyday lives. By removing the deployment barrier, the first release of CoCoPIE XGen will help unlock the huge market potential of mobile AI. We are excited to work with our partners to improve their competitive advantages with CoCoPIE XGen, and to accelerate the fast-growing device AI industry.”

The first release of CoCoPIE XGen is an on-premise software toolset. Users can install and use it on their own machines. XGen can be deployed on either a single computer for individual uses or a cluster of computers for scalable uses. The company says that it is working with its partners globally to deploy the technology to meet the various needs of AI on devices.



Linked Articles