Niobium team for fully encrypted genAI
Niobium’s Fully Homomorphic Encryption (FHE) acceleration technology is being used to make generative AI more secure.
US chip startup Niobium has been working with CryptoLab in Korea on protecting data in large language models and genAI system with FHE, where the data stays encrypted during operations.
This encrypted GenAI allows user queries and responses to remain encrypted so that inputs are unreadable as plain text even to the AI model itself.
Combining Niobium’s FHE accelerator hardware with CryptoLab’s patented advanced HEaaN CKKS technology will dramatically speed up homomorphic encryption operations, paving the way for practical, real-world applications of privacy-preserving AI.
The two are jointly developing fully encrypted GenAI/LLM inferencing at speeds comparable to unencrypted operations, eliminating the traditional trade-off between privacy and performance.
CryptoLab has expertise in post-quantum cryptography to defend against both current and future cyber threats, including those from quantum computing.
The joint effort is also focused on delivering turnkey FHE computation systems for businesses of all sizes.
“The synergy between our FHE acceleration technology and CryptoLab’s advanced software paves the way for a new era of data utilization. We’re not only safeguarding privacy but also unlocking the full potential of data in a secure environment,” said Kevin Yoder, CEO of Niobium in Ohio.
Niobium’s fully integrated custom silicon for FHE sits on a PCIe card that can be inserted into any existing cloud server to accelerate the performance of FHE software. Pilots are starting this quarter.
“This partnership represents a quantum leap for Private AI,” said Jung Hee Cheon, CEO of CryptoLab, which has an office in Lyon, France. “By collaborating with Niobium, we’re not just pushing the boundaries—we’re redefining the very foundations of secure, privacy-first artificial intelligence.”
www.cryptolab.co.kr; www.niobium.com