KIOXIA open source software advances AI RAG
Cette publication existe aussi en Français
In an ongoing effort to enhance the usability of AI vector database searches within retrieval-augmented generation (RAG) systems by optimising the use of solid-state drives (SSDs), Kioxia Corporation has announced an update to its KIOXIA AiSAQ™ (All-in-Storage ANNS with Product Quantisation) software.
This new open-source release introduces flexible controls, allowing system architects to define the balance point between search performance and the number of vectors, which are opposing factors in the fixed capacity of SSD storage in the system. The resulting benefit enables architects of RAG systems to fine-tune the optimal balance of specific workloads and their requirements without any hardware modifications.
First introduced in January 2025, KIOXIA AiSAQ software utilises a novel approximate nearest neighbour search (ANNS) algorithm optimised for SSDs, eliminating the need to store index data in DRAM. By enabling vector searches directly on SSDs and reducing host memory requirements, KIOXIA AiSAQ RAG technology allows vector databases to scale, largely without the restrictions caused by limited DRAM capacity.
When the installed capacity of the SSD in the system is fixed, increasing search performance (queries per second) requires more SSD capacity consumed per vector. This results in a smaller number of vectors. Conversely, to maximise the number of vectors, SSD capacity consumption per vector needs to be reduced, which results in lower performance. The optimal balance between these two opposing conditions varies depending on the specific workload. To find the appropriate balance, KIOXIA AiSAQ software introduces flexible configuration options. The latest update enables administrators to select the optimal balance for various workloads within the RAG system. Furthermore, the update makes KIOXIA AiSAQ technology a suitable SSD-based ANNS for not only RAG applications but also other vector-hungry applications such as offline semantic searches.
With the growing demand for scalable AI services, SSDs offer a practical alternative to DRAM for managing the high throughput and low latency that RAG systems require. KIOXIA AiSAQ software enables efficient meeting of these demands, allowing for large-scale generative AI without being constrained by limited memory resources.
The KIOXIA AiSAQ open-source AI RAG software is available for download at https://github.com/kioxia-jp/aisaq-diskann.
If you enjoyed this article, you will like the following ones: don't miss them by subscribing to :
