MENU

AI computing broker middleware to address global GPU shortages

AI computing broker middleware to address global GPU shortages

Technology News |
By Nick Flaherty

AI


Fujitsu has launched an AI computing broker middleware to improve GPU utilization and address global shortages

The middleware dynamically allocates GPU resources on a per-GPU basis, optimizing resource allocation and memory management across various platforms and AI applications. The memory management enables the simultaneous handling of up to 150GB of AI processing, approximately five times the physical GPU memory capacity

This provides a 2.25x increase in computational efficiency in trials with multiple companies.

The proprietary adaptive GPU allocator technology dynamically allocates GPUs for real-time high-efficiency processing, with various AI processing optimization techniques. It optimizes the use of CPUs and GPUs by allocating resources in real time to give priority to processes with high execution efficiency, even if the GPU is running a program.

Unlike conventional allocation on a per-job basis, Fujitsu’s AI computing broker dynamically allocates GPU resources on a per-GPU basis, using the computational optimization expertise to improve availability rates. The GPU memory management capabilities of the technology allow users to run numerous AI processes without worrying about GPU memory usage or physical capacity.

Following successful pilot trials, Tradom in Japan is using the AI computing broker technology in October 2024, while Sakura internet has started a feasibility study on the AI computing broker technology for its data centre operations.

The global market for generative AI is projected to grow approximately 20-fold from 2023 to 2030, with a corresponding increase in GPU use. However, the rising power consumption in data centers to meet this GPU demand presents a significant challenge.

Fujitsu has been conducting verification trials of this allocation technology across various platforms.

Moving forward, Fujitsu will expand the scope of its AI computing broker technology application, including implementation across multiple GPUs installed on multiple servers, anticipating use in even larger computing environments.

“Our company delivers cutting-edge AI-powered solutions for managing foreign exchange risk. The trial of Fujitsu’s AI computing broker technology proved its ability to significantly streamline GPU resource allocation for AI model generation, enabling the development of substantially more accurate models in significantly less time through AI learning process multiplexing. We are committed to leveraging this technology, in continued collaboration with Fujitsu, to proactively expand our solution offerings, driving both Tradom‘s growth and the advancement of the FinTech industry,” said Junichi Kayamoto, Chief Data Science Officer at Tradom.

www.fujitsu.com

 

If you enjoyed this article, you will like the following ones: don't miss them by subscribing to :    eeNews on Google News

Share:

Linked Articles
10s