STMicroelectronics has developed a digital signal processor that combines signal processing and AI algorithms with a MEMS sensor for edge processing on a single chip
The Intelligent Sensor Processing Unit (ISPU) combines a Digital Signal Processor (DSP) suited to run binary neural network AI algorithms alongside a MEMS sensor on the same silicon.
The ISPU is a proprietary 16bit RISC DSP with a four stage pipeline running at 5MHz and full precision floating point processing. It operates from 16bit variable-length instructions and 20bit data, and includes a single-cycle 16-bit multiplier. All of this gives a faster interrupt than an ARM Cortex core at 4 cycles rather than 15. It occupies just 8,000 gates to minimise the amount of silicon area alongside the MEMS sensor, and uses just 40Kbits of memory storage.
The device is programmable in C and is extensible (in the chip-design phase) for dedicated instructions and hardware components. It also combines an accelerator for binary neural network models
ISPUs will be packaged in a standard 3mm x 2.5mm x 0.83mm package and will be pin compatible with previous ST devices for quick upgrades. ST says the integration in a single device is key, showing a 5-6x saving in power consumption over System-in-Package approaches in sensor-fusion applications.
“While technically challenging, integrating ST’s sensors on the same piece of silicon with our ISPU does improve sensor-based systems from an online experience to an Onlife one. It advances the sensor’s features to speed decision-making by reducing data transfers, enhancing privacy by keeping data local, while reducing size and power consumption, which cuts costs,” said Andrea Onetti, Executive Vice President, MEMS Sub-Group, STMicroelectronics. “Moreover, the ISPU is easily programmable with commercial AI models and can ultimately operate with all of the leading AI tools.”
The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.
The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.
The technical storage or access that is used exclusively for statistical purposes.The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.
The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.