IMU-based gesture control for low-power wearables
When designing wearable devices, IMU-based gesture control requires less power, extending device battery life compared to camera or vision-based systems. The Bosch Sensortec BHI360 smart IMU sensor enables designers to achieve a compact form factor while ensuring ease of use and intuitive interfaces.
Emerging AR/VR headsets, smart glasses, and AI pins are changing the way a user interacts with the device through gestures such as air pinches and finger drags. However, many of these devices rely on camera-based or Time-of-Flight (ToF) systems to capture gestures, but these technologies have notable limitations — they demand a clear line of sight and substantial processing power to function effectively. The use of an IMU offers a powerful alternative.
The BHI360 is a programmable IMU-based sensor system combining a gyroscope with an accelerometer that enables full customization for wearable devices. IMU-based gesture control systems elevate how users interact with wearables. With natural gestures like pinching or wrist flicks, users can adjust volume, control lighting, or navigate media effortlessly.
IMUs, such as the BHI360 programmable smart IMU sensor system from Bosch Sensortec, excel in power efficiency. Unlike camera-based gesture control systems, which require continuous image capture and processing, IMUs track motion through acceleration and orientation changes. On-sensor processing software achieves gesture recognition with minimal latency and energy use. This extends battery life and increases the time between charges for the end device.
IMU-based systems offer robust gesture control regardless of environmental conditions. They are not affected by lighting, obstacles, or the need for line-of-sight, unlike camera-based solutions often found in devices like augmented reality headsets. Additionally, they eliminate the need for expensive and bulky camera-based systems, offering utmost application flexibility.
Compact, lightweight, and ideal for integration into small wearable devices, the BHI360 smart IMU sensor easily fits into smartwatches, allowing manufacturers to deliver sleek, unobtrusive designs without sacrificing functionality. By embedding AI and advanced algorithms directly on the sensor, the BHI360 enables ultra-low latency, real-time gesture recognition, elevating the user experience with faster, more responsive interactions. Its programmability allows manufacturers to customize gesture recognition algorithms for specific applications, offering exceptional flexibility across diverse wearable devices.
The BHI360 IMU sensor can also provide additional information by measuring the intensity of gestures, primarily through the accelerometer signal amplitude. This adds a useful dimension of information to event recognition, allowing for more nuanced and accurate gesture detection. For instance, the force of a pinch gesture or the acceleration profile of a hand wave can be quantified, enabling more sophisticated and context-aware interactions.
IMU-based systems from Bosch Sensortec are generally significantly lower in cost compared to camera-based systems. This cost efficiency makes gesture control accessible for simpler devices, broadening the range of products that can benefit from advanced interaction capabilities. Additionally, for high-end devices that already incorporate cameras, IMUs can complement these systems to increase gesture recognition accuracy. By combining the strengths of both technologies, manufacturers can deliver superior performance without significantly increasing production costs.
Bosch Sensortec’s collaboration with Doublepoint, a company specializing in human-machine interface (HMI) technology based on MEMS sensors, is a great example. Their gesture recognition platform, deployed directly on the BHI360 programmable IMU-based sensor system, demonstrates a practical application of the technology. By processing AI-driven algorithms directly on the sensor, the solution delivers ultra-low latency while minimizing power consumption, enabling always-on gesture detection in modern wearables.
“Together with Doublepoint, we empower manufacturers to accelerate product development by delivering a ready-to-implement micro-gesture control solution that enhances user interaction across connected devices, including AR/VR, robotics, IoT, wearables, TVs, automotive systems, and more,” comments Marcellino Gemelli, Head of Global Business Development at Bosch Sensortec.
Further reading
First ultrasound blood pressure monitoring wearable
Strain gauges sense wind on biomimetic aerial robots
Report: Quantum sensors mitigate GPS/PNT shortcomings
Moving prosthetics without implants using quantum sensors
Compact 3D low-power ToF sensor delivers high performance
Researchers turn low-cost RFID tags into scalable passive sensors
If you enjoyed this article, you will like the following ones: don't miss them by subscribing to :
