EU’s Tulipp project delivers its results for embedded vision
The project has delivered its first three use cases to be demonstrated at Vision 2018 in Stuttgart, covering Medical X-Ray imaging, automotive ADAS (Advanced Driver Assistance Systems) and UAVs (Unmanned Aircraft Vehicles).
The Medical X-Ray imaging use case combines an embedded computing board with a medical X-ray imaging sensor to eliminate the noise on images when radiation doses are reduced. The ADAS use case enables the implementation of pedestrian detection algorithms running in real-time on a small, energy efficient, embedded platform. The UAVs use case equips a UAV with real-time obstacle detection and avoidance capabilities based on a lightweight and low-cost stereo camera setup.
“At first glance, Medical X-Ray Imaging, ADAS and UAVs would appear to have very little in common,” said Philippe Millet of Thales and Tulipp’s Project Co-ordinator. “But that’s only true when viewed from the perspective of the final application as they all have a requirement for high-performance image processing and they also suffer from the so-called SWaP (Size, Weight and Power) computing constraints typical of embedded systems. Tulipp has addressed these challenges by taking a diverse range of application domains as the basis for defining a common reference processing platform comprising the hardware, the operating system and its programming environment that captures the commonality of real-time, high-performance image processing and vision applications.”
Tulipp’s Medical X-Ray imaging use case demonstrates advanced image enhancement algorithms for X-Ray images running at high frame rates. It focuses on improving the performance of X-Ray imaging Mobile C-Arms, which provide an internal view of a patient’s body in real-time during the course of an operation, increasing surgeon efficiency and accuracy with minimal incision sizes, aiding faster patient recovery and lowering nosocomial disease risks. Using Tulipp’s embedded hardware reference platform, which is the size of a smart phone, the use case demonstrates how radiation doses to which patients and staff are exposed, which are typically 30 times ambient radiation levels, can be reduced by 75% at the same time as maintaining the clarity of the real-time X-Ray images which would otherwise be rendered useless by the increases in the noise level on the images that a reduced radiation dose can cause.
ADAS adoption is dependent on the implementation of vision systems or on combinations of vision and radar and the algorithms must be capable of integration into a small, energy-efficient Electronic Control Unit (ECU). An ADAS algorithm should be able to process a video image stream with a frame size of 640×480 at a full 30Hz or at least at the half rate. The Tulipp ADAS use case demonstrates pedestrian recognition in real-time based on Viola & Jones algorithm. Using the Tulipp reference platform, the ADAS Use Case achieves a processing time per frame of 66ms, which means that the algorithm reaches the target of running on every second image when the camera runs at 30Hz.
Tulipp’s UAV use case demonstrates a real-time obstacle avoidance system for UAVs based on a stereo camera setup with cameras orientated in the direction of flight. Even though we talk about autonomous drones, most current systems are still remotely piloted by humans. The use case uses disparity maps, which are computed from the camera images, to locate obstacles in the flight path and to automatically steer the UAV around them. This is the necessary key towards totally autonomous drones.
Tulipp is funded by the European Union’s Horizon 2020 programme – www.tulipp.eu
Tulipp consortium members include:
Thales – www.thalesgroup.com
Efficient Innovation SAS – www.efficient-innovation.fr
Fraunhofer IOSB – www.iosb.fraunhofer.de
Hipperos – www.hipperos.com
Norges Teknisk-Naturvitenskapelige Universitet – www.ntnu.no
Technische Universität Dresden – tu-dresden.de
Sundance Multiprocessor Technology – www.sundance.com
Synective Labs – www.synective.se
If you enjoyed this article, you will like the following ones: don't miss them by subscribing to :
