Orbbec adds deep learning to 3D camera for robotic vision
3D vision developer Orbbec has added deep learning to is 3D stereo vision systems for robotic and industrial applications.
The Gemini 2 XL 3D camera launched by Orbbec at CES 2024 next week can be used as the primary visual system for a variety of robots and numerous AI-based video analytics and interaction systems.
The long range, 3D camera delivers accurate and reliable data in various lighting conditions from pitch black to outdoors and is Orbbec’s debut in long-range 3D cameras suitable for outdoor use. The camera is designed with a depth Field of View (FoV) of up to 101° diagonally, and advanced depth processing for conquering complex and demanding application scenarios
The 3D camera system provides data suitable for a wide range of demanding AI-driven recognition and tracking applications that require detection of small objects in high-reflectivity environments. The deep learning algorithms can generate a complete phase map around small objects and fixtures by overcoming challenges faced by traditional algorithms due to shadow, speckle pattern size and illumination condition.
Conventional algorithms struggle to calculate depth/phase in environmental conditions with highly reflective surfaces, direct sunlight, low visibility, sharp shape-cased shadows, small texture-caused shadow, etc. to calculate the depth/phase which results in a spotted image with missing depth areas. Orbbec’s AI algorithms create a solid complete phase map output even under these challenging conditions.
The Gemini 2 XL, when paired directly with the powerful NVIDIA Jetson Orin system-on-modules instead of the OBox, allows for additional image processing resulting in further improvement in the depth frame rate, accuracy, and scene versatility. This optimized deeplearning pipeline and camera calibration service will be offered only as part of Orbbec’s ODM package.
Support for the customization of the AI depth output and the ability for customers to re-train the model with their own data sets that allows engineers to achieve better performance under their specific application environment will be available through Orbbec’s ODM services engagement.
“We are excited to demonstrate the superior capabilities of Gemini 2 XL at this year’s Consumer Electronics Show,” said David Chen, Co-Founder and Head of Products at Orbbec. “As Orbbec’s learning library continues to expand, the camera’s capabilities will continue to improve, broadening their applicability in robotics and AI-based vision solutions.”
If you enjoyed this article, you will like the following ones: don't miss them by subscribing to :
