Toppan in Japan has developed an artificial intelligence (AI) system that makes it possible for multiple moving robots to identify people whose images have been uploaded in advance.
This person recognition function has been verified via a pilot test in which images sent from robots in various locations within an event space were analyzed and compiled in the cloud using an AI engine. It was possible to identify specific people from camera images sent by various types of robots and to perform cloud-based confirmation.
The test also demonstrated that people’s locations could be pinpointed by using the positions of the robots on TransBots.
- Virtual lab for high precision body measurements
- Toppan tests out nursing digital twin
- Digital twin combines robot control and VR
Toppan aims to use the TransBots with digital twins in diverse fields, such as security, customer analysis, guidance, transportation, and cleaning. Going forward, Toppan aims to work with robot manufacturers, enhancing the multifunction console for service robots and TransBots, and enabling multiple use cases.
Toppan’s TransBots is a digital twin for centralized management and control of multiple types of robots. Operators can use a multifunction console to configure courses for robots’ movement in a virtual space. Robots in the real space then move in accordance with the courses to arrive safely at their preset destinations. Robots can also pinpoint their own current position, detect obstacles, and speak to ensure the safety of people nearby. The use of the virtual space for setting courses and controlling robots means that the tasks can be performed remotely.
Toppan has now added the AI-driven person recognition function to the TransBots console. When people who have been preregistered on the system enter a physical space, multiple moving robots are able to recognize them.
This is expected to have various applications, including remote management of hospitals and complexes and management of large-scale events with restricted entry, such as exhibitions and concerts. In addition to telepresence robots, TransBots can also be applied for a wide range of service robots, such as robot carriers and mobile picking robots.
Security cameras and other Internet of Things (IoT) devices are employed for the management of buildings such as hospitals and complexes as well as for managing admission to exhibitions and concerts. But limitations on the scope that can be monitored by people and security cameras mean that robots are expected to play a larger role in the future.
The TransBots console consolidates elements such as robot location, battery capacity, video from cameras, display images, and audio on the robotics hub in the cloud and enables them to be controlled via various application consoles.
The main functions include a graphical user interface (GUI) for digital twin robot control, robot map drawing, multi-vendor robot connection, automated/manual operation, a robot management web dashboard, multiple telepresence management, live video streaming, equipment communication, remote central control of multiple locations, video storage, and signage functions.