Robot teleoperation is important when the working environment is dangerous for humans such as at disaster sites. For effective teleoperation, operators can benefit from viewing the robot’s surroundings in a third-person perspective. However, arranging an external camera to provide such views is challenging. Therefore, we propose methods to generate virtual third-person perspective images using sensors attached to the robot.
We have installed four fisheye cameras on the robot to capture 360° images, and by using the additional depth sensors on the robot, virtual third-person perspective images called free viewpoint images are generated.
For further reading:
Visualization of Dump Truck and Excavator in Bird’s-eye View by Fisheye Cameras and 3D Range Sensor