During the teleoperation of construction machines, it is highly needed to visualize the machine body itself. This is because the operator needs to perform a visual confirmation of the construction machine. In addition, information of crawler parts’ shoe slip is indispensable. Therefore, not only the surrounding environment but also the vehicle body are needed to be visualized. This paper proposes a tele-visualization system for both the construction machine and the surrounding environment from an arbitrary viewpoint by using mounted cameras. In the proposed method, both the construction machine and the surrounding environment are expressed as three-dimensional mesh models. In order to capture the actual scenes of the construction machine and the surrounding environment, the positions and orientations of the mounted cameras are adjusted. Simultaneous tele-visualization is achieved by mapping the image data captured from the scenes to the correct positions on the mesh models, after estimated the correspondence between the camera images and the mesh models.
Published in: 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO)
Date of Conference: 03-07 December 2016
Date Added to IEEE Xplore: 02 March 2017
INSPEC Accession Number: 16709621
DOI: 10.1109/ROBIO.2016.7866352
Publisher: IEEE
Conference Location: Qingdao, China