Calibration of RGBD-Sensors

The rgb-colored coordinate system is tracked with our calibrated multi-Kinect-V2 setup and precisely coincides with the magenta coordinate system which is tracked with an optical tracking system – our joint coordinate system

Abstract

We present an integrated approach for the calibration and registration of color and depth (RGBD) sensors into a joint coordinate system. Our application domain is 3D telepresence where users in front of a three-dimensional display need to be captured from all directions. The captured data is used to virtually reconstruct the group of people at a remote location. One key requirement of such applications is that contributions from different color and depth cameras match, as closely as possible, in spatially overlapping or adjacent regions. Our method employs a tracked checkerboard to establish a number of correspondences between positions in color and depth camera space and in world space. These correspondences are used to construct a single calibration and registration volume per RGBD sensor which maps raw depth sensor values in a single step into a joint coordinate system and to their associated color values. This approach considerably reduces reconstruction latency by omitting expensive image rectification processes during runtime. Furthermore, our evaluation demonstrates a high measurement accuracy with an average 3D error below 3 mm and an average texture deviation smaller than 0.5 pixels for a space of about 1.5 m x 1.8 m x 1.5 m.

Publications

  • Beck, S., Froehlich, B.
    Sweeping-Based Volumetric Calibration and Registration of Multiple
    RGBD-Sensors for 3D Capturing Systems. 

    In Proceedings of IEEE VR 2017, Los Angeles, USA, March 2017, pp. 167-176.
    [preprint] [video]
  • Beck, S., Froehlich, B.
    Volumetric Calibration and Registration of Multiple RGBD-Sensors into a
    Joint Coordinate System. 

    In Proceedings of IEEE Symposium on 3D User Interfaces (3DUI), Arles, France, pp. 89-96, March 2015.
    DOI=10.1109/3DUI.2015.7131731
    [preprint] [video]
  • Beck, S., Froehlich, B.
    Volumetric Calibration and Registration of RGBD-Sensors. 
    Virtual Reality (VR), 2015 IEEE, Arles, pp. 151-152, March 2015.
    DOI=10.1109/VR.2015.7223340
    [preprint]