Inter frame point clouds registration algorithm for pose optimization of depth camera

被引:0
|
作者
Li X.-D. [1 ,3 ]
Gao H.-W. [1 ]
Sun L. [2 ,3 ]
机构
[1] College of Mechanical and Electrical Engineering, Northeast Forestry University, Harbin
[2] College of Forestry, Northeast Forestry University, Harbin
[3] Northern Forest Fire Management Key Laboratory of the State Forestry and Grassland Bureau, Northeast Forestry University, Harbin
来源
Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science) | 2019年 / 53卷 / 09期
关键词
3D vision; Graph-based structure; Inter frame registration; Pose; Time of flight (TOF) camera;
D O I
10.3785/j.issn.1008-973X.2019.09.014
中图分类号
学科分类号
摘要
TOF (time of flight) camera can collect gray and depth images simultaneously to optimize the estimation of camera pose. Graph-based adjustment structure was applied to optimize the poses of the TOF camera in acquiring several frames. Registration between frames is a key operation which determines both the efficiency and effectiveness of the camera pose optimization. Scale invariant features were detected from a pair of images and matched subsequently. After the 2D feature points were extended into 3D space, two point clouds were registered in terms of relative positions between the features and the normal 3D points. Among all of the point clouds participating in the optimization of camera pose, any two point clouds were registered pair by pair using the proposed registering method. Lastly, the graph based algorithm was employed to adjust the camera poses, with inputs of the valid pairs of registered point clouds. Results demonstrated that the proposed method can improve the precision of the optimized camera pose, and the estimating efficiency is guaranteed. © 2019, Zhejiang University Press. All right reserved.
引用
收藏
页码:1749 / 1758
页数:9
相关论文
共 23 条
  • [1] Lange R., 3D time-of-flight distance measurement with custom solid-state image sensors in CMOS/CCD technology, pp. 14-56, (2000)
  • [2] Wang Y., Piao Y., Sun R.-C., Depth image super-resolution construction combined with high-resolution color image of the same scene, Acta Optica Sinica, 37, 8, pp. 102-108, (2017)
  • [3] Li S.-R., Li Q., Li H.-Y., Et al., Real-time accurate 3D reconstruction based on Kinect v2, Journal of Software, 27, 10, pp. 2519-2529, (2016)
  • [4] Henry P., Krainin M., Herbst E., Et al., RGB-D mapping: using Kinect-style depth cameras for dense 3D modeling of indoor environments, International Journal of Robotics Research, 31, 5, pp. 647-663, (2012)
  • [5] Foix S., Aleny G., Andrade-Cetto J., Et al., Object modeling using a TOF camera under an uncertainty reduction approach, Proceedings of IEEE International Conference on Robotics and Automation, pp. 1306-1312, (2010)
  • [6] Dellen B., Aleny G., Foix S., Et al., 3D object reconstruction from swissranger sensor data using a spring-mass model, Proceedings of the Fourth International Conference on Computer Vision Theory and Applications, pp. 368-372, (2009)
  • [7] Sarker A., Gepperth A., Handmann U., Et al., Dynamic hand gesture recognition for mobile systems using deep LSTM, Proceedings of the International Conference on Intelligent Human Computer Interaction, pp. 19-31, (2017)
  • [8] Gokturk S.B., Tomasi C., 3D head tracking based on recognition and interpolation usinga time-offlight depth sensor, Proceedings of the 18th IEEE Conference on Computer Vision and Pattern Recognition, pp. 211-217, (2004)
  • [9] Leonard J., Durran-Whyte H., Simultaneous map building and localization for an autonomous mobile robot, Proceedings of the IEEE Conference on Intelligent Robots and Systems, pp. 1442-1447, (1991)
  • [10] Besl P.J., Mckay N.D., A method for registration of 3D shapes, IEEE Transactions on Pattern Analysis and Machine Intelligence, 14, 2, pp. 239-256, (1992)