Precision 3-D Motion Tracking for Binocular Microscopic Vision System

被引:10
|
作者
Liu, Song [1 ]
Li, You-Fu [2 ,3 ]
机构
[1] Univ Southern Calif, Dept Elect Engn Electrophys, Los Angeles, CA 90089 USA
[2] City Univ Hong Kong, Dept Mech Engn, Hong Kong, Peoples R China
[3] City Univ Hong Kong, Shenzhen Res Inst, Shenzhen 518057, Peoples R China
关键词
Three-dimensional (3-D) motion tracking; Bayesian inference; binocular microscopic vision; depth of field (DOF) tracking; Kalman filtering;
D O I
10.1109/TIE.2019.2893849
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, a three-dimensional (3-D) motion tracking method is proposed for binocular microscopic vision system to precisely record the motion trajectories of millimeter size objects in the Cartesian space. Primarily two fundamental problems are solved. The first problem arises from the limited depth of field (DOF) of microscope. Considering the motion of the objects, the existing autofocusing methods requiring sequential images either in focus or defocus are not workable. Therefore, a one-shot prior autofocusing approach is desired, which needs to take the motion tendency of objects into account. Besides, the autofocusing process always lags behind the motion of objects, and there inevitably will be prediction deviation on the motion tendency of objects. This leads to the second problem to estimate the 3-Dmotion states from defocused images. In this paper, we first explain the defocusing process from the perspective of S-Transform, based on which the Bayesian inference inspired method to estimate the depth from defocus from one single image is derived thereafter. Afterwards, a motion states, including both the position and velocity, estimation approach is developed within the Kalman filter framework. The above two aspects mutually supply the necessary information for each other to be functional to accurately realize the DOF tracking and motion tracking of moving objects. Experiments were well-designed to validate the effectiveness of the proposed method, and experiments result showed a tracking precision of 3 mu m was achieved.
引用
收藏
页码:9339 / 9349
页数:11
相关论文
共 50 条
  • [31] Robust 3-D landmark tracking using trinocular vision
    Mallon, J
    Ghita, O
    Whelan, PF
    OPTP-IRELAND 2002: OPTICAL METROLOGY, IMAGING, AND MACHINE VISION, 2003, 4877 : 221 - 229
  • [32] A novel sensing and data fusion system for 3-d arm motion tracking inTelerehabilitation
    Tao, Yaqin
    Hu, Huosheng
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2008, 57 (05) : 1029 - 1040
  • [33] Accuracy and Precision of a Custom Camera-Based System for 2-D and 3-D Motion Tracking During Speech and Nonspeech Motor Tasks
    Feng, Yongqiang
    Max, Ludo
    JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 2014, 57 (02): : 426 - 438
  • [34] Moving Target Tracking and Measurement with a Binocular Vision System
    Yang, T. W.
    Zhu, K.
    Ruan, Q. Q.
    Han, J. D.
    2008 15TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MACHINE VISION IN PRACTICE (M2VIP), 2008, : 85 - +
  • [35] Minimum displacement thresholds for 3-D motion depend an the average binocular signal
    Sumnall, JH
    Harris, JM
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 1999, 40 (04) : S765 - S765
  • [36] Moving target tracking and measurement with a binocular vision system
    Yang, T. W.
    Zhu, K.
    Ruan, Q. Q.
    Han, J. D.
    INTERNATIONAL JOURNAL OF COMPUTER APPLICATIONS IN TECHNOLOGY, 2010, 39 (1-3) : 145 - 152
  • [37] Motion Planning for 3-D Target Tracking among Obstacles
    Bandyopadhyay, Tirthankar
    Ang, Marcelo H., Jr.
    Hsu, David
    ROBOTICS RESEARCH, 2010, 66 : 267 - 279
  • [38] Binocular vision-based 3-D trajectory following for autonomous robotic manipulation
    Chang, Wen-Chung
    ROBOTICA, 2007, 25 : 615 - 626
  • [39] 3-D Location of Tomato Based on Binocular Stereo Vision for Tomato Harvesting Robot
    Xiang, Rong
    Ying, Yibin
    Jiang, Huanyu
    Peng, Yongshi
    5TH INTERNATIONAL SYMPOSIUM ON ADVANCED OPTICAL MANUFACTURING AND TESTING TECHNOLOGIES: OPTOELECTRONIC MATERIALS AND DEVICES FOR DETECTOR, IMAGER, DISPLAY, AND ENERGY CONVERSION TECHNOLOGY, 2010, 7658
  • [40] Tracking 3-D coronary artery motion with biplane angiography
    Zhu, H
    Friedman, MH
    2002 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, PROCEEDINGS, 2002, : 605 - 608