Extraction of 3D distribution of potato plant CWSI based on thermal infrared image and binocular stereovision system

被引:6
|
作者
Wang, Liuyang [1 ]
Miao, Yanlong [2 ]
Han, Yuxiao [1 ]
Li, Han [1 ]
Zhang, Man [2 ]
Peng, Cheng [1 ]
机构
[1] China Agr Univ, Key Lab Agr Informat Acquisit Technol, Minist Agr & Rural Affairs, Beijing, Peoples R China
[2] China Agr Univ, Key Lab Smart Agr Syst Integrat Res, Minist Educ, Beijing, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
water stress; automation; photogrammetry; image registration; 3D distribution; COLOR SPACE; STRESS; THERMOGRAPHY; TEMPERATURE; FUSION; FIELD;
D O I
10.3389/fpls.2022.1104390
中图分类号
Q94 [植物学];
学科分类号
071001 ;
摘要
As the largest component of crops, water has an important impact on the growth and development of crops. Timely, rapid, continuous, and non-destructive detection of crop water stress status is crucial for crop water-saving irrigation, production, and breeding. Indices based on leaf or canopy temperature acquired by thermal imaging are widely used for crop water stress diagnosis. However, most studies fail to achieve high-throughput, continuous water stress detection and mostly focus on two-dimension measurements. This study developed a low-cost three-dimension (3D) motion robotic system, which is equipped with a designed 3D imaging system to automatically collect potato plant data, including thermal and binocular RGB data. A method is developed to obtain 3D plant fusion point cloud with depth, temperature, and RGB color information using the acquired thermal and binocular RGB data. Firstly, the developed system is used to automatically collect the data of the potato plants in the scene. Secondly, the collected data was processed, and the green canopy was extracted from the color image, which is convenient for the speeded-up robust features algorithm to detect more effective matching features. Photogrammetry combined with structural similarity index was applied to calculate the optimal homography transform matrix between thermal and color images and used for image registration. Thirdly, based on the registration of the two images, 3D reconstruction was carried out using binocular stereo vision technology to generate the original 3D point cloud with temperature information. The original 3D point cloud data were further processed through canopy extraction, denoising, and k-means based temperature clustering steps to optimize the data. Finally, the crop water stress index (CWSI) of each point and average CWSI in the canopy were calculated, and its daily variation and influencing factors were analyzed in combination with environmental parameters. The developed system and the proposed method can effectively detect the water stress status of potato plants in 3D, which can provide support for analyzing the differences in the three-dimensional distribution and spatial and temporal variation patterns of CWSI in potato.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] 3D Temperature Distribution Model Based on Thermal Infrared Image
    Jia, Tong
    Wang, HongYu
    Chen, DongYue
    Hou, MingYa
    Wu, ChengDong
    Tu, Mo
    Jiang, Yuli
    Zhang, Shuai
    JOURNAL OF SENSORS, 2017, 2017
  • [2] 3D Reconstruction of Fundus Vascular Structure Based on Binocular Stereovision
    Yu, Meng
    Meng, Hao
    Liu, Guo-Zhong
    2018 4TH ANNUAL INTERNATIONAL CONFERENCE ON NETWORK AND INFORMATION SYSTEMS FOR COMPUTERS (ICNISC 2018), 2018, : 140 - 143
  • [3] Research on 3D Reconstruction of Binocular Vision Based on Thermal Infrared
    Li, Huaizhou
    Wang, Shuaijun
    Bai, Zhenpeng
    Wang, Hong
    Li, Sen
    Wen, Shupei
    SENSORS, 2023, 23 (17)
  • [4] Wavelet transform based 3D scattered data processing in binocular micro stereovision system
    Liu, C
    Pei, W
    Xia, ZY
    Niyokindi, S
    Song, JC
    Wang, LD
    ADVANCES IN ABRASIVE TECHNOLOGY VIII, 2005, 291-292 : 673 - 678
  • [5] Automated thermal 3D reconstruction based on a robot equipped with uncalibrated infrared stereovision cameras
    Sentenac, T.
    Bugarin, F.
    Ducarouge, B.
    Devy, M.
    ADVANCED ENGINEERING INFORMATICS, 2018, 38 : 203 - 215
  • [6] 3D lane detection system based on stereovision
    Nedevschi, S
    Schmidt, R
    Graf, T
    Danescu, R
    Frentiu, D
    Marita, T
    Oniga, F
    Pocol, C
    ITSC 2004: 7TH INTERNATIONAL IEEE CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, PROCEEDINGS, 2004, : 161 - 166
  • [7] A 3D Passive Optical Localization System Based on Binocular Infrared Cameras
    Zeng, Yadan
    Dai, Houde
    Zheng, Minghu
    Su, Shijian
    Wu, Zhouxin
    Xia, Xuke
    Lin, Zhirong
    Wu, Qingxiang
    2016 IEEE INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION (ICIA), 2016, : 368 - 373
  • [8] Automatic 3D reconstruction and texture extraction for 3D building models from thermal infrared image sequences.
    Hoegner, L.
    Stilla, U.
    13TH QUANTITATIVE INFRARED THERMOGRAPHY CONFERENCE, 2016, : 322 - 331
  • [9] Integration of 3D stereovision system in image-guided radiotherapy: A DICOM-based method
    Liu, D.
    Li, S.
    MEDICAL PHYSICS, 2006, 33 (06) : 2039 - 2039
  • [10] Error Evaluation in a Stereovision-Based 3D Reconstruction System
    Abdelkrim Belhaoua
    Sophie Kohler
    Ernest Hirsch
    EURASIP Journal on Image and Video Processing, 2010