Extraction of 3D distribution of potato plant CWSI based on thermal infrared image and binocular stereovision system

被引:6
|
作者
Wang, Liuyang [1 ]
Miao, Yanlong [2 ]
Han, Yuxiao [1 ]
Li, Han [1 ]
Zhang, Man [2 ]
Peng, Cheng [1 ]
机构
[1] China Agr Univ, Key Lab Agr Informat Acquisit Technol, Minist Agr & Rural Affairs, Beijing, Peoples R China
[2] China Agr Univ, Key Lab Smart Agr Syst Integrat Res, Minist Educ, Beijing, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
water stress; automation; photogrammetry; image registration; 3D distribution; COLOR SPACE; STRESS; THERMOGRAPHY; TEMPERATURE; FUSION; FIELD;
D O I
10.3389/fpls.2022.1104390
中图分类号
Q94 [植物学];
学科分类号
071001 ;
摘要
As the largest component of crops, water has an important impact on the growth and development of crops. Timely, rapid, continuous, and non-destructive detection of crop water stress status is crucial for crop water-saving irrigation, production, and breeding. Indices based on leaf or canopy temperature acquired by thermal imaging are widely used for crop water stress diagnosis. However, most studies fail to achieve high-throughput, continuous water stress detection and mostly focus on two-dimension measurements. This study developed a low-cost three-dimension (3D) motion robotic system, which is equipped with a designed 3D imaging system to automatically collect potato plant data, including thermal and binocular RGB data. A method is developed to obtain 3D plant fusion point cloud with depth, temperature, and RGB color information using the acquired thermal and binocular RGB data. Firstly, the developed system is used to automatically collect the data of the potato plants in the scene. Secondly, the collected data was processed, and the green canopy was extracted from the color image, which is convenient for the speeded-up robust features algorithm to detect more effective matching features. Photogrammetry combined with structural similarity index was applied to calculate the optimal homography transform matrix between thermal and color images and used for image registration. Thirdly, based on the registration of the two images, 3D reconstruction was carried out using binocular stereo vision technology to generate the original 3D point cloud with temperature information. The original 3D point cloud data were further processed through canopy extraction, denoising, and k-means based temperature clustering steps to optimize the data. Finally, the crop water stress index (CWSI) of each point and average CWSI in the canopy were calculated, and its daily variation and influencing factors were analyzed in combination with environmental parameters. The developed system and the proposed method can effectively detect the water stress status of potato plants in 3D, which can provide support for analyzing the differences in the three-dimensional distribution and spatial and temporal variation patterns of CWSI in potato.
引用
收藏
页数:20
相关论文
共 50 条
  • [31] The initial study of LLS-based binocular stereo-vision system on underwater 3D image reconstruction in the laboratory
    Lin, Yu-Hsien
    Shou, Kuan-Po
    Huang, Lin-Jin
    JOURNAL OF MARINE SCIENCE AND TECHNOLOGY, 2017, 22 (03) : 513 - 532
  • [32] 3D spatial distortion model based on the Lagrange difference in a binocular visual system
    Xia, Zhongyuan
    Xia, Renbo
    Zhao, Jibin
    APPLIED OPTICS, 2023, 62 (08) : 1952 - 1960
  • [33] The initial study of LLS-based binocular stereo-vision system on underwater 3D image reconstruction in the laboratory
    Yu-Hsien Lin
    Kuan-Po Shou
    Lin-Jin Huang
    Journal of Marine Science and Technology, 2017, 22 : 513 - 532
  • [34] Active controlled exploration of 3D environmental models based on a binocular stereo system
    Burschka, D
    Farber, G
    8TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS, 1997 PROCEEDINGS - ICAR'97, 1997, : 971 - 977
  • [35] Calibration of 3D reconstruction system for liver surface based on binocular structured light
    Zhang F.
    Chen L.
    Yang X.
    Xue F.
    Sun L.
    Harbin Gongcheng Daxue Xuebao/Journal of Harbin Engineering University, 2022, 43 (10): : 1391 - 1398
  • [36] Animation Design System Based on 3D Image Technology
    Jiang, Fan
    Engineering Intelligent Systems, 2024, 32 (05): : 411 - 419
  • [37] Image-based 3D face modeling system
    Park, IK
    Zhang, H
    EURASIP JOURNAL ON APPLIED SIGNAL PROCESSING, 2005, 2005 (13) : 2072 - 2090
  • [38] A Public System for Image Based 3D Model Generation
    Tingdahl, David
    Van Gool, Luc
    COMPUTER VISION/COMPUTER GRAPHICS COLLABORATION TECHNIQUES, MIRAGE 2011, 2011, 6930 : 262 - 273
  • [39] Image-based 3D face modeling system
    Park, I.K. (pik@ieee.org), 1600, Hindawi Publishing Corporation (2005):
  • [40] Image-Based 3D Face Modeling System
    In Kyu Park
    Hui Zhang
    Vladimir Vezhnevets
    EURASIP Journal on Advances in Signal Processing, 2005