Extraction of 3D distribution of potato plant CWSI based on thermal infrared image and binocular stereovision system

被引:6
|
作者
Wang, Liuyang [1 ]
Miao, Yanlong [2 ]
Han, Yuxiao [1 ]
Li, Han [1 ]
Zhang, Man [2 ]
Peng, Cheng [1 ]
机构
[1] China Agr Univ, Key Lab Agr Informat Acquisit Technol, Minist Agr & Rural Affairs, Beijing, Peoples R China
[2] China Agr Univ, Key Lab Smart Agr Syst Integrat Res, Minist Educ, Beijing, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
water stress; automation; photogrammetry; image registration; 3D distribution; COLOR SPACE; STRESS; THERMOGRAPHY; TEMPERATURE; FUSION; FIELD;
D O I
10.3389/fpls.2022.1104390
中图分类号
Q94 [植物学];
学科分类号
071001 ;
摘要
As the largest component of crops, water has an important impact on the growth and development of crops. Timely, rapid, continuous, and non-destructive detection of crop water stress status is crucial for crop water-saving irrigation, production, and breeding. Indices based on leaf or canopy temperature acquired by thermal imaging are widely used for crop water stress diagnosis. However, most studies fail to achieve high-throughput, continuous water stress detection and mostly focus on two-dimension measurements. This study developed a low-cost three-dimension (3D) motion robotic system, which is equipped with a designed 3D imaging system to automatically collect potato plant data, including thermal and binocular RGB data. A method is developed to obtain 3D plant fusion point cloud with depth, temperature, and RGB color information using the acquired thermal and binocular RGB data. Firstly, the developed system is used to automatically collect the data of the potato plants in the scene. Secondly, the collected data was processed, and the green canopy was extracted from the color image, which is convenient for the speeded-up robust features algorithm to detect more effective matching features. Photogrammetry combined with structural similarity index was applied to calculate the optimal homography transform matrix between thermal and color images and used for image registration. Thirdly, based on the registration of the two images, 3D reconstruction was carried out using binocular stereo vision technology to generate the original 3D point cloud with temperature information. The original 3D point cloud data were further processed through canopy extraction, denoising, and k-means based temperature clustering steps to optimize the data. Finally, the crop water stress index (CWSI) of each point and average CWSI in the canopy were calculated, and its daily variation and influencing factors were analyzed in combination with environmental parameters. The developed system and the proposed method can effectively detect the water stress status of potato plants in 3D, which can provide support for analyzing the differences in the three-dimensional distribution and spatial and temporal variation patterns of CWSI in potato.
引用
收藏
页数:20
相关论文
共 50 条
  • [21] Fusion of Infrared Thermal Image and Visible Image for 3D Thermal Model Reconstruction Using Smartphone Sensors
    Yang, Ming-Der
    Su, Tung-Ching
    Lin, Hung-Yu
    SENSORS, 2018, 18 (07)
  • [22] Underwater Target Detection and 3D Reconstruction System Based on Binocular Vision
    Huo, Guanying
    Wu, Ziyin
    Li, Jiabiao
    Li, Shoujun
    SENSORS, 2018, 18 (10)
  • [23] Design of Binocular Stereo Vision System With Parallel Optical Axesand Image 3D Reconstruction
    Ma, Kai
    Zhou, Hongping
    Li, Jian
    Liu, Hongling
    2019 CHINA-QATAR INTERNATIONAL WORKSHOP ON ARTIFICIAL INTELLIGENCE AND APPLICATIONS TO INTELLIGENT MANUFACTURING (AIAIM), 2019, : 59 - 62
  • [24] A wavelet based 3D image compression system
    Montgomery, D
    Murtagh, F
    Amira, A
    SEVENTH INTERNATIONAL SYMPOSIUM ON SIGNAL PROCESSING AND ITS APPLICATIONS, VOL 1, PROCEEDINGS, 2003, : 65 - 68
  • [25] 3D image based collaboration system for telemedicine
    Kobayashi, T
    Satou, S
    Jiang, H
    Fujii, T
    Sugou, N
    Mito, T
    Shibata, I
    BIOMEDICAL PHOTONICS AND OPTOELECTRONIC IMAGING, 2000, 4224 : 282 - 289
  • [26] 3D image based collaboration system for telemedicine
    Kobayashi, T
    Satou, S
    Jiang, H
    Fujii, T
    Sugou, N
    Mitou, T
    Shibata, I
    TELEMEDICINE: MEDICINE AND COMMUNICATION, 2001, : 13 - 22
  • [27] The Infrared Multispectral Image Simulation Research Based on 3D Scene
    Li, Bo
    Zhao, Huai-ci
    Du, Mei
    Lv, Jinfeng
    PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON ELECTRIC AND ELECTRONICS, 2013, : 137 - 140
  • [28] DIC measurement method based on binocular stereo vision for image 3D displacement detection
    Dong, Xue
    JOURNAL OF MEASUREMENTS IN ENGINEERING, 2023, 11 (04) : 437 - 452
  • [29] Blind 3D image quality assessment based on self-similarity of binocular features
    Zhou, Wujie
    Zhang, Shuangshuang
    Pan, Ting
    Yu, Lu
    Qiu, Weiwei
    Zhou, Yang
    Luo, Ting
    NEUROCOMPUTING, 2017, 224 : 128 - 134
  • [30] 3D IMAGE QUALITY INDEX USING SDP-BASED BINOCULAR PERCEPTION MODEL
    Ko, Hyunsuk
    Kim, Chang-Su
    Choi, Seo Young
    Kuo, C. -C. Jay
    2013 IEEE 11TH IVMSP WORKSHOP: 3D IMAGE/VIDEO TECHNOLOGIES AND APPLICATIONS (IVMSP 2013), 2013,