SLAM-PYE: Tightly coupled GNSS-binocular-inertial fusion for pitaya positioning, counting, and yield estimation

被引:0
|
作者
Wang, Hongjie [1 ]
Hong, Xiangyu [1 ]
Qin, Linlin [1 ]
Shi, Chun [1 ]
Wu, Gang [1 ]
机构
[1] Univ Sci & Technol China, Dept Automat, 443 Huangshan Rd, Hefei 230027, Anhui, Peoples R China
关键词
Dynamic fruit localization; Radius estimation; Probabilistic factor graph; Sensor fusion; Multi-view measurement;
D O I
10.1016/j.compag.2024.109177
中图分类号
S [农业科学];
学科分类号
09 ;
摘要
Accurate pre-harvest yield estimation facilitates the more rational allocation of resources. Previous methods of estimating fruit position, either directly from hardware or through Structure from Motion (SFM), encounter challenges such as high hardware costs, extensive computational resources, and repetitive counting. In this paper, we present a graph optimization-based system that tightly couples dual-frequency GNSS raw measurements and visual-inertial data to estimate pitaya state, including its position and radius. Firstly, the system utilizes a coarse-to-fine approach to estimate the transformations on three axes and align three complementary sensors to a unified coordinate system, thus reducing the computational complexity of pure visual navigation. Secondly, for the first time, this system analytically calculates the pitaya state using the single-view measurement output from the binocular camera, replacing expensive lidar. It employs this calculated state as the initial value, then optimizes the pitaya state and eliminates outliers by multiple reprojection residuals from multi-view measurements. Next, for the first time, we integrate ionospheric- free pseudorange and Doppler residuals into the visual-inertial factor graph, thereby mitigating multipath interference in double-layer film greenhouse and providing a unique ID and position for each pitaya. Finally, we calculate the weight of each pitaya using a cubic polynomial based on its radius and estimate the overall greenhouse yield by summing all individual weights. In greenhouse experiments, our system achieved an Root Mean Square Error (RMSE) of 7 cm for position estimation, 7 mm for radius estimation, and a weight Mean Absolute Percentage Error (MAPE) of about 16% for individual pitaya. Overall, our system can provide costeffective, real-time, non-repetitive, and low-missing pitaya yield estimation to assist greenhouse managers in decision-making.
引用
收藏
页数:15
相关论文
共 3 条
  • [1] GVINS: Tightly Coupled GNSS-Visual-Inertial Fusion for Smooth and Consistent State Estimation
    Cao, Shaozu
    Lu, Xiuyuan
    Shen, Shaojie
    IEEE TRANSACTIONS ON ROBOTICS, 2022, 38 (04) : 2004 - 2021
  • [2] A LiDAR-Inertial SLAM Tightly Coupled With Dropout-Tolerant GNSS Fusion for Autonomous Mine Service Vehicles
    Wang Y.
    Lou Y.
    Song W.
    Zhan B.
    Xia F.
    Duan Q.
    IEEE Transactions on Instrumentation and Measurement, 2023, 72 : 1 - 15
  • [3] Small UAV's position and attitude estimation using tightly coupled multi baseline multi constellation GNSS and inertial sensor fusion
    Farkas, Marton
    Vanek, Balint
    Rozsa, Szabolcs
    2019 IEEE 6TH INTERNATIONAL WORKSHOP ON METROLOGY FOR AEROSPACE (METROAEROSPACE), 2019, : 176 - 181