Deep Object Detection of Crop Weeds: Performance of YOLOv7 on a Real Case Dataset from UAV Images

被引:88
|
作者
Gallo, Ignazio [1 ]
Rehman, Anwar Ur [1 ]
Dehkordi, Ramin Heidarian [2 ]
Landro, Nicola [1 ]
La Grassa, Riccardo [3 ]
Boschetti, Mirco [2 ]
机构
[1] Univ Insubria, Dept Theoret & Appl Sci, I-20100 Varese, Italy
[2] CNR, Inst Electromagnet Sensing Environm, I-20133 Milan, Italy
[3] Italian Natl Inst Astrophys, I-00100 Rome, Italy
关键词
Deep Learning; Convolutional Neural Network; UAV imagery; object detection; YOLOv7; CONVOLUTIONAL NETWORKS; CLASSIFICATION;
D O I
10.3390/rs15020539
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Weeds are a crucial threat to agriculture, and in order to preserve crop productivity, spreading agrochemicals is a common practice with a potential negative impact on the environment. Methods that can support intelligent application are needed. Therefore, identification and mapping is a critical step in performing site-specific weed management. Unmanned aerial vehicle (UAV) data streams are considered the best for weed detection due to the high resolution and flexibility of data acquisition and the spatial explicit dimensions of imagery. However, with the existence of unstructured crop conditions and the high biological variation of weeds, it remains a difficult challenge to generate accurate weed recognition and detection models. Two critical barriers to tackling this challenge are related to (1) a lack of case-specific, large, and comprehensive weed UAV image datasets for the crop of interest, (2) defining the most appropriate computer vision (CV) weed detection models to assess the operationality of detection approaches in real case conditions. Deep Learning (DL) algorithms, appropriately trained to deal with the real case complexity of UAV data in agriculture, can provide valid alternative solutions with respect to standard CV approaches for an accurate weed recognition model. In this framework, this paper first introduces a new weed and crop dataset named Chicory Plant (CP) and then tests state-of-the-art DL algorithms for object detection. A total of 12,113 bounding box annotations were generated to identify weed targets (Mercurialis annua) from more than 3000 RGB images of chicory plantations, collected using a UAV system at various stages of crop and weed growth. Deep weed object detection was conducted by testing the most recent You Only Look Once version 7 (YOLOv7) on both the CP and publicly available datasets (Lincoln beet (LB)), for which a previous version of YOLO was used to map weeds and crops. The YOLOv7 results obtained for the CP dataset were encouraging, outperforming the other YOLO variants by producing value metrics of 56.6%, 62.1%, and 61.3% for the mAP@0.5 scores, recall, and precision, respectively. Furthermore, the YOLOv7 model applied to the LB dataset surpassed the existing published results by increasing the mAP@0.5 scores from 51% to 61%, 67.5% to 74.1%, and 34.6% to 48% for the total mAP, mAP for weeds, and mAP for sugar beets, respectively. This study illustrates the potential of the YOLOv7 model for weed detection but remarks on the fundamental needs of large-scale, annotated weed datasets to develop and evaluate models in real-case field circumstances.
引用
收藏
页数:17
相关论文
共 38 条
  • [21] YOLO-FNC: An Improved Method for Small Object Detection in Remote Sensing Images Based on YOLOv7
    Dang, Lanxue
    Liu, Gang
    Hou, Yan-e
    Han, Hongyu
    IAENG International Journal of Computer Science, 2024, 51 (09) : 1281 - 1290
  • [22] An Improved YOLOv7 Model for Surface Damage Detection on Wind Turbine Blades Based on Low-Quality UAV Images
    Liao, Yongkang
    Lv, Mingyang
    Huang, Mingyong
    Qu, Mingwei
    Zou, Kehan
    Chen, Lei
    Feng, Liang
    DRONES, 2024, 8 (09)
  • [23] ARF-YOLOv8: a novel real-time object detection model for UAV-captured images detection
    Zeng, Yalin
    Guo, Dongjin
    He, Weikai
    Zhang, Tian
    Liu, Zhongtao
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2024, 21 (04)
  • [24] Improved Ship Detection Algorithm from Satellite Images Using YOLOv7 and Graph Neural Network
    Patel, Krishna
    Bhatt, Chintan
    Mazzeo, Pier Luigi
    ALGORITHMS, 2022, 15 (12)
  • [25] Object Detection of UAV Images from Orthographic Perspective Based on Improved YOLOv5s
    Lu, Feng
    Li, Kewei
    Nie, Yunfeng
    Tao, Yejia
    Yu, Yihao
    Huang, Linbo
    Wang, Xing
    SUSTAINABILITY, 2023, 15 (19)
  • [26] Automated detection of sugarcane crop lines from UAV images using deep learning
    Ribeiro, Joao Batista
    da Silva, Renato Rodrigues
    Dias, Jocival Dantas
    Escarpinati, Mauricio Cunha
    Backes, Andre Ricardo
    INFORMATION PROCESSING IN AGRICULTURE, 2024, 11 (03): : 385 - 396
  • [27] MSC-YOLO: Improved YOLOv7 Based on Multi-Scale Spatial Context for Small Object Detection in UAV-View
    Tang, Xiangyan
    Ruan, Chengchun
    Li, Xiulai
    Li, Binbin
    Fu, Cebin
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 79 (01): : 983 - 1003
  • [28] MWSR-YLCA: Improved YOLOv7 Embedded with Attention Mechanism for Nasopharyngeal Carcinoma Detection from MR Images
    Wu, Huixin
    Zhao, Xin
    Han, Guanghui
    Li, Haojiang
    Kong, Yuhao
    Li, Jiahui
    ELECTRONICS, 2023, 12 (06)
  • [29] Performance Evaluation of Modified YOLOv5 Object Detectors for Crop-Weed Classification and Detection in Agriculture Images
    Sandip Sonawane
    Nitin N. Patil
    SN Computer Science, 6 (2)
  • [30] A deep learning model for the localization and extraction of brain tumors from MR images using YOLOv7 and grab cut algorithm
    Krishnapriya, Srigiri
    Karuna, Yepuganti
    FRONTIERS IN ONCOLOGY, 2024, 14