Multispectral Plant Disease Detection with Vision Transformer-Convolutional Neural Network Hybrid Approaches

被引:9
|
作者
De Silva, Malithi [1 ]
Brown, Dane [1 ]
机构
[1] Rhodes Univ, Dept Comp Sci, Hamilton Bldg,Prince Alfred St, ZA-6139 Grahamstown, South Africa
关键词
plant disease identification; deep-learning; CNN; ViT; multispectral images; NIR; CNN;
D O I
10.3390/s23208531
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Plant diseases pose a critical threat to global agricultural productivity, demanding timely detection for effective crop yield management. Traditional methods for disease identification are laborious and require specialised expertise. Leveraging cutting-edge deep learning algorithms, this study explores innovative approaches to plant disease identification, combining Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) to enhance accuracy. A multispectral dataset was meticulously collected to facilitate this research using six 50 mm filter filters, covering both the visible and several near-infrared (NIR) wavelengths. Among the models employed, ViT-B16 notably achieved the highest test accuracy, precision, recall, and F1 score across all filters, with averages of 83.3%, 90.1%, 90.75%, and 89.5%, respectively. Furthermore, a comparative analysis highlights the pivotal role of balanced datasets in selecting the appropriate wavelength and deep learning model for robust disease identification. These findings promise to advance crop disease management in real-world agricultural applications and contribute to global food security. The study underscores the significance of machine learning in transforming plant disease diagnostics and encourages further research in this field.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] Efficient knowledge distillation for hybrid models: A vision transformer-convolutional neural network to convolutional neural network approach for classifying remote sensing images
    Song, Huaxiang
    Yuan, Yuxuan
    Ouyang, Zhiwei
    Yang, Yu
    Xiang, Hui
    IET CYBER-SYSTEMS AND ROBOTICS, 2024, 6 (03)
  • [2] Vision transformer meets convolutional neural network for plant disease classification
    Thakur, Poornima Singh
    Chaturvedi, Shubhangi
    Khanna, Pritee
    Sheorey, Tanuja
    Ojha, Aparajita
    ECOLOGICAL INFORMATICS, 2023, 77
  • [3] A hybrid Framework for plant leaf disease detection and classification using convolutional neural networks and vision transformer
    Aboelenin, Sherihan
    Elbasheer, Foriaa Ahmed
    Eltoukhy, Mohamed Meselhy
    El-Hady, Walaa M.
    Hosny, Khalid M.
    COMPLEX & INTELLIGENT SYSTEMS, 2025, 11 (02)
  • [4] Attention-guided hybrid transformer-convolutional neural network for underwater image super-resolution
    Zhan, Zihan
    Li, Chaofeng
    Zhang, Yuqi
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (01)
  • [5] Single-image super-resolution using lightweight transformer-convolutional neural network hybrid model
    Liu, Yuanyuan
    Yue, Mengtao
    Yan, Han
    Zhu, Lu
    IET IMAGE PROCESSING, 2023, 17 (10) : 2881 - 2893
  • [6] Using a Hybrid Convolutional Neural Network with a Transformer Model for Tomato Leaf Disease Detection
    Chen, Zhichao
    Wang, Guoqiang
    Lv, Tao
    Zhang, Xu
    AGRONOMY-BASEL, 2024, 14 (04):
  • [7] Plant disease detection using hybrid model based on convolutional autoencoder and convolutional neural network
    Bedi, Punam
    Gole, Pushkar
    ARTIFICIAL INTELLIGENCE IN AGRICULTURE, 2021, 5 (05): : 90 - 101
  • [8] ETCNN: An ensemble transformer-convolutional neural network for automatic analysis of fetal heart rate
    Wu, Qingjian
    Lu, Yaosheng
    Kang, Xue
    Wang, Huijin
    Zheng, Zheng
    Bai, Jieyun
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 96
  • [9] Hybrid network of convolutional neural network and transformer for deepfake geographic image detection
    Liu, Xiaoyong
    Dong, Xiaofei
    Xie, Feng
    Lu, Pei
    Lu, Xi
    Jiang, Mingzhong
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (02)
  • [10] Exploring the synergies of hybrid convolutional neural network and Vision Transformer architectures for computer vision: A survey
    Haruna, Yunusa
    Qin, Shiyin
    Chukkol, Abdulrahman Hamman Adama
    Yusuf, Abdulganiyu Abdu
    Bello, Isah
    Lawan, Adamu
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 144