Multispectral Plant Disease Detection with Vision Transformer-Convolutional Neural Network Hybrid Approaches

被引:9
|
作者
De Silva, Malithi [1 ]
Brown, Dane [1 ]
机构
[1] Rhodes Univ, Dept Comp Sci, Hamilton Bldg,Prince Alfred St, ZA-6139 Grahamstown, South Africa
关键词
plant disease identification; deep-learning; CNN; ViT; multispectral images; NIR; CNN;
D O I
10.3390/s23208531
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Plant diseases pose a critical threat to global agricultural productivity, demanding timely detection for effective crop yield management. Traditional methods for disease identification are laborious and require specialised expertise. Leveraging cutting-edge deep learning algorithms, this study explores innovative approaches to plant disease identification, combining Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) to enhance accuracy. A multispectral dataset was meticulously collected to facilitate this research using six 50 mm filter filters, covering both the visible and several near-infrared (NIR) wavelengths. Among the models employed, ViT-B16 notably achieved the highest test accuracy, precision, recall, and F1 score across all filters, with averages of 83.3%, 90.1%, 90.75%, and 89.5%, respectively. Furthermore, a comparative analysis highlights the pivotal role of balanced datasets in selecting the appropriate wavelength and deep learning model for robust disease identification. These findings promise to advance crop disease management in real-world agricultural applications and contribute to global food security. The study underscores the significance of machine learning in transforming plant disease diagnostics and encourages further research in this field.
引用
收藏
页数:22
相关论文
共 50 条
  • [41] Plant Disease Detection by Leaf Image Classification Using Convolutional Neural Network
    Bharali, Parismita
    Bhuyan, Chandrika
    Boruah, Abhijit
    INFORMATION, COMMUNICATION AND COMPUTING TECHNOLOGY (ICICCT 2019), 2019, 1025 : 194 - 205
  • [42] Detection of Plant Leaf Disease by Generative Adversarial and Deep Convolutional Neural Network
    Deshpande R.
    Patidar H.
    Journal of The Institution of Engineers (India): Series B, 2023, 104 (5) : 1043 - 1052
  • [43] A Deep Convolutional Neural Network with Batch Normalization Approach for Plant Disease Detection
    Albogamy, R. Fahad
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2021, 21 (09): : 51 - 62
  • [44] Automatic plant disease detection using computationally efficient convolutional neural network
    Rizwan, Muhammad
    Bibi, Samina
    Ul Haq, Sana
    Asif, Muhammad
    Jan, Tariqullah
    Zafar, Mohammad Haseeb
    ENGINEERING REPORTS, 2024,
  • [45] An Improved Deep Residual Convolutional Neural Network for Plant Leaf Disease Detection
    Pandian, Arun J.
    Kanchanadevi, K.
    Rajalakshmi, N. R.
    Arulkumaran, G.
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [46] Using a novel convolutional neural network for plant pests detection and disease classification
    Shafik, Wasswa
    Tufail, Ali
    Liyanage, Chandratilak De Silva
    Apong, Rosyzie Anna Awg Haji Mohd
    JOURNAL OF THE SCIENCE OF FOOD AND AGRICULTURE, 2023, 103 (12) : 5849 - 5861
  • [47] Plant-CNN-ViT: Plant Classification with Ensemble of Convolutional Neural Networks and Vision Transformer
    Lee, Chin Poo
    Lim, Kian Ming
    Song, Yu Xuan
    Alqahtani, Ali
    PLANTS-BASEL, 2023, 12 (14):
  • [48] FPGA-Based Unified Accelerator for Convolutional Neural Network and Vision Transformer
    Li T.
    Zhang F.
    Wang S.
    Cao W.
    Chen L.
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2024, 46 (06): : 2663 - 2672
  • [49] Plug-and-play adapter for fusing convolutional neural network with vision transformer
    Chen, Bin
    Fan, Xianlian
    Wu, Shiqian
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (05)
  • [50] Integration of Convolutional Neural Network and Vision Transformer for gesture recognition using sEMG
    Liu, Xiaoguang
    Hu, Lijian
    Tie, Liang
    Jun, Li
    Wang, Xiaodong
    Liu, Xiuling
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 98