Lightweight Vehicle Detection Based on Mamba_ViT

被引:0
|
作者
Song, Ze [1 ]
Wang, Yuhai [1 ]
Xu, Shuobo [1 ]
Wang, Peng [1 ]
Liu, Lele [1 ]
机构
[1] Shandong Jiaotong Univ, Sch Informat & Elect Engn, Jinan 250357, Peoples R China
关键词
artificial intelligence; deep learning; object detection; vehicle detection; lightweight;
D O I
10.3390/s24227138
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Vehicle detection algorithms are essential for intelligent traffic management and autonomous driving systems. Current vehicle detection algorithms largely rely on deep learning techniques, enabling the automatic extraction of vehicle image features through convolutional neural networks (CNNs). However, in real traffic scenarios, relying only on a single feature extraction unit makes it difficult to fully understand the vehicle information in the traffic scenario, thus affecting the vehicle detection effect. To address this issue, we propose a lightweight vehicle detection algorithm based on Mamba_ViT. First, we introduce a new feature extraction architecture (Mamba_ViT) that separates shallow and deep features and processes them independently to obtain a more complete contextual representation, ensuring comprehensive and accurate feature extraction. Additionally, a multi-scale feature fusion mechanism is employed to enhance the integration of shallow and deep features, leading to the development of a vehicle detection algorithm named Mamba_ViT_YOLO. The experimental results on the UA-DETRAC dataset show that our proposed algorithm improves mAP@50 by 3.2% compared to the latest YOLOv8 algorithm, while using only 60% of the model parameters.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Vehicle detection algorithm based on lightweight YOLOX
    Cong Xiong
    Anning Yu
    Senhao Yuan
    Xinghua Gao
    Signal, Image and Video Processing, 2023, 17 : 1793 - 1800
  • [2] A Lightweight Intrusion Detection System for Vehicular Networks Based on an Improved ViT Model
    Wang, Shaoqiang
    Zheng, Baosen
    Liu, Zhaoyuan
    Fan, Ziyao
    Liu, Yubao
    Dai, Yinfei
    IEEE ACCESS, 2024, 12 : 118842 - 118856
  • [3] Vehicle detection algorithm based on lightweight YOLOX
    Xiong, Cong
    Yu, Anning
    Yuan, Senhao
    Gao, Xinghua
    SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (05) : 1793 - 1800
  • [4] YOLO-ViT-Based Method for Unmanned Aerial Vehicle Infrared Vehicle Target Detection
    Zhao, Xiaofeng
    Xia, Yuting
    Zhang, Wenwen
    Zheng, Chao
    Zhang, Zhili
    REMOTE SENSING, 2023, 15 (15)
  • [5] A lightweight network for vehicle detection based on embedded system
    Wu, Huanhuan
    Hua, Yuantao
    Zou, Hua
    Ke, Gang
    JOURNAL OF SUPERCOMPUTING, 2022, 78 (16): : 18209 - 18224
  • [6] Dense Road Vehicle Detection Based on Lightweight ConvLSTM
    Jin, Zhi
    Zhang, Qian
    Li, Xiying
    Computer Engineering and Applications, 2023, 59 (08) : 89 - 96
  • [7] A lightweight network for vehicle detection based on embedded system
    Huanhuan Wu
    Yuantao Hua
    Hua Zou
    Gang Ke
    The Journal of Supercomputing, 2022, 78 : 18209 - 18224
  • [8] HCFormer: A Lightweight Pest Detection Model Combining CNN and ViT
    Zeng, Meiqi
    Chen, Shaonan
    Liu, Hongshan
    Wang, Weixing
    Xie, Jiaxing
    AGRONOMY-BASEL, 2024, 14 (09):
  • [9] Daily runoff prediction based on lightweight Mamba with partial normalization
    Jia, Donghuai
    Li, Weide
    Huang, Di
    Chen, Shukai
    HYDROLOGY RESEARCH, 2024, 55 (12): : 1182 - 1196
  • [10] PWDViTNet: A lightweight early pine wilt disease detection model based on the fusion of ViT and CNN
    Chen, Zhichao
    Lin, Haifeng
    Bai, Di
    Qian, Jingjing
    Zhou, Hongping
    Gao, Yunya
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2025, 230