Adaptive pruning threshold based convolutional neural network for object detection

被引:0
|
作者
Guo, Zhendong [1 ]
Li, Xiaohong [1 ]
Zhang, Kai [1 ]
Guo, Xiaoyong [1 ]
机构
[1] Tianjin Univ Sci & Technol, Coll Elect Informat & Automat, 1038 Dagu Nanlu, Tianjin 300457, Peoples R China
基金
中国国家自然科学基金;
关键词
Object detection; adaptive pruning threshold; channel pruning; layer pruning;
D O I
10.3233/JIFS-213002
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, it is proposed that the redundancy in convolutional neural networks of object detection can be effectively removed via an adaptive pruning threshold method (APTCNN) which is associated with scaling factors in batch normalization layers. In this way, the channel pruning can be done iteratively with varying pruning threshold until the satisfactory performance is obtained. The method is also useful for identifying the unimportant convolutional layers. Therefore it can be applied for layer pruning. The experiments are conducted on three benchmark object detection datasets. APTCNN is verified for pruning the backbone network of object detectors YOLOv3 and YOLOv3-spp. It is shown that the importance of channels and layers are accurately ranked by the proposed adaptive threshold. For the channel pruning, our method reduces the size of YOLOv3 and YOLOv3-spp by 32x and 48x respectively, and accelerates 1.7x and 1.9x respectively. However, the accuracy suffers only 0.77% and 1.32% loss, respectively. As a result, the redundancy in the network architecture can be efficiently removed yielding a slimmed model that has lower computing operations, reduced size, and without compromising accuracy.
引用
收藏
页码:7821 / 7831
页数:11
相关论文
共 50 条
  • [11] Channel pruning based on convolutional neural network sensitivity
    Yang, Chenbin
    Liu, Huiyi
    NEUROCOMPUTING, 2022, 507 : 97 - 106
  • [12] Convolutional neural network pruning based on misclassification cost
    Ahmadluei, Saeed
    Faez, Karim
    Masoumi, Behrooz
    JOURNAL OF SUPERCOMPUTING, 2023, 79 (18): : 21185 - 21234
  • [13] Convolutional neural network pruning based on misclassification cost
    Saeed Ahmadluei
    Karim Faez
    Behrooz Masoumi
    The Journal of Supercomputing, 2023, 79 : 21185 - 21234
  • [14] Research on Optimization of Object Detection Technology Based on Convolutional Neural Network
    Yang Xue
    Huang Wanjun
    Yu Hongyang
    2020 13TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID 2020), 2020, : 13 - 16
  • [15] Convolutional Neural Network Based Automatic Object Detection on Aerial Images
    Sevo, Igor
    Avramovic, Aleksej
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2016, 13 (05) : 740 - 744
  • [16] Research on Vehicle Object Detection Method Based on Convolutional Neural Network
    Zhang, Qinghui
    Wan, Chenxia
    Bian, Shanfeng
    2018 11TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID), VOL 1, 2018, : 271 - 274
  • [17] An FPGA Realization of a Deep Convolutional Neural Network Using a Threshold Neuron Pruning
    Fujii, Tomoya
    Sato, Simpei
    Nakahara, Hiroki
    Motomura, Masato
    APPLIED RECONFIGURABLE COMPUTING, 2017, 10216 : 268 - 280
  • [18] The Network Intrusion Detection Based on Reasoning and Guided Adaptive Convolutional Neural Network
    Wang, Tiezhu
    Qi, Lin
    Liu, Pengfei
    Gong, Zhiqiang
    Li, Liang
    BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2020, 126 : 234 - 234
  • [19] Variational Convolutional Neural Network Pruning
    Zhao, Chenglong
    Ni, Bingbing
    Zhang, Jian
    Zhao, Qiwei
    Zhang, Wenjun
    Tian, Qi
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 2775 - 2784
  • [20] Convolutional Neural Network Pruning: A Survey
    Xu, Sheng
    Huang, Anran
    Chen, Lei
    Zhang, Baochang
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 7458 - 7463