A Pedestrian Detection Model Based on Binocular Information Fusion

被引:2
|
作者
Zhang, Juan [1 ]
Ma, Zhonggui [1 ]
Nuermaimaiti, Nuerxiati [1 ]
机构
[1] Univ Sci & Technol Beijing, Sch Comp & Commun Engn, Beijing, Peoples R China
关键词
Pedestrian detection; deep learning; binocular vision; PSMNet; Faster R-CNN;
D O I
10.1109/wocc.2019.8770601
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Pedestrian detection, as a special kind of target detection, is a research hotspot in the field of image processing and computer vision. Because monocular vision cannot obtain the depth information of the image, it cannot meet the accuracy requirements of pedestrian detection. In order to solve these problems, a new cascading pedestrian detection model based on PSMNet binocular information fusion and improved faster R-CNN pedestrian detection model is proposed. Firstly, binocular images are fed into the original PSMNet binocular information fusion module to get the disparity map, and then left and right images are fused by the disparity map to get the fusion image. Secondly, in the improved faster R-CNN pedestrian detection module, the left, right and fusion image of one frame are as separate inputs, and pedestrian detection is carried out respectively. Finally, the detection results of the three channels are passed through the target consistency validation module, and the verified pedestrian detection target is as the final output detection result. The simulation results show that the accuracy and recall rate of the cascading model are improved, the missed detection rate is reduced to 13.42%, and the accuracy rate is 88.58%.
引用
收藏
页码:13 / 17
页数:5
相关论文
共 50 条
  • [1] Pedestrian detection aided by fusion of binocular information
    Zhang, Zhiguo
    Tao, Wenbing
    Sun, Kun
    Hu, Wenbin
    Yao, Li
    PATTERN RECOGNITION, 2016, 60 : 227 - 238
  • [2] Research on Pedestrian Detection Based on Multimodal Information Fusion
    Yang, Xiaoping
    Li, Zhehong
    Liu, Yuan
    Huang, Ran
    Tan, Kai
    Huang, Lin
    INFORMATION TECHNOLOGY AND CONTROL, 2023, 52 (04): : 1045 - 1057
  • [3] A Pedestrian Detection System Based on Binocular Stereo
    Liu, Xiaohui
    Jin, Zhigang
    2012 INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP 2012), 2012,
  • [4] Joint information fusion and multi-scale network model for pedestrian detection
    Zhang, Hexiang
    Hu, Ziyu
    Hao, Ruoxin
    VISUAL COMPUTER, 2021, 37 (08): : 2433 - 2442
  • [5] Joint information fusion and multi-scale network model for pedestrian detection
    Hexiang Zhang
    Ziyu Hu
    Ruoxin Hao
    The Visual Computer, 2021, 37 : 2433 - 2442
  • [6] High-density pedestrian detection algorithm based on deep information fusion
    Zhang, Hexiang
    Yang, Xiaofang
    Hu, Ziyu
    Hao, Ruoxin
    Gao, Zehang
    Wang, Jianhao
    APPLIED INTELLIGENCE, 2022, 52 (13) : 15483 - 15495
  • [7] High-density pedestrian detection algorithm based on deep information fusion
    Hexiang Zhang
    Xiaofang Yang
    Ziyu Hu
    Ruoxin Hao
    Zehang Gao
    Jianhao Wang
    Applied Intelligence, 2022, 52 : 15483 - 15495
  • [8] Pedestrian Detection in Binocular Stereo Sequence Based on Appearance Consistency
    Zhang, Zhiguo
    Tao, Wenbing
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2016, 26 (09) : 1772 - 1785
  • [9] Pedestrian detection based on the privileged information
    Fan Meng
    Zhiquan Qi
    Yingjie Tian
    Lingfeng Niu
    Neural Computing and Applications, 2018, 29 : 1485 - 1494
  • [10] Pedestrian Detection Based on Depth Information
    Sun, Jia
    Li, Yanfeng
    Chen, Houjin
    Li, Jupeng
    Li, Feng
    ICMLC 2020: 2020 12TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND COMPUTING, 2018, : 249 - 253