A Pedestrian Detection Model Based on Binocular Information Fusion

被引:2
|
作者
Zhang, Juan [1 ]
Ma, Zhonggui [1 ]
Nuermaimaiti, Nuerxiati [1 ]
机构
[1] Univ Sci & Technol Beijing, Sch Comp & Commun Engn, Beijing, Peoples R China
关键词
Pedestrian detection; deep learning; binocular vision; PSMNet; Faster R-CNN;
D O I
10.1109/wocc.2019.8770601
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Pedestrian detection, as a special kind of target detection, is a research hotspot in the field of image processing and computer vision. Because monocular vision cannot obtain the depth information of the image, it cannot meet the accuracy requirements of pedestrian detection. In order to solve these problems, a new cascading pedestrian detection model based on PSMNet binocular information fusion and improved faster R-CNN pedestrian detection model is proposed. Firstly, binocular images are fed into the original PSMNet binocular information fusion module to get the disparity map, and then left and right images are fused by the disparity map to get the fusion image. Secondly, in the improved faster R-CNN pedestrian detection module, the left, right and fusion image of one frame are as separate inputs, and pedestrian detection is carried out respectively. Finally, the detection results of the three channels are passed through the target consistency validation module, and the verified pedestrian detection target is as the final output detection result. The simulation results show that the accuracy and recall rate of the cascading model are improved, the missed detection rate is reduced to 13.42%, and the accuracy rate is 88.58%.
引用
收藏
页码:13 / 17
页数:5
相关论文
共 50 条
  • [31] Pedestrian Detection Based on Multi-vision Features Fusion
    Xiao, Degui
    Chen, Yong
    2016 12TH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (ICNC-FSKD), 2016, : 1910 - 1915
  • [32] Pedestrian Detection Method Based on Neural Network and Data Fusion
    Zhu B.
    Huang M.
    Tan D.
    Hu X.
    Gu J.
    Tan, Dongkui (tandongkui@126.com), 1600, SAE-China (42): : 1482 - 1489
  • [33] Convolution Pedestrian Detection Based on Random Fusion of Color and Gradient
    Gui Xiangquan
    Jiang Jiajun
    Li, Li
    Chen, Dongmei
    Gao, Lei
    PROCEEDINGS OF THE 3RD WORKSHOP ON ADVANCED RESEARCH AND TECHNOLOGY IN INDUSTRY (WARTIA 2017), 2017, 148 : 26 - 34
  • [34] Pedestrian Detection Based on Multi-Scale Fusion Features
    Jiang, Hao
    Zhang, Chuang
    Wu, Ming
    PROCEEDINGS OF 2018 INTERNATIONAL CONFERENCE ON NETWORK INFRASTRUCTURE AND DIGITAL CONTENT (IEEE IC-NIDC), 2018, : 329 - 333
  • [35] Pedestrian Liveness Detection Based on mmWave Radar and Camera Fusion
    Li, Hao
    Liu, Ruofeng
    Wang, Shuai
    Jiang, Wenchao
    Lu, Chris Xiaoxuan
    2022 19TH ANNUAL IEEE INTERNATIONAL CONFERENCE ON SENSING, COMMUNICATION, AND NETWORKING (SECON), 2022, : 262 - 270
  • [36] Pedestrian Detection Based on Fusion of Millimeter Wave Radar and Vision
    Guo, Xiao-peng
    Du, Jin-song
    Gao, Jie
    Wang, Wei
    2018 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND PATTERN RECOGNITION (AIPR 2018), 2018, : 38 - 42
  • [37] Pedestrian Detection Based on Deep Learning Model
    Li, Hailong
    Wu, Zhendong
    Zhang, Jianwu
    2016 9TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2016), 2016, : 796 - 800
  • [38] Camera and lidar fusion for pedestrian detection
    Jun, Wang
    Wu, Tao
    PROCEEDINGS 3RD IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION ACPR 2015, 2015, : 371 - 375
  • [39] FDENet: Fusion Depth Semantics and Edge-Attention Information for Multispectral Pedestrian Detection
    Liu, Xiaowei
    Xu, Xinying
    Xie, Jun
    Li, Pengyue
    Wei, Jiamin
    Sang, Yiyu
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (06) : 5441 - 5448
  • [40] Multi-Cue Event Information Fusion for Pedestrian Detection With Neuromorphic Vision Sensors
    Chen, Guang
    Cao, Hu
    Ye, Canbo
    Zhang, Zhenyan
    Liu, Xingbo
    Mo, Xuhui
    Qu, Zhongnan
    Conradt, Jorg
    Roehrbein, Florian
    Knoll, Alois
    FRONTIERS IN NEUROROBOTICS, 2019, 13