Efficient and robust Pedestrian Detection using Deep Learning for Human-Aware Navigation

被引:39
|
作者
Mateus, Andre [1 ]
Ribeiro, David [1 ]
Miraldo, Pedro [1 ,2 ]
Nascimento, Jacinto C. [1 ]
机构
[1] Inst Super Tecn, Inst Sistemas & Robot LARSyS, Lisbon, Portugal
[2] KTH Royal Inst Technol, Dept Automat Control, Stockholm, Sweden
关键词
Pedestrian detection; Convolutional Neural Network; Human-Aware Navigation; MOBILE ROBOT MOTION;
D O I
10.1016/j.robot.2018.12.007
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper addresses the problem of Human-Aware Navigation (HAN), using multi camera sensors to implement a vision-based person tracking system. The main contributions of this paper are as follows: a novel and efficient Deep Learning person detection and a standardization of human-aware constraints. In the first stage of the approach, we propose to cascade the Aggregate Channel Features (ACF) detector with a deep Convolutional Neural Network (CNN) to achieve fast and accurate Pedestrian Detection (PD). Regarding the human awareness (that can be defined as constraints associated with the robot's motion), we use a mixture of asymmetric Gaussian functions, to define the cost functions associated to each constraint. Both methods proposed herein are evaluated individually to measure the impact of each of the components. The final solution (including both the proposed pedestrian detection and the human-aware constraints) is tested in a typical domestic indoor scenario, in four distinct experiments. The results show that the robot is able to cope with human-aware constraints, defined after common proxemics and social rules. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:23 / 37
页数:15
相关论文
共 50 条
  • [41] Assessing the Social Criteria for Human-Robot Collaborative Navigation: A Comparison of Human-Aware Navigation Planners
    Khambhaita, Harmish
    Alami, Rachid
    2017 26TH IEEE INTERNATIONAL SYMPOSIUM ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION (RO-MAN), 2017, : 1140 - 1145
  • [42] Human-Aware Robot Navigation by Long-Term Movement Prediction
    Bruckschen, Lilli
    Bungert, Kira
    Dengler, Nils
    Bennewitz, Maren
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 11032 - 11037
  • [43] Human-Aware Reinforcement Learning for Adaptive Human Robot Teaming
    Singh, Saurav
    Heard, Jamison
    PROCEEDINGS OF THE 2022 17TH ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION (HRI '22), 2022, : 1049 - 1052
  • [44] Learning Cross-Modal Deep Representations for Robust Pedestrian Detection
    Xu, Dan
    Ouyang, Wanli
    Ricci, Elisa
    Wang, Xiaogang
    Sebe, Nicu
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 4236 - 4244
  • [45] Multi-Grained Deep Feature Learning for Robust Pedestrian Detection
    Lin, Chunze
    Lu, Jiwen
    Zhou, Jie
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (12) : 3608 - 3621
  • [46] Human-Aware Reinforcement Learning for Fault Recovery Using Contextual Gaussian Processes
    McGuire, Steve
    Michael Furlong, P.
    Heckman, Christoffer
    Julier, Simon
    Ahmed, Nisar
    JOURNAL OF AEROSPACE INFORMATION SYSTEMS, 2021, 18 (07): : 429 - 441
  • [47] Socially Aware Robot Navigation Using Deep Reinforcement Learning
    Truong Xuan Tung
    Trung Dung Ngo
    2018 IEEE CANADIAN CONFERENCE ON ELECTRICAL & COMPUTER ENGINEERING (CCECE), 2018,
  • [48] Give Pedestrian More Choice: Socially Aware Navigation Using Reinforcement Learning with Human Action Entropy Maximization
    Wu, Jiaxu
    Asama, Hajime
    An, Qi
    Yamashita, Atsushi
    INTELLIGENT AUTONOMOUS SYSTEMS 18, VOL 2, IAS18-2023, 2024, 794 : 77 - 90
  • [49] Human-Aware Navigation for Autonomous Mobile Robots for Intra-factory Logistics
    Marques, Francisco
    Goncalves, Duarte
    Barata, Jose
    Santana, Pedro
    SYMBIOTIC INTERACTION, SYMBIOTIC 2017, 2018, 10727 : 79 - 85
  • [50] Vulnerable pedestrian detection and tracking using deep learning
    Song, Hyok
    Choi, In Kyu
    Ko, Min Soo
    Bae, Jinwoo
    Kwak, Sooyoung
    Yoo, Jisang
    2018 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2018, : 178 - 179