Reducing Overconfidence Predictions in Autonomous Driving Perception

被引:4
|
作者
Melotti, Gledson [1 ,2 ]
Premebida, Cristiano [2 ]
Bird, Jordan J. [3 ]
Faria, Diego R. [4 ]
Goncalves, Nuno [2 ,5 ]
机构
[1] Fed Inst Espirito Santo, BR-29932540 Vitoria, ES, Brazil
[2] Univ Coimbra, Inst Syst & Robot ISR UC, Dept Elect & Comp Engn, P-3030290 Coimbra, Portugal
[3] Nottingham Trent Univ, Dept Comp Sci, Computat Intelligence & Applicat Res Grp CIA, Nottingham NG1 4FQ, England
[4] Univ Hertfordshire, Sch Phys Engn & Comp Sci, Hatfield AL10 9AB, Herts, England
[5] Portuguese Mint & Official Printing Off, P-1000042 Lisbon, Portugal
关键词
Uncertainty; Calibration; Predictive models; Bayes methods; Autonomous vehicles; Deep learning; Training; Bayesian inference; confidence calibration; object recognition; perception system; probability prediction; NEURAL-NETWORKS; CLASSIFICATION;
D O I
10.1109/ACCESS.2022.3175195
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In state-of-the-art deep learning for object recognition, Softmax and Sigmoid layers are most commonly employed as the predictor outputs. Such layers often produce overconfidence predictions rather than proper probabilistic scores, which can thus harm the decision-making of 'critical' perception systems applied in autonomous driving and robotics. Given this, we propose a probabilistic approach based on distributions calculated out of the Logit layer scores of pre-trained networks which are then used to constitute new decision layers based on Maximum Likelihood (ML) and Maximum a-Posteriori (MAP) inference. We demonstrate that the hereafter called ML and MAP layers are more suitable for probabilistic interpretations than Softmax and Sigmoid-based predictions for object recognition. We explore distinct sensor modalities via RGB images and LiDARs (RV: range-view) data from the KITTI and Lyft Level-5 datasets, where our approach shows promising performance compared to the usual Softmax and Sigmoid layers, with the benefit of enabling interpretable probabilistic predictions. Another advantage of the approach introduced in this paper is that the so-called ML and MAP layers can be implemented in existing trained networks, that is, the approach benefits from the output of the Logit layer of pre-trained networks. Thus, there is no need to carry out a new training phase since the ML and MAP layers are used in the test/prediction phase. The Classification results are presented using reliability diagrams, while detection results are illustrated using precision-recall curves.
引用
收藏
页码:54805 / 54821
页数:17
相关论文
共 50 条
  • [21] Robust Environment Perception for the Audi Autonomous Driving Cup
    Kuhnt, Florian
    Pfeiffer, Micha
    Zimmer, Peter
    Zimmerer, David
    Gomer, Jan-Markus
    Kaiser, Vitali
    Kohlhaas, Ralf
    Zoellner, J. Marius
    2016 IEEE 19TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2016, : 1424 - 1431
  • [22] Vision-based environmental perception for autonomous driving
    Liu, Fei
    Lu, Zihao
    Lin, Xianke
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2025, 239 (01) : 39 - 69
  • [23] Scalability in Perception for Autonomous Driving: Waymo Open Dataset
    Sun, Pei
    Kretzschmar, Henrik
    Dotiwalla, Xerxes
    Chouard, Aurelien
    Patnaik, Vijaysai
    Tsui, Paul
    Guo, James
    Zhou, Yin
    Chai, Yuning
    Caine, Benjamin
    Vasudevan, Vijay
    Han, Wei
    Ngiam, Jiquan
    Zhao, Hang
    Timofeev, Aleksei
    Ettinger, Scott
    Krivokon, Maxim
    Gao, Amy
    Joshi, Aditya
    Zhang, Yu
    Shlens, Jonathon
    Chen, Zhifeng
    Anguelov, Dragomir
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 2443 - 2451
  • [24] Autonomous Driving Architectures, Perception and Data Fusion: A Review
    Velasco-Hernandez, Gustavo
    Yeong, De Jong
    Barry, John
    Walsh, Joseph
    2020 IEEE 16TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTER COMMUNICATION AND PROCESSING (ICCP 2020), 2020, : 315 - 321
  • [25] Perception Datasets for Anomaly Detection in Autonomous Driving: A Survey
    Bogdoll, Daniel
    Uhlemeyer, Svenja
    Kowol, Kamil
    Zoellner, J. Marius
    2023 IEEE INTELLIGENT VEHICLES SYMPOSIUM, IV, 2023,
  • [26] CoPEM: Cooperative Perception Error Models for Autonomous Driving
    Piazzoni, Andrea
    Cherian, Jim
    Vijay, Roshan
    Chau, Lap-Pui
    Dauwels, Justin
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 3834 - +
  • [27] Autonomous Driving: Part 1-Sensing and Perception
    Karam, Lina J.
    Katupitiya, Jay
    Milanes, Vicente
    Pitas, Ioannis
    Ye, Jieping
    IEEE SIGNAL PROCESSING MAGAZINE, 2020, 37 (04) : 11 - 13
  • [28] 2 METHODS OF REDUCING OVERCONFIDENCE
    ARKES, HR
    CHRISTENSEN, C
    LAI, C
    BLUMER, C
    ORGANIZATIONAL BEHAVIOR AND HUMAN DECISION PROCESSES, 1987, 39 (01) : 133 - 144
  • [29] Multimodal Trajectory Predictions for Autonomous Driving without a Detailed Prior Map
    Kawasaki, Atsushi
    Seki, Akihito
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 3722 - 3731
  • [30] Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networks
    Cui, Henggang
    Radosavljevic, Vladan
    Chou, Fang-Chieh
    Lin, Tsung-Han
    Thi Nguyen
    Huang, Tzu-Kuo
    Schneider, Jeff
    Djuric, Nemanja
    2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 2090 - 2096