Mapping with Monocular Camera Sensor under Adversarial Illumination for Intelligent Vehicles

被引:1
|
作者
Tian, Wei [1 ]
Wen, Yongkun [1 ]
Chu, Xinning [1 ]
机构
[1] Tongji Univ, Sch Automot Studies, Shanghai 201804, Peoples R China
基金
国家重点研发计划;
关键词
intelligent vehicle; monocular camera sensor; visual mapping; adversarial illumination; unsupervised keypoint learning; scale drift reduction; VERSATILE; ROBUST;
D O I
10.3390/s23063296
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
High-precision maps are widely applied in intelligent-driving vehicles for localization and planning tasks. The vision sensor, especially monocular cameras, has become favoured in mapping approaches due to its high flexibility and low cost. However, monocular visual mapping suffers from great performance degradation in adversarial illumination environments such as on low-light roads or in underground spaces. To address this issue, in this paper, we first introduce an unsupervised learning approach to improve keypoint detection and description on monocular camera images. By emphasizing the consistency between feature points in the learning loss, visual features in dim environment can be better extracted. Second, to suppress the scale drift in monocular visual mapping, a robust loop-closure detection scheme is presented, which integrates both feature-point verification and multi-grained image similarity measurements. With experiments on public benchmarks, our keypoint detection approach is proven robust against varied illumination. With scenario tests including both underground and on-road driving, we demonstrate that our approach is able to reduce the scale drift in reconstructing the scene and achieve a mapping accuracy gain of up to 0.14 m in textureless or low-illumination environments.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Research on Obstacle Avoidance of Intelligent Driving Vehicles Based on Monocular Camera
    Zhang, Bing
    Li, Liang
    Cheng, Shuo
    Zhang, Wenhao
    Li, Shaojie
    Xiao, Lingyun
    CICTP 2019: TRANSPORTATION IN CHINA-CONNECTING THE WORLD, 2019, : 5576 - 5586
  • [2] Monocular Camera Based Real-Time Dense Mapping Using Generative Adversarial Network
    Yang, Xin
    Chen, Jingyu
    Wang, Zhiwei
    Zhang, Qiaozhe
    Liu, Wenyu
    Liao, Chunyuan
    Cheng, Kwang-Ting
    PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 896 - 904
  • [3] Indoor SLAM for Micro Aerial Vehicles Control using Monocular Camera and Sensor Fusion
    Garcia, Sergio
    Elena Lopez, M.
    Barea, Rafael
    Bergasa, Luis M.
    Gomez, Alejandro
    Molinos, Eduardo J.
    2016 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS (ICARSC 2016), 2016, : 205 - 210
  • [4] Sensor Fusion of Camera and Cloud Digital Twin Information for Intelligent Vehicles
    Liu, Yongkang
    Wang, Ziran
    Hang, Kyungtae
    Shou, Zhenyu
    Tiwari, Prashant
    Hansen, John H. L.
    2020 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2020, : 182 - 187
  • [5] Implementation of ORB-SLAM-2 Algorithm for Localization and Mapping using Monocular Camera Sensor
    Anggraeni, Pipit
    Ramdhan, Nur Jamiludin
    Ridwan
    Asshydiqi, M. Taufiq Aulia
    PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON MECHATRONICS, ROBOTICS AND SYSTEMS ENGINEERING (MORSE), 2021, : 64 - 69
  • [6] Distance Estimation for Marine Vehicles Using a Monocular Video Camera
    Gladstone, Ran
    Moshe, Yair
    Bard, Avihai
    Shenhav, Elior
    2016 24TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2016, : 2405 - 2409
  • [7] Research on tracking method of multiple vehicles based on monocular camera
    Faculty of Information Science and Engineering, Northeastern University, Shenyang 110004, China
    Binggong Xuebao, 2007, 8 (988-992):
  • [8] Pose Tracking of Moving Sensor using Monocular Camera and IMU Sensor
    Jung, Sukwoo
    Park, Seho
    Lee, KyungTaek
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2021, 15 (08) : 3011 - 3024
  • [9] A General HCI System Based on Monocular Camera for Intelligent Terminals
    Sun, Jiyan
    Guo, Anhong
    Xiao, Shihan
    PROCEEDINGS OF 2011 INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENCE AND AWARENESS INTERNET, IET AIAI2011, 2011, : 354 - 358
  • [10] Automated Static Camera Calibration with Intelligent Vehicles
    Tsaregorodtsev, Alexander
    Holzbock, Adrian
    Strohbeck, Jan
    Buchholz, Michael
    Belagiannis, Vasileios
    2023 IEEE INTELLIGENT VEHICLES SYMPOSIUM, IV, 2023,