Mapping with Monocular Camera Sensor under Adversarial Illumination for Intelligent Vehicles

被引:1
|
作者
Tian, Wei [1 ]
Wen, Yongkun [1 ]
Chu, Xinning [1 ]
机构
[1] Tongji Univ, Sch Automot Studies, Shanghai 201804, Peoples R China
基金
国家重点研发计划;
关键词
intelligent vehicle; monocular camera sensor; visual mapping; adversarial illumination; unsupervised keypoint learning; scale drift reduction; VERSATILE; ROBUST;
D O I
10.3390/s23063296
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
High-precision maps are widely applied in intelligent-driving vehicles for localization and planning tasks. The vision sensor, especially monocular cameras, has become favoured in mapping approaches due to its high flexibility and low cost. However, monocular visual mapping suffers from great performance degradation in adversarial illumination environments such as on low-light roads or in underground spaces. To address this issue, in this paper, we first introduce an unsupervised learning approach to improve keypoint detection and description on monocular camera images. By emphasizing the consistency between feature points in the learning loss, visual features in dim environment can be better extracted. Second, to suppress the scale drift in monocular visual mapping, a robust loop-closure detection scheme is presented, which integrates both feature-point verification and multi-grained image similarity measurements. With experiments on public benchmarks, our keypoint detection approach is proven robust against varied illumination. With scenario tests including both underground and on-road driving, we demonstrate that our approach is able to reduce the scale drift in reconstructing the scene and achieve a mapping accuracy gain of up to 0.14 m in textureless or low-illumination environments.
引用
收藏
页数:21
相关论文
共 50 条
  • [31] Ceiling vision based SLAM approach using sensor fusion of sonar sensor and monocular camera
    Jo, Sungjin
    Choi, Hyukdoo
    Kim, Euntai
    2012 12TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS), 2012, : 1461 - 1464
  • [32] Intelligent driving intelligence test for autonomous vehicles with naturalistic and adversarial environment
    Shuo Feng
    Xintao Yan
    Haowei Sun
    Yiheng Feng
    Henry X. Liu
    Nature Communications, 12
  • [33] MONOCULAR COLOR DISTINCTION OF VELUMETRICAL OBJECTS UNDER VARIOUS ILLUMINATION CONDITIONS
    NIKOLAEV, PP
    BIOFIZIKA, 1988, 33 (01): : 140 - 144
  • [34] Intelligent driving intelligence test for autonomous vehicles with naturalistic and adversarial environment
    Feng, Shuo
    Yan, Xintao
    Sun, Haowei
    Feng, Yiheng
    Liu, Henry X.
    NATURE COMMUNICATIONS, 2021, 12 (01)
  • [35] An intelligent camera based smart seeding rate sensor
    Sommer, Martin S.
    Rupitsch, Stefan J.
    Kastner, Michael
    Zagar, Bernhard G.
    2006 IEEE INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE PROCEEDINGS, VOLS 1-5, 2006, : 428 - +
  • [36] A New Way of Estimating Distances to Foregoing Vehicles from a Monocular Camera with Error Modeling
    Suzuki, Teppei
    Sato, Ikuro
    2019 30TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV19), 2019, : 2208 - 2214
  • [37] Benchmarking of monocular camera UAV-based localization and mapping methods in vineyards
    Wang, Kaiwen
    Kooistra, Lammert
    Wang, Yaowu
    Velez, Sergio
    Wang, Wensheng
    Valente, Joao
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2024, 227
  • [38] ORB-SLAM Based Semi-Dense Mapping with Monocular Camera
    Wang, Boshi
    Wang, Haiying
    Yu, Yuan
    Zong, Limin
    2017 IEEE 20TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2017,
  • [39] Research on Intelligent Mobile Platform Base on Monocular Vision and Ultrasonic Sensor
    Mo, Yuda
    Zou, Xiangjun
    Hou, Jiaqi
    Lin, Guichao
    Long, Yuhui
    Liu, Nian
    Li, Bo
    Jiang, Zhilin
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2014, PT I, 2014, 8917 : 197 - 203
  • [40] Research on intelligent mobile platform base on monocular vision and ultrasonic sensor
    Mo, Yuda
    Zou, Xiangjun
    Hou, Jiaqi
    Lin, Guichao
    Long, Yuhui
    Liu, Nian
    Li, Bo
    Jiang, Zhilin
    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2014, 8917 : 197 - 203