Seeing in Extra Darkness Using a Deep-Red Flash

被引:7
|
作者
Xiong, Jinhui [1 ]
Wang, Jian [2 ]
Heidrich, Wolfgang [1 ]
Nayar, Shree [2 ]
机构
[1] KAUST, Daejeon, South Korea
[2] Snap Res, Daejeon, South Korea
关键词
D O I
10.1109/CVPR46437.2021.00987
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a new flash technique for low-light imaging, using deep-red light as an illuminating source. Our main observation is that in a dim environment, the human eye mainly uses rods for the perception of light, which are not sensitive to wavelengths longer than 620 nm, yet the camera sensor still has a spectral response. We propose a novel modulation strategy when training a modern CNN model for guided image filtering, fusing a noisy RGB frame and a flash frame. This fusion network is further extended for video reconstruction. We have built a prototype with minor hardware adjustments and tested the new flash technique on a variety of static and dynamic scenes. The experimental results demonstrate that our method produces compelling reconstructions, even in extra dim conditions.
引用
收藏
页码:9995 / 10004
页数:10
相关论文
共 50 条
  • [31] Deep-red emitting MgTiO:Mn phosphor ceramics for plant lighting
    Zixin WANG
    Hui LIN
    Dawei ZHANG
    Yiming SHEN
    Yang LI
    Ruijin HONG
    Chunxian TAO
    Zhaoxia HAN
    Lei CHEN
    Shengming ZHOU
    Journal of Advanced Ceramics , 2021, (01) : 88 - 97
  • [32] A NEW Cu(I) IODIDE COMPLEX SHOWING DEEP-RED LUMINESCENCE
    A V Artem′ev
    M I Rakhmanova
    K A Brylev
    I Yu Bagryanskaya
    Journal of Structural Chemistry, 2020, 61 : 1068 - 1071
  • [33] Fluorescence Imaging Using Deep-Red Indocyanine Blue, a Complementary Partner for Near-Infrared Indocyanine Green
    Gamage, Rananjaya S.
    Smith, Bradley D.
    CHEMICAL & BIOMEDICAL IMAGING, 2024, 2 (05): : 384 - 397
  • [34] Continuously tunable deep-red laser based on Pr3+:YLF
    Cai, Zhiping
    Fang, Run
    Huang, Rongfei
    Xu, Huiying
    Wang, Yushu
    OPTICS AND LASER TECHNOLOGY, 2023, 164
  • [35] A Review of Deep-Red (650-700 nm)-Emitting Semiconductor Nanocrystals
    Jin, Geyu
    Liu, Fangze
    Wei, Jing
    Li, Hongbo
    CRYSTALS, 2024, 14 (09)
  • [36] Deep-red photoluminescent mechanoresponsive polymers with dynamic CuI-arylamide mechanophores
    Gridneva, Tatiana
    Karimata, Ayumu
    Bansal, Richa
    Fayzullin, Robert R.
    Vasylevskyi, Serhii
    Bruhacs, Andrew
    Khusnutdinova, Julia R.
    CHEMICAL COMMUNICATIONS, 2023, 60 (02) : 212 - 215
  • [37] Porphyrin, phthalocyanine and porphyrazine derivatives with multifluorenyl substituents as efficient deep-red emitters
    Barker, Carl A.
    Zeng, Xianshun
    Bettington, Sylvia
    Batsanov, Andrei S.
    Bryce, Martin R.
    Beeby, Andrew
    CHEMISTRY-A EUROPEAN JOURNAL, 2007, 13 (23) : 6710 - 6717
  • [38] Tuning the position of methyl groups to realize highly efficient deep-red PhOLEDs
    Xia, Rongrong
    Zhang, Zhen
    Guo, Jianfeng
    Dou, Dehai
    Wang, Ke
    Cao, Jin
    Wang, Zixing
    DYES AND PIGMENTS, 2021, 195
  • [39] Synthesis and Performance of Deep-Red Phosphorescent Iridium Complexes with Pyrone as an Auxiliary Ligand
    Jiang, Wen
    Hou, Wenming
    Yan, Caixian
    Nie, Zhifeng
    Chang, Qiaowen
    Li, Xiangguang
    Liu, Weiping
    MOLECULES, 2024, 29 (13):
  • [40] Annihilation upconversion: harvesting the entire deep-red spectral range of the sun irradiation
    Heinrich, Ernesta
    Avlasevich, Yuri
    Landfester, Katharina
    Baluschev, Stanislav
    JOURNAL OF PHOTONICS FOR ENERGY, 2018, 8 (02):