Seeing in Extra Darkness Using a Deep-Red Flash

被引:7
|
作者
Xiong, Jinhui [1 ]
Wang, Jian [2 ]
Heidrich, Wolfgang [1 ]
Nayar, Shree [2 ]
机构
[1] KAUST, Daejeon, South Korea
[2] Snap Res, Daejeon, South Korea
关键词
D O I
10.1109/CVPR46437.2021.00987
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a new flash technique for low-light imaging, using deep-red light as an illuminating source. Our main observation is that in a dim environment, the human eye mainly uses rods for the perception of light, which are not sensitive to wavelengths longer than 620 nm, yet the camera sensor still has a spectral response. We propose a novel modulation strategy when training a modern CNN model for guided image filtering, fusing a noisy RGB frame and a flash frame. This fusion network is further extended for video reconstruction. We have built a prototype with minor hardware adjustments and tested the new flash technique on a variety of static and dynamic scenes. The experimental results demonstrate that our method produces compelling reconstructions, even in extra dim conditions.
引用
收藏
页码:9995 / 10004
页数:10
相关论文
共 50 条
  • [11] Imaging of nucleolar RNA in living cells using a highly photostable deep-red fluorescent probe
    Zhou, Bingjiang
    Liu, Weimin
    Zhang, Hongyan
    Wu, Jiasheng
    Liu, Sha
    Xu, Haitao
    Wang, Pengfei
    BIOSENSORS & BIOELECTRONICS, 2015, 68 : 189 - 196
  • [12] Deep-red activated persistent luminescence nanoparticles via upconversion
    Giordano, Luidgi
    Veloso Rodrigues, Lucas Carvalho
    Delgado, Teresa
    Viana, Bruno
    2021 CONFERENCE ON LASERS AND ELECTRO-OPTICS EUROPE & EUROPEAN QUANTUM ELECTRONICS CONFERENCE (CLEO/EUROPE-EQEC), 2021,
  • [13] Deep-Red Emissive BODIPY-Chlorin Arrays Excitable with Green and Red Wavelengths
    Meares, Adam
    Satraitis, Andrius
    Santhanam, Nithya
    Yu, Zhanqian
    Ptaszek, Marcin
    JOURNAL OF ORGANIC CHEMISTRY, 2015, 80 (08): : 3858 - 3869
  • [14] Water-soluble, deep-red fluorescent squaraine rotaxanes
    Cole, Erin L.
    Arunkumar, Easwaran
    Xiao, Shuzhang
    Smith, Bryan A.
    Smith, Bradley D.
    ORGANIC & BIOMOLECULAR CHEMISTRY, 2012, 10 (30) : 5769 - 5773
  • [15] Solution-Process-Feasible Deep-Red Phosphorescent Emitter
    Jou, Jwo-Huei
    Su, Yu-Ting
    Hsiao, Ming-Ting
    Yu, Hui-Huan
    He, Zhe-Kai
    Fu, Shen-Chin
    Chiang, Chi-Heng
    Chen, Chien-Tien
    Chou, Chia-hung
    Shyue, Jing-Jong
    JOURNAL OF PHYSICAL CHEMISTRY C, 2016, 120 (33): : 18794 - 18802
  • [16] DEEP-RED, THE INTERNATIONAL DEBT CRISIS AND ITS HISTORICAL PRECEDENTS
    JAMES, H
    AMERICAN SCHOLAR, 1987, 56 (03): : 331 - 341
  • [17] Synthesis and Optical Properties of Red and Deep-Red Emissive Polymeric and Copolymeric BODIPY Dyes
    Donuru, Venkat R.
    Vegesna, Giri K.
    Velayudham, Singaravelu
    Green, Sarah
    Liu, Haiying
    CHEMISTRY OF MATERIALS, 2009, 21 (10) : 2130 - 2138
  • [18] Squaraine rotaxane shuttle as a ratiometric deep-red optical chloride sensor
    Collins, Carleton G.
    Peck, Evan M.
    Kramer, Patrick J.
    Smith, Bradley D.
    CHEMICAL SCIENCE, 2013, 4 (06) : 2557 - 2563
  • [19] Deep-red circularly polarised luminescent C70 derivatives
    Haruka Kano
    Hironobu Hayashi
    Kyohei Matsuo
    Michiya Fujiki
    Hiroko Yamada
    Naoki Aratani
    Scientific Reports, 11
  • [20] DETECTION OF DEEP-RED LOW-LEVEL LIGHT-PULSES
    BURNHAM, R
    SCARL, D
    APPLIED OPTICS, 1986, 25 (09): : 1514 - 1518