Seeing in Extra Darkness Using a Deep-Red Flash

被引:7
|
作者
Xiong, Jinhui [1 ]
Wang, Jian [2 ]
Heidrich, Wolfgang [1 ]
Nayar, Shree [2 ]
机构
[1] KAUST, Daejeon, South Korea
[2] Snap Res, Daejeon, South Korea
关键词
D O I
10.1109/CVPR46437.2021.00987
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a new flash technique for low-light imaging, using deep-red light as an illuminating source. Our main observation is that in a dim environment, the human eye mainly uses rods for the perception of light, which are not sensitive to wavelengths longer than 620 nm, yet the camera sensor still has a spectral response. We propose a novel modulation strategy when training a modern CNN model for guided image filtering, fusing a noisy RGB frame and a flash frame. This fusion network is further extended for video reconstruction. We have built a prototype with minor hardware adjustments and tested the new flash technique on a variety of static and dynamic scenes. The experimental results demonstrate that our method produces compelling reconstructions, even in extra dim conditions.
引用
收藏
页码:9995 / 10004
页数:10
相关论文
共 50 条
  • [1] Deep-red fluorescent imaging probe for bacteria
    White, Alexander G.
    Gray, Brian D.
    Pak, Koon Yan
    Smith, Bradley D.
    BIOORGANIC & MEDICINAL CHEMISTRY LETTERS, 2012, 22 (08) : 2833 - 2836
  • [2] Water soluble, deep-red fluorescent squaraine rotaxanes
    Cole, Erin L.
    Arunkumar, Easwaran
    Xiao, Shuzhang
    Smith, Bryan A.
    Smith, Bradley D.
    ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 2012, 243
  • [3] High performance red/deep-red emitting phosphors for white LEDs
    Rajendran, Marikumar
    Vaidyanathan, Sivakumar
    NEW JOURNAL OF CHEMISTRY, 2020, 44 (14) : 5354 - 5365
  • [4] Deep-red fluorescent imaging probe for anionic membranes
    Plaunt, Adam J.
    White, Alexander G.
    Smith, Bradley D.
    ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 2012, 244
  • [5] Benefits of using BODIPY-porphyrin dyads for developing deep-red lighting sources
    Weber, M. D.
    Nikolaou, V.
    Wittmann, J. E.
    Nikolaou, A.
    Angaridis, P. A.
    Charalambidis, G.
    Stangel, C.
    Kahnt, A.
    Coutsolelos, A. G.
    Costa, R. D.
    CHEMICAL COMMUNICATIONS, 2016, 52 (08) : 1602 - 1605
  • [6] DEEP-RED HOLOGRAPHY USING A JUNCTION LASER AND SILVER-HALIDE HOLOGRAPHIC EMULSION
    HART, S
    MENDES, G
    BAZARGAN, K
    XU, SC
    OPTICS LETTERS, 1988, 13 (11) : 955 - 957
  • [7] Strategy for Manufacturing a Deep-Red Ink Based on Nanocellulose and Reactive Red 120
    Wang, Wenbo
    Fu, Shiyu
    ACS SUSTAINABLE CHEMISTRY & ENGINEERING, 2019, 7 (07): : 7233 - 7240
  • [8] Red and deep-red emissive polymeric nanoparticles based on polybenzofulvene and perylenediimide derivatives
    Villafiorita-Monteleone, F.
    Kozma, E.
    Giovanella, U.
    Catellani, M.
    Paolino, M.
    Collico, V.
    Colombo, M.
    Cappelli, A.
    Botta, C.
    DYES AND PIGMENTS, 2018, 149 : 331 - 335
  • [9] A radical polymer with efficient deep-red luminescence in the condensed state
    Abdurahman, Alim
    Peng, Qiming
    Ablikim, Obolda
    Ai, Xin
    Li, Feng
    MATERIALS HORIZONS, 2019, 6 (06) : 1265 - 1270
  • [10] Deep-red semiconductor monolithic mode-locked lasers
    Kong, L.
    Wang, H. L.
    Bajek, D.
    White, S. E.
    Forrest, A. F.
    Wang, X. L.
    Cui, B. F.
    Pan, J. Q.
    Ding, Y.
    Cataluna, M. A.
    APPLIED PHYSICS LETTERS, 2014, 105 (22)