Seeing in Extra Darkness Using a Deep-Red Flash

被引:7
|
作者
Xiong, Jinhui [1 ]
Wang, Jian [2 ]
Heidrich, Wolfgang [1 ]
Nayar, Shree [2 ]
机构
[1] KAUST, Daejeon, South Korea
[2] Snap Res, Daejeon, South Korea
关键词
D O I
10.1109/CVPR46437.2021.00987
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a new flash technique for low-light imaging, using deep-red light as an illuminating source. Our main observation is that in a dim environment, the human eye mainly uses rods for the perception of light, which are not sensitive to wavelengths longer than 620 nm, yet the camera sensor still has a spectral response. We propose a novel modulation strategy when training a modern CNN model for guided image filtering, fusing a noisy RGB frame and a flash frame. This fusion network is further extended for video reconstruction. We have built a prototype with minor hardware adjustments and tested the new flash technique on a variety of static and dynamic scenes. The experimental results demonstrate that our method produces compelling reconstructions, even in extra dim conditions.
引用
收藏
页码:9995 / 10004
页数:10
相关论文
共 50 条
  • [21] Optical Imaging of Bacterial Infection in Living Mice Using Deep-Red Fluorescent Squaraine Rotaxane Probes
    White, Alexander G.
    Fu, Na
    Leevy, W. Matthew
    Lee, Jung-Jae
    Blasco, Michael A.
    Smith, Bradley D.
    BIOCONJUGATE CHEMISTRY, 2010, 21 (07) : 1297 - 1304
  • [22] Di(acenaphtho)BODIPYs and Dipyrrins as Dyes with Deep-Red To NIR Absorptions
    Uno, Hidemitsu
    Hirose, Mako
    Honda, Takayuki
    Mori, Shigeki
    Takase, Masayoshi
    Okujima, Tetsuo
    BULLETIN OF THE CHEMICAL SOCIETY OF JAPAN, 2019, 92 (05) : 1001 - 1007
  • [23] Anomalous deep-red luminescence of perylene black analogues with strong π-π interactions
    Ningning Tang
    Jiadong Zhou
    Liangxuan Wang
    Matthias Stolte
    Guojing Xie
    Xinbo Wen
    Linlin Liu
    Frank Würthner
    Johannes Gierschner
    Zengqi Xie
    Nature Communications, 14 (1)
  • [24] Biosynthesis of the Narrowband Deep-Red Emissive Carbon Nanodots from Eggshells
    Deng, Yuan
    Shen, Chenglong
    Zhao, Wenbo
    Zheng, Guangsong
    Jiao, Fuhang
    Lou, Qing
    Liu, Kaikai
    Shan, Chong-Xin
    Dong, Lin
    ACS SUSTAINABLE CHEMISTRY & ENGINEERING, 2023, 11 (17) : 6535 - 6544
  • [25] In Vivo Imaging of Bone Using a Deep-Red Fluorescent Molecular Probe Bearing Multiple Iminodiacetate Groups
    Harmatys, Kara M.
    Cole, Erin L.
    Smith, Bradley D.
    MOLECULAR PHARMACEUTICS, 2013, 10 (11) : 4263 - 4271
  • [26] PHOTOPROPERTIES OF ALKOXY-SUBSTITUTED PHTHALOCYANINES WITH DEEP-RED OPTICAL ABSORBANCE
    FORD, WE
    RIHTER, BD
    KENNEY, ME
    RODGERS, MAJ
    PHOTOCHEMISTRY AND PHOTOBIOLOGY, 1989, 50 (03) : 277 - 282
  • [27] A NEW Cu(I) IODIDE COMPLEX SHOWING DEEP-RED LUMINESCENCE
    Artem'ev, A., V
    Rakhmanova, M., I
    Brylev, K. A.
    Bagryanskaya, I. Yu
    JOURNAL OF STRUCTURAL CHEMISTRY, 2020, 61 (07) : 1068 - 1071
  • [28] Deep-red circularly polarised luminescent C70 derivatives
    Kano, Haruka
    Hayashi, Hironobu
    Matsuo, Kyohei
    Fujiki, Michiya
    Yamada, Hiroko
    Aratani, Naoki
    SCIENTIFIC REPORTS, 2021, 11 (01)
  • [29] Deep-red double-clad fiber laser at 717 nm
    KIFLE, E. S. R. O. M.
    LOIKO, P. A. V. E. L.
    BERTHELOT, T. H. I. B. A. U. D.
    RAULT, T. H. I. P. H. A. I. N. E.
    BODIN, L. A. U. R. I. N. E.
    PAU, F. L. O. R. E. N. C. E.
    RECOQUE, G. I. L. L. E. S.
    GEORGES, T. H. I. E. R. R. Y.
    CAMY, P. A. T. R. I. C. E.
    OPTICS LETTERS, 2023, 48 (06) : 1494 - 1497
  • [30] Host and Dopant Materials for Idealized Deep-Red Organic Electrophosphorescence Devices
    Fan, Chun-Hsiang
    Sun, Peipei
    Su, Tsu-Hui
    Cheng, Chien-Hong
    ADVANCED MATERIALS, 2011, 23 (26) : 2981 - +