EVENT-BASED CAMERA SIMULATION USING MONTE CARLO PATH TRACING WITH ADAPTIVE DENOISING

被引:2
|
作者
Tsuji, Yuta [1 ]
Yatagawa, Tatsuya [2 ]
Kubo, Hiroyuki [3 ]
Morishima, Shigeo [1 ]
机构
[1] Waseda Univ, Tokyo, Japan
[2] Hitotsubashi Univ, Kunitachi, Tokyo, Japan
[3] Chiba Univ, Chiba, Japan
来源
2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP | 2023年
关键词
Event-based video; Monte Carlo path tracing; weighted local regression;
D O I
10.1109/ICIP49359.2023.10222771
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents an algorithm to obtain an event-based video from noisy frames given by physics-based Monte Carlo path tracing over a synthetic 3D scene. Given the nature of dynamic vision sensor (DVS), rendering event-based video can be viewed as a process of detecting the changes from noisy brightness values. We extend a denoising method based on a weighted local regression (WLR) to detect the brightness changes rather than applying denoising to every pixel. Specifically, we derive a threshold to determine the likelihood of event occurrence and reduce the number of times to perform the regression. Our method is robust to noisy video frames obtained from a few path-traced samples. Despite its efficiency, our method performs comparably to or even better than an approach that exhaustively denoises every frame. Visit our project page for more information: https://github.com/0V/ESIM-AD.git.
引用
收藏
页码:301 / 305
页数:5
相关论文
共 50 条
  • [31] Falcon ODIN: An Event-Based Camera Payload
    McHarg, Matthew
    Cohen, Greg
    Marcireau, Alex
    Theis, Zack
    McMahon-Crabtree, Peter
    UNCONVENTIONAL IMAGING, SENSING, AND ADAPTIVE OPTICS 2024, 2024, 13149
  • [32] A 6-DOFs event-based camera relocalization system by CNN-LSTM and image denoising
    Jin, Yifan
    Yu, Lei
    Li, Guangqiang
    Fei, Shumin
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 170
  • [33] Path integral Monte Carlo simulation of vortices
    Nordborg, H
    Blatter, G
    CZECHOSLOVAK JOURNAL OF PHYSICS, 1996, 46 : 1817 - 1818
  • [34] ANALYSIS OF MULTILEVEL MONTE CARLO PATH SIMULATION USING THE MILSTEIN DISCRETISATION
    Giles, Michael B.
    Debrabant, Kristian
    Roessler, Andreas
    DISCRETE AND CONTINUOUS DYNAMICAL SYSTEMS-SERIES B, 2019, 24 (08): : 3881 - 3903
  • [35] Spaceborne imaging simulation of ship based on Monte Carlo ray tracing method
    Wang Biao
    He Hong-fei
    Lin Jia-xuan
    REMOTE SENSING AND MODELING OF THE ATMOSPHERE, OCEANS, AND INTERACTIONS V, 2014, 9265
  • [36] Improvements in Monte Carlo denoising based on batching
    Deasy, J
    El Naqal, I
    Kawrakow, I
    Siebers, J
    Wickerhauser, M
    Vicic, M
    Fippel, M
    MEDICAL PHYSICS, 2004, 31 (06) : 1731 - 1731
  • [37] Denoising of event-based sensors with deep neural networks
    Zhang, Zhihong
    Suo, Jinli
    Dai, Qionghai
    OPTOELECTRONIC IMAGING AND MULTIMEDIA TECHNOLOGY VIII, 2021, 11897
  • [38] TWO DENOISING ALGORITHMS FOR BI-DIRECTIONAL MONTE CARLO RAY TRACING
    Ershov, S., V
    Zhdanov, D. D.
    Voloboy, A. G.
    Galaktionov, V. A.
    MATHEMATICA MONTISNIGRI, 2018, 43 : 78 - 100
  • [39] Event-Based Feature Extraction Using Adaptive Selection Thresholds
    Afshar, Saeed
    Ralph, Nicholas
    Xu, Ying
    Tapson, Jonathan
    van Schaik, Andre
    Cohen, Gregory
    SENSORS, 2020, 20 (06)
  • [40] Development and validation of a Monte Carlo simulation of a gamma camera using MCNP.
    O'Connor, MK
    Monville, ME
    Nonneman, S
    JOURNAL OF NUCLEAR MEDICINE, 1998, 39 (05) : 97P - 98P