Jrender: An efficient differentiable rendering library based on Jittor

被引:1
|
作者
Xin, Hanggao [1 ]
Xiang, Chenzhong [1 ]
Zhou, Wenyang [1 ]
Liang, Dun [1 ]
机构
[1] Tsinghua Univ, Beijing, Peoples R China
关键词
Differentiable rendering; Real-time rendering; Deep learning; IMAGE; RECONSTRUCTION;
D O I
10.1016/j.gmod.2023.101202
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Differentiable rendering has been proven as a powerful tool to bridge 2D images and 3D models. With the aid of differentiable rendering, tasks in computer vision and computer graphics could be solved more elegantly and accurately. To address challenges in the implementations of differentiable rendering methods, we present an efficient and modular differentiable rendering library named Jrender based on Jittor. Jrender supports surface rendering for 3D meshes and volume rendering for 3D volumes. Compared with previous differentiable renderers, Jrender exhibits a significant improvement in both performance and rendering quality. Due to the modular design, various rendering effects such as PBR materials shading, ambient occlusions, soft shadows, global illumination, and subsurface scattering could be easily supported in Jrender, which are not available in other differentiable rendering libraries. To validate our library, we integrate Jrender into applications such as 3D object reconstruction and NeRF, which show that our implementations could achieve the same quality with higher performance.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Efficient Specular Glints Rendering With Differentiable Regularization
    Fan, Jiahui
    Wang, Beibei
    Wu, Wenshi
    Hasan, Milos
    Yang, Jian
    Yan, Ling-Qi
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2023, 29 (06) : 2940 - 2949
  • [2] Efficient participating media rendering with differentiable regularization
    Wu, Wenshi
    Wang, Beibei
    Hasan, Milos
    Zhang, Lei
    Jin, Zhong
    Yan, Ling-Qi
    COMPUTATIONAL VISUAL MEDIA, 2024, 10 (05) : 937 - 948
  • [3] Efficient Multi-View Inverse Rendering Using a Hybrid Differentiable Rendering Method
    Zhu, Xiangyang
    Pan, Yiling
    Deng, Bailin
    Wang, Bin
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 1849 - 1857
  • [4] Curved Image Triangulation Based on Differentiable Rendering
    Wang, Wanyi
    Chen, Zhonggui
    Fang, Lincong
    Cao, Juan
    COMPUTER GRAPHICS FORUM, 2024, 43 (07)
  • [5] Differentiable Point-based Inverse Rendering
    Chung, Hoon-Gyu
    Choi, Seokjun
    Baek, Seung-Hwan
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 4399 - 4409
  • [6] Differentiable Transient Rendering
    Yi, Shinyoung
    Kim, Donggun
    Choi, Kiseok
    Jarabo, Adrian
    Gutierrez, Diego
    Kim, Min H.
    ACM TRANSACTIONS ON GRAPHICS, 2021, 40 (06):
  • [7] Physics-Based Differentiable Rendering for Efficient and Plausible Fluid Modeling from Monocular Video
    Cen, Yunchi
    Zhang, Qifan
    Liang, Xiaohui
    ENTROPY, 2023, 25 (09)
  • [8] JNeRF: An efficient heterogeneous NeRF model zoo based on Jittor
    Yang, Guo-Wei
    Liu, Zheng-Ning
    Li, Dong-Yang
    Peng, Hao-Yang
    COMPUTATIONAL VISUAL MEDIA, 2023, 9 (02) : 401 - 404
  • [9] JNeRF: An efficient heterogeneous NeRF model zoo based on Jittor
    Guo-Wei Yang
    Zheng-Ning Liu
    Dong-Yang Li
    Hao-Yang Peng
    Computational Visual Media, 2023, 9 : 401 - 404
  • [10] Dynamic ocean inverse modeling based on differentiable rendering
    Xueguang Xie
    Yang Gao
    Fei Hou
    Aimin Hao
    Hong Qin
    Computational Visual Media, 2024, 10 : 279 - 294