A real 3D scene rendering optimization method based on region of interest and viewing frustum prediction in virtual reality

被引:7
|
作者
Dang, Pei [1 ]
Zhu, Jun [1 ]
Wu, Jianlin [1 ]
Li, Weilian [1 ,2 ]
You, Jigang [1 ]
Fu, Lin [1 ]
Shi, Yiqun [3 ]
Gong, Yuhang [4 ]
机构
[1] Southwest Jiaotong Univ, Fac Geosci & Environm Engn, Chengdu, Sichuan, Peoples R China
[2] Univ Bonn, Inst Geodesy & Geoinformat, Bonn, Germany
[3] Southwest Jiaotong Univ, Fac Civil Engn, Chengdu, Peoples R China
[4] Sichuan Inst Land Sci & Technol, Dept Nat Resources Sichuan Prov, Chengdu, Peoples R China
基金
中国国家自然科学基金;
关键词
Real 3D scene; virtual reality; Kalman filter; region of interest; viewing frustum; SACCADE TARGET SELECTION; MESH SIMPLIFICATION; VISUAL-ATTENTION; EYE TRACKING; ALGORITHM;
D O I
10.1080/17538947.2022.2080878
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
As an important technology of digital construction, real 3D models can improve the immersion and realism of virtual reality (VR) scenes. The large amount of data for real 3D scenes requires more effective rendering methods, but the current rendering optimization methods have some defects and cannot render real 3D scenes in virtual reality. In this study, the location of the viewing frustum is predicted by a Kalman filter, and eye-tracking equipment is used to recognize the region of interest (ROI) in the scene. Finally, the real 3D model of interest in the predicted frustum is rendered first. The experimental results show that the method of this study can predict the frustrum location approximately 200 ms in advance, the prediction accuracy is approximately 87%, the scene rendering efficiency is improved by 8.3%, and the motion sickness is reduced by approximately 54.5%. These studies help promote the use of real 3D models in virtual reality and ROI recognition methods. In future work, we will further improve the prediction accuracy of viewing frustums in virtual reality and the application of eye tracking in virtual geographic scenes.
引用
收藏
页码:1081 / 1100
页数:20
相关论文
共 50 条
  • [1] Adaptive 3D Rendering based on Region-of-Interest
    Chamaret, Christel
    Godeffroy, Sylvain
    Lopez, Patrick
    Le Meur, Olivier
    STEREOSCOPIC DISPLAYS AND APPLICATIONS XXI, 2010, 7524
  • [2] A 3D interactive scene construction method for interior design based on virtual reality
    Fan, Yafei
    Liang, Lijuan
    ARTIFICIAL LIFE AND ROBOTICS, 2024, : 173 - 183
  • [3] AN IMPROVED VIEW FRUSTUM CULLING METHOD USING OCTREES FOR 3D REAL-TIME RENDERING
    De Carvalho, Paulo Roberto, Jr.
    Dos Santos, Maikon Cismoski
    Schwartz, William Robson
    Pedrini, Helio
    INTERNATIONAL JOURNAL OF IMAGE AND GRAPHICS, 2013, 13 (03)
  • [4] Design of visual 3D scene based on virtual reality technology
    Ling, Hongyan
    BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2019, 125 : 164 - 165
  • [5] Real-Time 3D Road Scene Based on Virtual-Real Fusion Method
    Wu, Yuezhou
    Liu, Changjiang
    Lan, Shiyong
    Yang, Menglong
    IEEE SENSORS JOURNAL, 2015, 15 (02) : 750 - 756
  • [6] Animation Design and Virtual Reality Dynamic Scene Rendering Optimization Based on Transformer Model
    Xie, Yannan
    Sirisuk, Metta
    Computer-Aided Design and Applications, 2024, 21 (S28): : 1 - 14
  • [7] MeshReduce: Split Rendering of Live 3D Scene for Virtual Teleportation
    Jin, Tao
    Lu, Edward
    Dasari, Mallesham
    Apicharttrisorn, Kittipat
    Seshan, Srinivasan
    Rowe, Anthony
    2024 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS, VRW 2024, 2024, : 1186 - 1187
  • [8] Optimization of the Virtual Scene Layout Based on the Optimal 3D Viewpoint
    Zhang, Yan
    Yang, Gang
    IEEE ACCESS, 2022, 10 : 110426 - 110443
  • [9] Spatiotemporal Antialiasing for Rendering 3D Scene with Specular Effect based on Virtual Hit Points
    Liang, Weidong
    Chen, Chunyi
    Hu, Xiaojuan
    Xing, Qiwei
    Yang, Huamin
    ICVIP 2019: PROCEEDINGS OF 2019 3RD INTERNATIONAL CONFERENCE ON VIDEO AND IMAGE PROCESSING, 2019, : 183 - 189
  • [10] CAPTURE, REPRESENTATION, AND RENDERING OF 3D AUDIO FOR VIRTUAL AND AUGMENTED REALITY
    Tashev, Ivan J.
    INTERNATIONAL JOURNAL ON INFORMATION TECHNOLOGIES AND SECURITY, 2019, 11 : 49 - 62