A real 3D scene rendering optimization method based on region of interest and viewing frustum prediction in virtual reality

被引:7
|
作者
Dang, Pei [1 ]
Zhu, Jun [1 ]
Wu, Jianlin [1 ]
Li, Weilian [1 ,2 ]
You, Jigang [1 ]
Fu, Lin [1 ]
Shi, Yiqun [3 ]
Gong, Yuhang [4 ]
机构
[1] Southwest Jiaotong Univ, Fac Geosci & Environm Engn, Chengdu, Sichuan, Peoples R China
[2] Univ Bonn, Inst Geodesy & Geoinformat, Bonn, Germany
[3] Southwest Jiaotong Univ, Fac Civil Engn, Chengdu, Peoples R China
[4] Sichuan Inst Land Sci & Technol, Dept Nat Resources Sichuan Prov, Chengdu, Peoples R China
基金
中国国家自然科学基金;
关键词
Real 3D scene; virtual reality; Kalman filter; region of interest; viewing frustum; SACCADE TARGET SELECTION; MESH SIMPLIFICATION; VISUAL-ATTENTION; EYE TRACKING; ALGORITHM;
D O I
10.1080/17538947.2022.2080878
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
As an important technology of digital construction, real 3D models can improve the immersion and realism of virtual reality (VR) scenes. The large amount of data for real 3D scenes requires more effective rendering methods, but the current rendering optimization methods have some defects and cannot render real 3D scenes in virtual reality. In this study, the location of the viewing frustum is predicted by a Kalman filter, and eye-tracking equipment is used to recognize the region of interest (ROI) in the scene. Finally, the real 3D model of interest in the predicted frustum is rendered first. The experimental results show that the method of this study can predict the frustrum location approximately 200 ms in advance, the prediction accuracy is approximately 87%, the scene rendering efficiency is improved by 8.3%, and the motion sickness is reduced by approximately 54.5%. These studies help promote the use of real 3D models in virtual reality and ROI recognition methods. In future work, we will further improve the prediction accuracy of viewing frustums in virtual reality and the application of eye tracking in virtual geographic scenes.
引用
收藏
页码:1081 / 1100
页数:20
相关论文
共 50 条
  • [41] Research on Optimization of 3D Tourism Virtual Crossover Scene based on Semantic Perception Analysis
    Wang, Guixia
    ADVANCES IN MULTIMEDIA, 2022, 2022
  • [42] A 3D Authoring Method by Editing Real World Scene
    Lin, Jiaqing
    Nishino, Hiroaki
    Kagawa, Tsuneo
    2014 EIGHTH INTERNATIONAL CONFERENCE ON COMPLEX, INTELLIGENT AND SOFTWARE INTENSIVE SYSTEMS (CISIS),, 2014, : 324 - 330
  • [43] 3D Scene Reconstruction and Digitization Method for Mixed Reality Systems
    M. I. Sorokin
    D. D. Zhdanov
    A. D. Zhdanov
    Programming and Computer Software, 2023, 49 : 151 - 160
  • [44] 3D Scene Reconstruction and Digitization Method for Mixed Reality Systems
    Sorokin, M. I.
    Zhdanov, D. D.
    Zhdanov, A. D.
    PROGRAMMING AND COMPUTER SOFTWARE, 2023, 49 (03) : 151 - 160
  • [45] Triangle mesh optimization for improving rendering quality of 3D virtual environments
    Guo, Qingwei
    Yue, Weining
    Li, Qicheng
    Wang, Guoping
    VIRTUAL REALITY, PROCEEDINGS, 2007, 4563 : 62 - +
  • [46] Proposal of Digital Twin Platform Based on 3D Rendering and IIoT Principles Using Virtual/Augmented Reality
    Leskovsky, Roman
    Kucera, Erik
    Haffner, Oto
    Rosinova, Danica
    PROCEEDINGS OF THE 2020 30TH INTERNATIONAL CONFERENCE CYBERNETICS & INFORMATICS (K&I '20), 2020,
  • [47] Research on Data Lightweight Method for Real Scene 3D Based on Interactive Markup
    Lu, Xin
    2024 5TH INTERNATIONAL CONFERENCE ON GEOLOGY, MAPPING AND REMOTE SENSING, ICGMRS 2024, 2024, : 256 - 259
  • [48] The Fundamental Theory of True 3D Virtual Reality and The Development of Scene Structure Research
    Liu, Hongli
    You, Doudou
    Cai, Juan
    Liu, Caixia
    PROCEEDINGS OF THE 2015 6TH INTERNATIONAL CONFERENCE ON MANUFACTURING SCIENCE AND ENGINEERING, 2016, 32 : 892 - 897
  • [49] 3D Reconstruction Method of Virtual and Real Fusion Based on Machine Learning
    Zhu, Wenyao
    Zhou, Shuyue
    Mathematical Problems in Engineering, 2022, 2022
  • [50] 3D Reconstruction Method of Virtual and Real Fusion Based on Machine Learning
    Zhu, Wenyao
    Zhou, Shuyue
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2022, 2022