A real 3D scene rendering optimization method based on region of interest and viewing frustum prediction in virtual reality

被引:7
|
作者
Dang, Pei [1 ]
Zhu, Jun [1 ]
Wu, Jianlin [1 ]
Li, Weilian [1 ,2 ]
You, Jigang [1 ]
Fu, Lin [1 ]
Shi, Yiqun [3 ]
Gong, Yuhang [4 ]
机构
[1] Southwest Jiaotong Univ, Fac Geosci & Environm Engn, Chengdu, Sichuan, Peoples R China
[2] Univ Bonn, Inst Geodesy & Geoinformat, Bonn, Germany
[3] Southwest Jiaotong Univ, Fac Civil Engn, Chengdu, Peoples R China
[4] Sichuan Inst Land Sci & Technol, Dept Nat Resources Sichuan Prov, Chengdu, Peoples R China
基金
中国国家自然科学基金;
关键词
Real 3D scene; virtual reality; Kalman filter; region of interest; viewing frustum; SACCADE TARGET SELECTION; MESH SIMPLIFICATION; VISUAL-ATTENTION; EYE TRACKING; ALGORITHM;
D O I
10.1080/17538947.2022.2080878
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
As an important technology of digital construction, real 3D models can improve the immersion and realism of virtual reality (VR) scenes. The large amount of data for real 3D scenes requires more effective rendering methods, but the current rendering optimization methods have some defects and cannot render real 3D scenes in virtual reality. In this study, the location of the viewing frustum is predicted by a Kalman filter, and eye-tracking equipment is used to recognize the region of interest (ROI) in the scene. Finally, the real 3D model of interest in the predicted frustum is rendered first. The experimental results show that the method of this study can predict the frustrum location approximately 200 ms in advance, the prediction accuracy is approximately 87%, the scene rendering efficiency is improved by 8.3%, and the motion sickness is reduced by approximately 54.5%. These studies help promote the use of real 3D models in virtual reality and ROI recognition methods. In future work, we will further improve the prediction accuracy of viewing frustums in virtual reality and the application of eye tracking in virtual geographic scenes.
引用
收藏
页码:1081 / 1100
页数:20
相关论文
共 50 条
  • [21] 3D reconstruction method of forest landscape based on virtual reality
    Zhong Li
    Yu-Dong Zhang
    Multimedia Tools and Applications, 2020, 79 : 16369 - 16383
  • [22] 3D virtual colonoscopy with real-time volume rendering
    Wan, M
    Li, W
    Kreeger, K
    Bitter, I
    Kaufman, A
    Liang, ZR
    Chen, DQ
    Wax, M
    MEDICAL IMAGING 2000: PHYSIOLOGY AND FUNCTION FORM MULTIDIMENSIONAL IMAGES, 2000, 3978 : 165 - 171
  • [23] Dynamic 3D display of mixed virtual and real scene based on digitized holography
    Li, Yong
    He, Liang-bo
    Zhan, Jian-dong
    Huang, Kai
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2022, 37 (05) : 632 - 638
  • [24] 3D modelling based on virtual reality
    Zhaparov, M. K.
    Nassen, Y.
    2016 6th International Conference - Cloud System and Big Data Engineering (Confluence), 2016, : 399 - 402
  • [25] Analysis of 3D reconstruction of large-scale architectural scene based on virtual reality
    Li Fang
    Jiang Tao
    Gang Jia-lin
    2017 INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS, ELECTRONICS AND CONTROL (ICCSEC), 2017, : 142 - 146
  • [26] Study and Implementation of 3D Scene Management and Real-Time Rendering Technology Based on OSG
    Qun, Wei
    Lie, Xu
    ELECTRONIC INFORMATION AND ELECTRICAL ENGINEERING, 2012, 19 : 529 - 532
  • [27] Real-time 3D Audio Downmixing System based on Sound Rendering for the Immersive Sound of Mobile Virtual Reality Applications
    Hong, Dukki
    Kwon, Hyuck-Joo
    Kim, Cheong Ghil
    Park, Woo-Chan
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2018, 12 (12): : 5936 - 5954
  • [28] 3D Object Detection Algorithm Based on the Reconstruction of Sparse Point Clouds in the Viewing Frustum
    Xu, Xing
    Wu, Xiang
    Zhao, Yun
    Lue, Xiaoshu
    Aapaoja, Aki
    MOBILE INFORMATION SYSTEMS, 2022, 2022
  • [29] Method for Creating Virtual Copies of Real Labs in a 2D Environment, Representing a 3D Virtual Reality
    Evstatiev, Boris
    Doychinov, Yordan
    Gabrovska-Evstatieva, Katerina
    2018 IEEE 24TH INTERNATIONAL SYMPOSIUM FOR DESIGN AND TECHNOLOGY IN ELECTRONIC PACKAGING (SIITME), 2018, : 138 - 141
  • [30] An absolute orientation realization method based on 3d real scene model
    Du, Shuhan
    Yi, Hui
    Chen, Xiangning
    Xu, Bijie
    Wang, Haoyue
    3RD INTERNATIONAL FORUM ON GEOSCIENCE AND GEODESY, 2021, 658