Seamless 3D Interaction of Virtual and Real Objects in Professional Virtual Studios

被引：5
|
作者：
Hach T.
Arias P. [1 ]
Bosch C. [2 ]
Montesa J.
Gasco P. [3 ]
机构：
[1] Hach, Thomas
[2] Arias, Pablo
[3] Bosch, Carles
[4] Montesa, Javier
[5] Gasco, Pablo
来源：
| 1600年 / Society of Motion Picture and Television Engineers卷 / 126期
关键词：
broadcast; depth upscaling; green screen compositing; RGB+D; RGB+Z; time-of-flight; virtual studio;
D O I：
10.5594/JMI.2016.2632398
中图分类号：
学科分类号：
摘要：
This paper presents a novel pipeline for adding 3D geometry information to conventional green screen assets in virtual broadcast studios. Today's green screen studios are limited to 2D object interaction. Information about depth is not available, and hence the 3D relation to nonvirtual objects is unknown. We overcome this situation by using an integrated RGB+depth camera and a specialized processing pipeline, which delivers an additional synchronized depth channel in realtime. This technology enables interaction of virtual and real objects, including shadow casting and occluding virtual objects. We implemented and tested several of these effects within a professional virtual studio renderer. © 2002 Society of Motion Picture and Television Engineers, Inc.
引用
收藏
页码：43 / 56
页数：13
相关论文
共 50 条
  • [1] 3D Interaction with Virtual Objects in Real Water
    Costa, Raphael
    Quarles, John
    2019 11TH INTERNATIONAL CONFERENCE ON VIRTUAL WORLDS AND GAMES FOR SERIOUS APPLICATIONS (VS-GAMES), 2019, : 48 - 54
  • [2] A study of overlapping virtual objects on real objects in 3D space
    Kondo, T
    Matsunaga, K
    Shidoji, K
    Matsuki, Y
    MEDICINE MEETS VIRTUAL REALITY 12: BUILDING A BETTER YOU: THE NEXT TOOLS FOR MEDICAL EDUCATION, DIAGNOSIS , AND CARE, 2004, 98 : 171 - 173
  • [3] Seamless 3D interaction for virtual tables, projection planes, and Caves
    Encarnaçao, LM
    Bimber, O
    Schmalstieg, D
    Barton, RJ
    COCKPIT DISPLAYS VII: DISPLAYS FOR DEFENSE APPLICATIONS, 2000, 4022 : 177 - 188
  • [4] Usage of Android device in interaction with 3D virtual objects
    Prazina, I.
    Okanovic, V.
    Balic, K.
    Rizvic, S.
    2017 40TH INTERNATIONAL CONVENTION ON INFORMATION AND COMMUNICATION TECHNOLOGY, ELECTRONICS AND MICROELECTRONICS (MIPRO), 2017, : 244 - 246
  • [5] Virtual Shadows for Real Humans in a CAVE: Influence on Virtual Embodiment and 3D Interaction
    Cortes, Guillaume
    Argelaguet, Ferran
    Marchand, Eric
    Lecuyer, Anatole
    ACM SYMPOSIUM ON APPLIED PERCEPTION (SAP 2018), 2018,
  • [6] Virtual Shadows for Real Humans in a CAVE: Influence on Virtual Embodiment and 3D Interaction
    Cortes, Guillaume
    Argelaguet, Ferran
    Marchand, Eric
    Lecuyer, Anatole
    ACM SYMPOSIUM ON APPLIED PERCEPTION (SAP 2018), 2018,
  • [7] Digitized Holography: Spatial 3D Imaging of Virtual and Real Objects
    Matsushima, Kyoji
    Arima, Yasuaki
    Nakahara, Sumio
    THREE-DIMENSIONAL IMAGING, VISUALIZATION, AND DISPLAY 2011, 2011, 8043
  • [8] A gesture control system for intuitive 3D interaction with virtual objects
    Manders, Corey
    Farbiz, Farzam
    Yin, Tang Ka
    Yuan Miaolong
    Guan, Chua Gim
    COMPUTER ANIMATION AND VIRTUAL WORLDS, 2010, 21 (02) : 117 - 129
  • [9] Presentation and interaction of virtual 3D objects without geometric model
    Uchiyama, S
    Yamamoto, H
    Katayama, A
    Tamura, H
    DESIGN OF COMPUTING SYSTEMS: SOCIAL AND ERGONOMIC CONSIDERATIONS, 1997, 21 : 869 - 872
  • [10] Real-time hand gesture-based interaction with objects in 3D virtual environments
    Kim, Jong-Oh
    Kim, Mihye
    Yoo, Kwan-Hee
    International Journal of Multimedia and Ubiquitous Engineering, 2013, 8 (06): : 339 - 348
12345