3D recovery of human gaze in natural environments

被引:1
|
作者
Paletta, Lucas [1 ]
Santner, Katrin [1 ]
Fritz, Gerald [1 ]
Mayer, Heinz [1 ]
机构
[1] JOANNEUM RES Forsch Gesellsch mbH, DIGITAL Inst Informat & Commun Technol, A-8010 Graz, Austria
关键词
Mapping; SLAM; Cognitive Human-Robot Interaction; Human Attention Analysis;
D O I
10.1117/12.2008539
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The estimation of human attention has recently been addressed in the context of human robot interaction. Today, joint work spaces already exist and challenge cooperating systems to jointly focus on common objects, scenes and work niches. With the advent of Google glasses and increasingly affordable wearable eye-tracking, monitoring of human attention will soon become ubiquitous. The presented work describes for the first time a method for the estimation of human fixations in 3D environments that does not require any artificial landmarks in the field of view and enables attention mapping in 3D models. It enables full 3D recovery of the human view frustum and the gaze pointer in a previously acquired 3D model of the environment in real time. The study on the precision of this method reports a mean projection error approximate to 1.1 cm and a mean angle error approximate to 0.6 degrees within the chosen 3D model - the precision does not go below the one of the technical instrument (approximate to 1 degrees). This innovative methodology will open new opportunities for joint attention studies as well as for bringing new potential into automated processing for human factors technologies.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] PostureHMR: Posture Transformation for 3D Human Mesh Recovery
    Song, Yu-Pei
    Wu, Xiao
    Yuan, Zhaoquan
    Qiao, Jian-Jun
    Peng, Qiang
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 9732 - 9741
  • [32] ReFit: Recurrent Fitting Network for 3D Human Recovery
    Wang, Yufu
    Daniilidis, Kostas
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 14598 - 14608
  • [33] Deformable Mesh Transformer for 3D Human Mesh Recovery
    Yoshiyasu, Yusuke
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 17006 - 17015
  • [34] META-LEARNED INITIALIZATION FOR 3D HUMAN RECOVERY
    Kim, Mira
    Min, Youngjo
    Kim, Jiwon
    Kim, Seungryong
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 4238 - 4242
  • [35] Efficient 3D recovery of human motion in monocular video
    Chen, Cheng
    Xiao, Jun
    Zhuang, Yueting
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2009, 21 (08): : 1118 - 1126
  • [36] Score-Guided Diffusion for 3D Human Recovery
    Stathopoulos, Anastasis
    Han, Ligong
    Metaxas, Dimitris
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 906 - 915
  • [37] Recovery of 3D human posture from single view
    Sun, Y
    Hu, JS
    Li, MH
    Wang, EL
    ELECTRONIC IMAGING AND MULTIMEDIA TECHNOLOGY III, 2002, 4925 : 229 - 237
  • [38] Using natural vs. artificial stimuli to perform calibration For 3D gaze tracking
    Maggia, Christophe
    Guyader, Nathalie
    Dugue, Anne Guerin
    HUMAN VISION AND ELECTRONIC IMAGING XVIII, 2013, 8651
  • [39] Automatic Generation of Labeled 3D Point Clouds of Natural Environments with Gazebo
    Sanchez, Manuel
    Martinez, Jorge L.
    Morales, Jesus
    Robles, Alfredo
    Moran, Mariano
    2019 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS (ICM), 2019, : 161 - 166
  • [40] 3D scene modelling and curve-based localization in natural environments
    Devy, M
    Parra, C
    1998 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-4, 1998, : 3091 - 3096