3D recovery of human gaze in natural environments

被引:1
|
作者
Paletta, Lucas [1 ]
Santner, Katrin [1 ]
Fritz, Gerald [1 ]
Mayer, Heinz [1 ]
机构
[1] JOANNEUM RES Forsch Gesellsch mbH, DIGITAL Inst Informat & Commun Technol, A-8010 Graz, Austria
关键词
Mapping; SLAM; Cognitive Human-Robot Interaction; Human Attention Analysis;
D O I
10.1117/12.2008539
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The estimation of human attention has recently been addressed in the context of human robot interaction. Today, joint work spaces already exist and challenge cooperating systems to jointly focus on common objects, scenes and work niches. With the advent of Google glasses and increasingly affordable wearable eye-tracking, monitoring of human attention will soon become ubiquitous. The presented work describes for the first time a method for the estimation of human fixations in 3D environments that does not require any artificial landmarks in the field of view and enables attention mapping in 3D models. It enables full 3D recovery of the human view frustum and the gaze pointer in a previously acquired 3D model of the environment in real time. The study on the precision of this method reports a mean projection error approximate to 1.1 cm and a mean angle error approximate to 0.6 degrees within the chosen 3D model - the precision does not go below the one of the technical instrument (approximate to 1 degrees). This innovative methodology will open new opportunities for joint attention studies as well as for bringing new potential into automated processing for human factors technologies.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Intuitive human-robot interaction through active 3D gaze tracking
    Atienza, R
    Zelinsky, A
    Robotics Research, 2005, 15 : 172 - 181
  • [42] Java']Java 3D, 3D graphical environments and behaviour
    Burrows, AL
    England, D
    SOFTWARE-PRACTICE & EXPERIENCE, 2002, 32 (04): : 359 - 376
  • [43] Neural 3D Gaze: 3D Pupil Localization and Gaze Tracking based on Anatomical Eye Model and Neural Refraction Correction
    Lu, Conny
    Chakravarthula, Praneeth
    Liu, Kaihao
    Liu, Xixiang
    Li, Siyuan
    Fuchs, Henry
    2022 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR 2022), 2022, : 375 - 383
  • [44] Human knowledge acquisition from 3D interaction in virtual environments
    Cheng Cheng
    Jiang Ru
    Dong XueMei
    SCIENCE CHINA-INFORMATION SCIENCES, 2012, 55 (07) : 1528 - 1540
  • [46] Human knowledge acquisition from 3D interaction in virtual environments
    Cheng Cheng
    Ru Jiang
    XueMei Dong
    Science China Information Sciences, 2012, 55 : 1528 - 1540
  • [47] Human-Information Interaction in 3D Immersive Virtual Environments
    Komlodi, A.
    Hercegfi, K.
    Jozsa, E.
    Koles, M.
    3RD IEEE INTERNATIONAL CONFERENCE ON COGNITIVE INFOCOMMUNICATIONS (COGINFOCOM 2012), 2012, : 597 - 600
  • [48] PoseScript: 3D Human Poses from Natural Language
    Delmas, Ginger
    Weinzaepfel, Philippe
    Lucas, Thomas
    Moreno-Noguer, Francesc
    Rogez, Gregory
    COMPUTER VISION - ECCV 2022, PT VI, 2022, 13666 : 346 - 362
  • [49] PoseFix: Correcting 3D Human Poses with Natural Language
    Delmas, Ginger
    Weinzaepfel, Philippe
    Moreno-Noguer, Francesc
    Rogez, Gregory
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 14972 - 14982
  • [50] Reactive Gaze during Locomotion in Natural Environments
    Melgare, J. K.
    Rohmer, D.
    Musse, S. R.
    Cani, M-P.
    ACM SIGGRAPH / EUROGRAPHICS SYMPOSIUM OF COMPUTER ANIMATION 2024, 2024,