3D recovery of human gaze in natural environments

被引:1
|
作者
Paletta, Lucas [1 ]
Santner, Katrin [1 ]
Fritz, Gerald [1 ]
Mayer, Heinz [1 ]
机构
[1] JOANNEUM RES Forsch Gesellsch mbH, DIGITAL Inst Informat & Commun Technol, A-8010 Graz, Austria
关键词
Mapping; SLAM; Cognitive Human-Robot Interaction; Human Attention Analysis;
D O I
10.1117/12.2008539
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The estimation of human attention has recently been addressed in the context of human robot interaction. Today, joint work spaces already exist and challenge cooperating systems to jointly focus on common objects, scenes and work niches. With the advent of Google glasses and increasingly affordable wearable eye-tracking, monitoring of human attention will soon become ubiquitous. The presented work describes for the first time a method for the estimation of human fixations in 3D environments that does not require any artificial landmarks in the field of view and enables attention mapping in 3D models. It enables full 3D recovery of the human view frustum and the gaze pointer in a previously acquired 3D model of the environment in real time. The study on the precision of this method reports a mean projection error approximate to 1.1 cm and a mean angle error approximate to 0.6 degrees within the chosen 3D model - the precision does not go below the one of the technical instrument (approximate to 1 degrees). This innovative methodology will open new opportunities for joint attention studies as well as for bringing new potential into automated processing for human factors technologies.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Remote Gaze Tracking System for 3D Environments
    Liu, Congcong
    Herrup, Karl
    Shi, Bertram E.
    2017 39TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2017, : 1768 - 1771
  • [2] Efficient analysis of gaze-behavior in 3D environments
    Pfeiffer, Thies
    Renner, Patrick
    Pfeiffer-Lessmann, Nadine
    COGNITIVE PROCESSING, 2014, 15 (01) : S127 - S129
  • [3] Visual Recovery of Saliency Maps from Human Attention in 3D Environments
    Santner, Katrin
    Fritz, Gerald
    Paletta, Lucas
    Mayer, Heinz
    2013 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2013, : 4297 - 4303
  • [4] A Calibration Interface for 3D Gaze Depth Disambiguation in Virtual Environments
    Boyd, Cameron
    Thompson, Mia
    Smith, Madeline
    Dorai, Gokila
    Orlosky, Jason
    2024 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS, VRW 2024, 2024, : 695 - 696
  • [5] Playing for 3D Human Recovery
    Cai, Zhongang
    Zhang, Mingyuan
    Ren, Jiawei
    Wei, Chen
    Ren, Daxuan
    Lin, Zhengyu
    Zhao, Haiyu
    Yang, Lei
    Loy, Chen Change
    Liu, Ziwei
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (12) : 10533 - 10545
  • [6] Gaze-to-Object Mapping during Visual Search in 3D Virtual Environments
    Bernhard, Matthias
    Stavrakis, Efstathios
    Hecher, Michael
    Wimmer, Michael
    ACM TRANSACTIONS ON APPLIED PERCEPTION, 2014, 11 (03)
  • [7] A study on human gaze detection based on 3D eye model
    Park, Kang Ryoung
    ARTICULATED MOTION AND DEFORMABLE OBJECTS, PROCEEDINGS, 2006, 4069 : 1 - 9
  • [8] 3D gaze tracking and analysis for attentive Human Computer Interaction
    Ki, Jeongseok
    Kwon, Yong-Moo
    Sohn, Kwanghoon
    PROCEEDINGS OF THE FRONTIERS IN THE CONVERGENCE OF BIOSCIENCE AND INFORMATION TECHNOLOGIES, 2007, : 617 - +
  • [9] 3D Gaze Tracking System for NVidia 3D Vision
    Wibirama, Sunu
    Hamamoto, Kazuhiko
    2013 35TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2013, : 3194 - 3197
  • [10] 3D gaze estimation and interaction
    Ki, Jeongseok
    Kwon, Yong-Moo
    2008 3DTV-CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO, 2008, : 353 - 356