Iris Geometric Transformation Guided Deep Appearance-Based Gaze Estimation

被引:0
|
作者
Nie, Wei [1 ]
Wang, Zhiyong [1 ]
Ren, Weihong [1 ]
Zhang, Hanlin [1 ]
Liu, Honghai [1 ,2 ]
机构
[1] Harbin Inst Technol Shenzhen, State Key Lab Robot & Syst, Shenzhen 518055, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518000, Peoples R China
基金
中国国家自然科学基金;
关键词
Estimation; Iris; Artificial neural networks; Three-dimensional displays; Feature extraction; Faces; Multitasking; Training; Heating systems; Vectors; Appearance-based gaze estimation; deep learning; geometric priors; eye landmarks; EYE; VISION;
D O I
10.1109/TIP.2025.3546465
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The geometric alterations in the iris's appearance are intricately linked to the gaze direction. However, current deep appearance-based gaze estimation methods mainly rely on latent feature sharing to leverage iris features for improving deep representation learning, often neglecting the explicit modeling of their geometric relationships. To address this issue, this paper revisits the physiological structure of the eyeball and introduces a set of geometric assumptions, such as "the normal vector of the iris center approximates the gaze direction". Building on these assumptions, we propose an Iris Geometric Transformation Guided Gaze estimation (IGTG-Gaze) module, which establishes an explicit geometric parameter sharing mechanism to link gaze direction and sparse iris landmark coordinates directly. Extensive experimental results demonstrate that IGTG-Gaze seamlessly integrates into various deep neural networks, flexibly extends from sparse iris landmarks to dense eye mesh, and consistently achieves leading performance in both within- and cross-dataset evaluations, all while maintaining end-to-end optimization. These advantages highlight IGTG-Gaze as a practical and effective approach for enhancing deep gaze representation from appearance.
引用
收藏
页码:1616 / 1631
页数:16
相关论文
共 50 条
  • [41] TabletGaze: dataset and analysis for unconstrained appearance-based gaze estimation in mobile tablets
    Qiong Huang
    Ashok Veeraraghavan
    Ashutosh Sabharwal
    Machine Vision and Applications, 2017, 28 : 445 - 461
  • [42] CI-Net: Appearance-Based Gaze Estimation via Cooperative Network
    Luo, Yuan
    Chen, Jiangtao
    Chen, Jian
    IEEE ACCESS, 2022, 10 : 78739 - 78746
  • [43] SuperVision: Self-Supervised Super-Resolution for Appearance-Based Gaze Estimation
    O'Shea, Galen
    Komeili, Majid
    GAZE MEETS MACHINE LEARNING WORKSHOP, 2023, 226 : 197 - 217
  • [44] Appearance-based gaze estimation with feature fusion of multi-level information elements
    Ren, Zhonghe
    Fang, Fengzhou
    Hou, Gaofeng
    Li, Zihao
    Niu, Rui
    JOURNAL OF COMPUTATIONAL DESIGN AND ENGINEERING, 2023, 10 (03) : 1080 - 1109
  • [45] InvisibleEye: Fully Embedded Mobile Eye Tracking Using Appearance-Based Gaze Estimation
    Steil, Julian
    Tonsen, Marc
    Sugano, Yusuke
    Bulling, Andreas
    GETMOBILE-MOBILE COMPUTING & COMMUNICATIONS REVIEW, 2019, 23 (02) : 30 - 34
  • [46] Appearance-Based Gaze Estimation Method Using Static Transformer Temporal Differential Network
    Li, Yujie
    Huang, Longzhao
    Chen, Jiahui
    Wang, Xiwen
    Tan, Benying
    MATHEMATICS, 2023, 11 (03)
  • [47] Democratizing eye-tracking? Appearance-based gaze estimation with improved attention branch
    Kuric, Eduard
    Demcak, Peter
    Majzel, Jozef
    Nguyen, Giang
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 149
  • [48] EG-Net: Appearance-based eye gaze estimation using an efficient gaze network with attention mechanism
    Wu, Xinmei
    Li, Lin
    Zhu, Haihong
    Zhou, Gang
    Li, Linfeng
    Su, Fei
    He, Shen
    Wang, Yanggang
    Long, Xue
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238
  • [49] Appearance-based Gaze Tracking with Free Head Movement
    Lai, Chih-Chuan
    Chen, Yu-Ting
    Chen, Kuan-Wen
    Chen, Shen-Chi
    Shih, Sheng-Wen
    Hung, Yi-Ping
    2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, : 1869 - 1873
  • [50] Evaluating User Experience and Data Quality in Gamified Data Collection for Appearance-Based Gaze Estimation
    Yue, Mingtao
    Sayuda, Tomomi
    Pennington, Miles
    Sugano, Yusuke
    INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 2024,