Iris Geometric Transformation Guided Deep Appearance-Based Gaze Estimation

被引:0
|
作者
Nie, Wei [1 ]
Wang, Zhiyong [1 ]
Ren, Weihong [1 ]
Zhang, Hanlin [1 ]
Liu, Honghai [1 ,2 ]
机构
[1] Harbin Inst Technol Shenzhen, State Key Lab Robot & Syst, Shenzhen 518055, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518000, Peoples R China
基金
中国国家自然科学基金;
关键词
Estimation; Iris; Artificial neural networks; Three-dimensional displays; Feature extraction; Faces; Multitasking; Training; Heating systems; Vectors; Appearance-based gaze estimation; deep learning; geometric priors; eye landmarks; EYE; VISION;
D O I
10.1109/TIP.2025.3546465
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The geometric alterations in the iris's appearance are intricately linked to the gaze direction. However, current deep appearance-based gaze estimation methods mainly rely on latent feature sharing to leverage iris features for improving deep representation learning, often neglecting the explicit modeling of their geometric relationships. To address this issue, this paper revisits the physiological structure of the eyeball and introduces a set of geometric assumptions, such as "the normal vector of the iris center approximates the gaze direction". Building on these assumptions, we propose an Iris Geometric Transformation Guided Gaze estimation (IGTG-Gaze) module, which establishes an explicit geometric parameter sharing mechanism to link gaze direction and sparse iris landmark coordinates directly. Extensive experimental results demonstrate that IGTG-Gaze seamlessly integrates into various deep neural networks, flexibly extends from sparse iris landmarks to dense eye mesh, and consistently achieves leading performance in both within- and cross-dataset evaluations, all while maintaining end-to-end optimization. These advantages highlight IGTG-Gaze as a practical and effective approach for enhancing deep gaze representation from appearance.
引用
收藏
页码:1616 / 1631
页数:16
相关论文
共 50 条
  • [1] Appearance-Based Gaze Estimation With Deep Learning: A Review and Benchmark
    Cheng, Yihua
    Wang, Haofei
    Bao, Yiwei
    Lu, Feng
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (12) : 7509 - 7528
  • [2] Appearance-based eye gaze estimation
    Tan, KH
    Kriegman, DJ
    Ahuja, N
    SIXTH IEEE WORKSHOP ON APPLICATIONS OF COMPUTER VISION, PROCEEDINGS, 2002, : 191 - 195
  • [3] Appearance-Based Gaze Estimation in the Wild
    Zhang, Xucong
    Sugano, Yusuke
    Fritz, Mario
    Bulling, Andreas
    2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 4511 - 4520
  • [4] MPIIGaze: Real World Dataset and Deep Appearance-Based Gaze Estimation
    Zhang, Xucong
    Sugano, Yusuke
    Fritz, Mario
    Bulling, Andreas
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (01) : 162 - 175
  • [5] Appearance-Based Gaze Estimation via Evaluation-Guided Asymmetric Regression
    Cheng, Yihua
    Lu, Feng
    Zhang, Xucong
    COMPUTER VISION - ECCV 2018, PT XIV, 2018, 11218 : 105 - 121
  • [6] Appearance-Based Gaze Estimation for ASD Diagnosis
    Li, Jing
    Chen, Zejin
    Zhong, Yihao
    Lam, Hak-Keung
    Han, Junxia
    Ouyang, Gaoxiang
    Li, Xiaoli
    Liu, Honghai
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (07) : 6504 - 6517
  • [7] Appearance-based Gaze Estimation using Kinect
    Choi, Jinsoo
    Ahn, Byungtae
    Park, Jaesik
    Kweon, In So
    2013 10TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS AND AMBIENT INTELLIGENCE (URAI), 2013, : 260 - 261
  • [8] Appearance-Based Gaze Estimation for Driver Monitoring
    Nikan, Soodeh
    Upadhyay, Devesh
    GAZE MEETS MACHINE LEARNING WORKSHOP, VOL 210, 2022, 210 : 127 - 139
  • [9] Appearance-based gaze estimation using deep features and random forest regression
    Wang, Yafei
    Shen, Tianyi
    Yuan, Guoliang
    Bian, Jiming
    Fu, Xianping
    KNOWLEDGE-BASED SYSTEMS, 2016, 110 : 293 - 301
  • [10] Revisiting Data Normalization for Appearance-Based Gaze Estimation
    Zhang, Xucong
    Sugano, Yusuke
    Bulling, Andreas
    2018 ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS (ETRA 2018), 2018,