Iris Geometric Transformation Guided Deep Appearance-Based Gaze Estimation

被引:0
|
作者
Nie, Wei [1 ]
Wang, Zhiyong [1 ]
Ren, Weihong [1 ]
Zhang, Hanlin [1 ]
Liu, Honghai [1 ,2 ]
机构
[1] Harbin Inst Technol Shenzhen, State Key Lab Robot & Syst, Shenzhen 518055, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518000, Peoples R China
基金
中国国家自然科学基金;
关键词
Estimation; Iris; Artificial neural networks; Three-dimensional displays; Feature extraction; Faces; Multitasking; Training; Heating systems; Vectors; Appearance-based gaze estimation; deep learning; geometric priors; eye landmarks; EYE; VISION;
D O I
10.1109/TIP.2025.3546465
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The geometric alterations in the iris's appearance are intricately linked to the gaze direction. However, current deep appearance-based gaze estimation methods mainly rely on latent feature sharing to leverage iris features for improving deep representation learning, often neglecting the explicit modeling of their geometric relationships. To address this issue, this paper revisits the physiological structure of the eyeball and introduces a set of geometric assumptions, such as "the normal vector of the iris center approximates the gaze direction". Building on these assumptions, we propose an Iris Geometric Transformation Guided Gaze estimation (IGTG-Gaze) module, which establishes an explicit geometric parameter sharing mechanism to link gaze direction and sparse iris landmark coordinates directly. Extensive experimental results demonstrate that IGTG-Gaze seamlessly integrates into various deep neural networks, flexibly extends from sparse iris landmarks to dense eye mesh, and consistently achieves leading performance in both within- and cross-dataset evaluations, all while maintaining end-to-end optimization. These advantages highlight IGTG-Gaze as a practical and effective approach for enhancing deep gaze representation from appearance.
引用
收藏
页码:1616 / 1631
页数:16
相关论文
共 50 条
  • [11] Offset Calibration for Appearance-Based Gaze Estimation via Gaze Decomposition
    Chen, Zhaokang
    Shi, Bertram E.
    2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 259 - 268
  • [12] Federated Learning for Appearance-based Gaze Estimation in the Wild
    Elfares, Mayar
    Hu, Zhiming
    Reisert, Pascal
    Bulling, Andreas
    Kuesters, Ralf
    GAZE MEETS MACHINE LEARNING WORKSHOP, VOL 210, 2022, 210 : 20 - 36
  • [13] Towards Eyeglasses Refraction in Appearance-based Gaze Estimation
    Lyu, Junfeng
    Xu, Feng
    2023 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY, ISMAR, 2023, : 693 - 702
  • [14] Young-gaze: an appearance-based gaze estimation solution for adolescents
    Lu, Xiaofeng
    Zhao, Zichen
    Ke, Weitao
    Yan, Qingsong
    Liu, Zhi
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (10) : 7145 - 7155
  • [15] Benefits of temporal information for appearance-based gaze estimation
    Palmero, Cristina
    Komogortsev, Oleg V.
    Talathi, Sachin S.
    ETRA 2020 SHORT PAPERS: ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS, 2020,
  • [16] Appearance-Based Gaze Estimation Using Visual Saliency
    Sugano, Yusuke
    Matsushita, Yasuyuki
    Sato, Yoichi
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (02) : 329 - 341
  • [17] Appearance-Based Gaze Estimation via Uncalibrated Gaze Pattern Recovery
    Lu, Feng
    Chen, Xiaowu
    Sato, Yoichi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (04) : 1543 - 1553
  • [18] Unsupervised Outlier Detection in Appearance-Based Gaze Estimation
    Chen, Zhaokang
    Deng, Didan
    Pi, Jimin
    Shi, Bertram E.
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 1088 - 1097
  • [19] Adaptive Linear Regression for Appearance-Based Gaze Estimation
    Lu, Feng
    Sugano, Yusuke
    Okabe, Takahiro
    Sato, Yoichi
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (10) : 2033 - 2046
  • [20] A Deep Learning Approach to Appearance-Based Gaze Estimation under Head Pose Variations
    Sun, Hsin-Pei
    Yang, Cheng-Hsun
    Lai, Shang-Hong
    PROCEEDINGS 2017 4TH IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION (ACPR), 2017, : 935 - 940