Saliency-Based Gaze Visualization for Eye Movement Analysis

被引:5
|
作者
Yoo, Sangbong [1 ]
Jeong, Seongmin [1 ]
Kim, Seokyeon [1 ]
Jang, Yun [1 ]
机构
[1] Sejong Univ, Comp Engn & Convergence Engn Intelligent Drone, Seoul 05006, South Korea
关键词
gaze data visualization; saliency analysis; visual attention; VISUAL-ATTENTION; EARLY VISION; TRACKING; SEARCH; MODEL; OBJECT;
D O I
10.3390/s21155178
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Gaze movement and visual stimuli have been utilized to analyze human visual attention intuitively. Gaze behavior studies mainly show statistical analyses of eye movements and human visual attention. During these analyses, eye movement data and the saliency map are presented to the analysts as separate views or merged views. However, the analysts become frustrated when they need to memorize all of the separate views or when the eye movements obscure the saliency map in the merged views. Therefore, it is not easy to analyze how visual stimuli affect gaze movements since existing techniques focus excessively on the eye movement data. In this paper, we propose a novel visualization technique for analyzing gaze behavior using saliency features as visual clues to express the visual attention of an observer. The visual clues that represent visual attention are analyzed to reveal which saliency features are prominent for the visual stimulus analysis. We visualize the gaze data with the saliency features to interpret the visual attention. We analyze the gaze behavior with the proposed visualization to evaluate that our approach to embedding saliency features within the visualization supports us to understand the visual attention of an observer.
引用
收藏
页数:18
相关论文
共 50 条
  • [41] Crowdsourcing Evaluation of Saliency-Based XAI Methods
    Lu, Xiaotian
    Tolmachev, Arseny
    Yamamoto, Tatsuya
    Takeuchi, Koh
    Okajima, Seiji
    Takebayashi, Tomoyoshi
    Maruhashi, Koji
    Kashima, Hisashi
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2021: APPLIED DATA SCIENCE TRACK, PT V, 2021, 12979 : 431 - 446
  • [42] Saliency-Based Spatiotemporal Attention for Video Captioning
    Chen, Yangyu
    Zhang, Weigang
    Wang, Shuhui
    Li, Liang
    Huang, Qingming
    2018 IEEE FOURTH INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM), 2018,
  • [43] Saliency-based framework for facial expression recognition
    Rizwan Ahmed Khan
    Alexandre Meyer
    Hubert Konik
    Saida Bouakaz
    Frontiers of Computer Science, 2019, 13 : 183 - 198
  • [44] Saliency-based image correction for colorblind patients
    Jinjiang Li
    Xiaomei Feng
    Hui Fan
    Computational Visual Media, 2020, 6 : 169 - 189
  • [45] Saliency-based YOLO for single target detection
    Hu, Jun-ying
    Shi, C. -J. Richard
    Zhang, Jiang-she
    KNOWLEDGE AND INFORMATION SYSTEMS, 2021, 63 (03) : 717 - 732
  • [46] Saliency-based Detection for Maritime Object Tracking
    Cane, Tom
    Ferryman, James
    PROCEEDINGS OF 29TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, (CVPRW 2016), 2016, : 1257 - 1264
  • [47] SALIENCY-BASED ENDMEMBER DETECTION FOR HYPERSPECTRAL IMAGERY
    Wang, Xinyu
    Zhong, Yanfei
    Xu, Yao
    Zhang, Liangpei
    Xu, Yanyan
    2017 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2017, : 984 - 987
  • [48] Saliency-based image processing for retinal prostheses
    Parikh, N.
    Itti, L.
    Weiland, J.
    JOURNAL OF NEURAL ENGINEERING, 2010, 7 (01)
  • [49] Saliency-based image correction for colorblind patients
    Li, Jinjiang
    Feng, Xiaomei
    Fan, Hui
    COMPUTATIONAL VISUAL MEDIA, 2020, 6 (02) : 169 - 189
  • [50] Saliency-based color accessibility: Theory into practice
    Tajima, Satohiro
    Komine, Kazuteru
    IDW/AD '12: PROCEEDINGS OF THE INTERNATIONAL DISPLAY WORKSHOPS, PT 3, 2012, 19 : 1979 - 1980