Automatic Recognition and Augmentation of Attended Objects in Real-time using Eye Tracking and a Head-mounted Display

被引：11
|
作者：
Barz, Michael [1 ]
Kapp, Sebastian [2 ]
Kuhn, Jochen [2 ]
Sonntag, Daniel [1 ]
机构：
[1] Oldenburg Univ, German Res Ctr Artificial Intelligence DFKI, Oldenburg, Germany
[2] Tech Univ Kaiserslautern, Kaiserslautern, Rlp, Germany
来源：
ACM SYMPOSIUM ON EYE TRACKING RESEARCH AND APPLICATIONS (ETRA 2021) | 2021年
关键词：
eye tracking; augmented reality; visual attention; cognition-aware computing; computer vision;
D O I：
10.1145/3450341.3458766
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
Scanning and processing visual stimuli in a scene is essential for the human brain to make situation-aware decisions. Adding the ability to observe the scanning behavior and scene processing to intelligent mobile user interfaces can facilitate a new class of cognition-aware user interfaces. As a first step in this direction, we implement an augmented reality (AR) system that classifies objects at the user's point of regard, detects visual attention to them, and augments the real objects with virtual labels that stick to the objects in real-time. We use a head-mounted AR device (Microsoft HoloLens 2) with integrated eye tracking capabilities and a front-facing camera for implementing our prototype.
引用
收藏
页数：4
相关论文
共 50 条
  • [31] Real-time detection of deviations in VMAT and IMRT beam delivery using a head-mounted detector
    Canters, R. A. M.
    Kusters, J. M. A. M.
    Oellig, J.
    Carrasco, J. P.
    Huizenga, H.
    RADIOTHERAPY AND ONCOLOGY, 2015, 115 : S436 - S437
  • [32] Real-time motion correction using gradient tones and head-mounted NMR field probes
    Haeberlin, Maximilian
    Kasper, Lars
    Barmet, Christoph
    Brunner, David O.
    Dietrich, Benjamin E.
    Gross, Simon
    Wilm, Bertram J.
    Kozerke, Sebastian
    Pruessmann, Klaas P.
    MAGNETIC RESONANCE IN MEDICINE, 2015, 74 (03) : 647 - 660
  • [33] Data Prediction of Electromagnetic Head Tracking using Self Healing Neural Model for Head-Mounted Display
    Kataria, Aman
    Ghosh, Smarajit
    Karar, Vinod
    ROMANIAN JOURNAL OF INFORMATION SCIENCE AND TECHNOLOGY, 2020, 23 (04): : 354 - 367
  • [34] GPU based Real-time Correction for Optical Distortions in Head-Mounted Displays
    Weng, Dongdong
    Wang, Yongtian
    Liu, Yue
    PROCEEDINGS OF THE FIFTH INTERNATIONAL CONFERENCE ON IMAGE AND GRAPHICS (ICIG 2009), 2009, : 672 - 676
  • [35] Integrated real-time eye, head, and body tracking in front of a wall-sized display
    Canto-Pereira, L. H.
    Tanner, T. G.
    Herholz, S.
    Fleming, R. W.
    Balthoff, H. H.
    PERCEPTION, 2007, 36 : 26 - 26
  • [36] Pupil-Contour-Based Gaze Estimation With Real Pupil Axes for Head-Mounted Eye Tracking
    Wan, Zhonghua
    Xiong, Caihua
    Chen, Wenbin
    Zhang, Hanyuan
    Wu, Shiqian
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (06) : 3640 - 3650
  • [37] Real-Time Eyeblink Detector and Eye State Classifier for Virtual Reality (VR) Headsets (Head-Mounted Displays, HMDs)
    Alsaeedi, Nassr
    Wloka, Dieter
    SENSORS, 2019, 19 (05)
  • [38] Real-Time Radiometric Compensation for Optical See-Through Head-Mounted Displays
    Langlotz, Tobias
    Cook, Matthew
    Regenbrecht, Holger
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2016, 22 (11) : 2385 - 2394
  • [39] Design and construction of a head-mounted system for the real-time measurement of pupil diameter variations
    Joshi, Vinayak
    Barreto, Armando
    WMSCI 2007: 11TH WORLD MULTI-CONFERENCE ON SYSTEMICS, CYBERNETICS AND INFORMATICS, VOL II, PROCEEDINGS, 2007, : 36 - +
  • [40] Refocusing the Real-world using the Optical See-through Head-mounted Display
    Chung, Jae Ryun
    Kim, Dong-Wook
    Jung, Seung-Won
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGE TECHNOLOGY (IWAIT) 2019, 2019, 11049
12345