Automatic Recognition and Augmentation of Attended Objects in Real-time using Eye Tracking and a Head-mounted Display

被引：11

作者：

Barz, Michael ^{[1
]}

Kapp, Sebastian ^{[2
]}

Kuhn, Jochen ^{[2
]}

Sonntag, Daniel ^{[1
]}

机构：

[1] Oldenburg Univ, German Res Ctr Artificial Intelligence DFKI, Oldenburg, Germany

[2] Tech Univ Kaiserslautern, Kaiserslautern, Rlp, Germany

来源：

ACM SYMPOSIUM ON EYE TRACKING RESEARCH AND APPLICATIONS (ETRA 2021) | 2021年

关键词：

eye tracking; augmented reality; visual attention; cognition-aware computing; computer vision;

D O I：

10.1145/3450341.3458766

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Scanning and processing visual stimuli in a scene is essential for the human brain to make situation-aware decisions. Adding the ability to observe the scanning behavior and scene processing to intelligent mobile user interfaces can facilitate a new class of cognition-aware user interfaces. As a first step in this direction, we implement an augmented reality (AR) system that classifies objects at the user's point of regard, detects visual attention to them, and augments the real objects with virtual labels that stick to the objects in real-time. We use a head-mounted AR device (Microsoft HoloLens 2) with integrated eye tracking capabilities and a front-facing camera for implementing our prototype.

引用

页数：4

共 50 条

[41] Awareness of the real-world environment when using augmented reality head-mounted display
Aromaa, Susanna
Vaatanen, Antti
Aaltonen, Iina
Goriachev, Vladimir
Helin, Kaj
Karjalainen, Jaakko
APPLIED ERGONOMICS, 2020, 88
[42] Real-Time Tracking of Visually Attended Objects in Virtual Environments and Its Application to LOD
Lee, Sungkil
Kim, Gerard Jounghyun
Choi, Seungmoon
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2009, 15 (01) : 6 - 19
[43] Estimating 3-D Point-of-Regard in a Real Environment Using a Head-Mounted Eye-Tracking System
Takemura, Kentaro
Takahashi, Kenji
Takamatsu, Jun
Ogasawara, Tsukasa
IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2014, 44 (04) : 531 - 536
[44] Real-time 3D scans of cardiac surgery using a single optical-see-through head-mounted display in a mobile setup
Dewitz, Bastian
Bibo, Roman
Moazemi, Sobhan
Kalkhoff, Sebastian
Recker, Stephan
Liebrecht, Artur
Lichtenberg, Artur
Geiger, Christian
Steinicke, Frank
Aubin, Hug
Schmid, Falko
FRONTIERS IN VIRTUAL REALITY, 2022, 3
[45] Real-time ultrasound-guided thoracentesis simulation using an optical see-through head-mounted display: a proof-of-concept study
Okachi, Shotaro
Matsui, Toshinori
Sakurai, Manami
Ito, Takayasu
Morise, Masahiro
Imaizumi, Kazuyoshi
Ishii, Makoto
Fujiwara, Michitaka
JOURNAL OF ULTRASONOGRAPHY, 2024, 24 (96)
[46] Real-time Measurement of Olfactory Information Using Head-mounted Sensors During Odor-guided Navigation
Tariq, Mohammad F.
Lowell, Aliena
Lewis, Suzanne M.
Perkel, David
Gire, David
CHEMICAL SENSES, 2019, 44 (07) : E54 - E55
[47] Head-tracking in scopic surgical procedures using Robot-held camera and head-mounted stereoscopic display
Elle, OJ
Samset, E
Bakken, A
Hogetveit, JO
Fosse, E
CARS 2000: COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2000, 1214 : 121 - 127
[48] Holographic patient tracking after bed movement for augmented reality neuronavigation using a head-mounted display
Fick, T.
van Doormaal, J. A. M.
Hoving, E. W.
Regli, L.
van Doormaal, T. P. C.
ACTA NEUROCHIRURGICA, 2021, 163 (04) : 879 - 884
[49] Holographic patient tracking after bed movement for augmented reality neuronavigation using a head-mounted display
T. Fick
J.A.M. van Doormaal
E.W. Hoving
L. Regli
T.P.C. van Doormaal
Acta Neurochirurgica, 2021, 163 : 879 - 884
[50] Head-Mounted Standalone Real-Time Tracking System for Moving Light-Emitting Targets Fusing Vision and Inertial Sensors
Digiacomo, Francesca
Afroz, Abanti Shama
Pelliccia, Riccardo
Inglese, Francesco
Milazzo, Mario
Stefanini, Cesare
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (11) : 8953 - 8961

← 1 2 3 4 5 →