Automatic Recognition and Augmentation of Attended Objects in Real-time using Eye Tracking and a Head-mounted Display

被引：11

作者：

Barz, Michael ^{[1
]}

Kapp, Sebastian ^{[2
]}

Kuhn, Jochen ^{[2
]}

Sonntag, Daniel ^{[1
]}

机构：

[1] Oldenburg Univ, German Res Ctr Artificial Intelligence DFKI, Oldenburg, Germany

[2] Tech Univ Kaiserslautern, Kaiserslautern, Rlp, Germany

来源：

ACM SYMPOSIUM ON EYE TRACKING RESEARCH AND APPLICATIONS (ETRA 2021) | 2021年

关键词：

eye tracking; augmented reality; visual attention; cognition-aware computing; computer vision;

D O I：

10.1145/3450341.3458766

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Scanning and processing visual stimuli in a scene is essential for the human brain to make situation-aware decisions. Adding the ability to observe the scanning behavior and scene processing to intelligent mobile user interfaces can facilitate a new class of cognition-aware user interfaces. As a first step in this direction, we implement an augmented reality (AR) system that classifies objects at the user's point of regard, detects visual attention to them, and augments the real objects with virtual labels that stick to the objects in real-time. We use a head-mounted AR device (Microsoft HoloLens 2) with integrated eye tracking capabilities and a front-facing camera for implementing our prototype.

引用

页数：4

共 50 条

[21] Assessment of eye fatigue caused by head-mounted displays using eye-tracking
Wang, Yan
Zhai, Guangtao
Chen, Sichao
Min, Xiongkuo
Gao, Zhongpai
Song, Xuefei
BIOMEDICAL ENGINEERING ONLINE, 2019, 18 (01)
[22] An Extended Method for Saccadic Eye Movement Measurements Using a Head-Mounted Display
Lee, Youngkeun
Kumar, Yadav Sunil
Lee, Daehyeon
Kim, Jihee
Kim, Junggwon
Yoo, Jisang
Kwon, Soonchul
HEALTHCARE, 2020, 8 (02)
[23] Head-mounted display cataract surgery: a new frontier with eye tracking and foveated rendering technology
Ethan Waisberg
Joshua Ong
Nasif Zaman
Sharif Amit Kamran
Prithul Sarker
Alireza Tavakkoli
Andrew G. Lee
Eye, 2024, 38 : 1022 - 1023
[24] Head-mounted display cataract surgery: a new frontier with eye tracking and foveated rendering technology
Waisberg, Ethan
Ong, Joshua
Zaman, Nasif
Kamran, Sharif Amit
Sarker, Prithul
Tavakkoli, Alireza
Lee, Andrew G.
EYE, 2024, 38 (05) : 1022 - 1023
[25] REAL-TIME RECOGNITION AND TRACKING OF MOVING OBJECTS
Dobrovodsky, Karol
Andris, Pavel
COMPUTING AND INFORMATICS, 2014, 33 (06) : 1213 - 1236
[26] Get a Grip: Slippage-Robust and Glint-Free Gaze Estimation for Real-Time Pervasive Head-Mounted Eye Tracking
Santini, Thiago
Niehorster, Diederick C.
Kasneci, Enkelejda
ETRA 2019: 2019 ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS, 2019,
[27] Production of a VR Horror Movie Using a Head-Mounted Display with a Head-Tracking System
Sera, Kenichi
Kitada, Takashi
Maki, Nahomi
Human Interface and the Management of Information: Information, Design and Interaction, Pt I, 2016, 9734 : 556 - 562
[28] Real-Time Tracking of Visually Attended Objects in Interactive Virtual Environments
Lee, Sungkil
Kim, Gerard Jounghyun
Choi, Seungmoon
VRST 2007: ACM SYMPOSIUM ON VIRTUAL REALITY SOFTWARE AND TECHNOLOGY, PROCEEDINGS, 2007, : 29 - 38
[29] Augmented Reality for Presenting Real-Time Data During Students' Laboratory Work: Comparing a Head-Mounted Display With a Separate Display
Thees, Michael
Altmeyer, Kristin
Kapp, Sebastian
Rexigel, Eva
Beil, Fabian
Klein, Pascal
Malone, Sarah
Bruenken, Roland
Kuhn, Jochen
FRONTIERS IN PSYCHOLOGY, 2022, 13
[30] Real-Time Onboard Object Detection for Augmented Reality: Enhancing Head-Mounted Display with YOLOv8
Lysakowski, Mikolaj
Zywanowski, Kamil
Banaszczyk, Adam
Nowicki, Michal R.
Skrzypczynski, Piotr
Tadeja, Slawomir K.
2023 IEEE INTERNATIONAL CONFERENCE ON EDGE COMPUTING AND COMMUNICATIONS, EDGE, 2023, : 364 - 371

← 1 2 3 4 5 →