Which Experimental Design is Better Suited for VQA Tasks? Eye Tracking Study on Cognitive Load, Performance, and Gaze Allocations

被引：1

作者：

Vriend, Sita A. ^{[1
]}

Vidyapu, Sandeep ^{[1
]}

Rama, Amer ^{[1
]}

Chen, Kun-Ting ^{[1
,2
]}

Weiskopf, Daniel ^{[1
]}

机构：

[1] Univ Stuttgart, Stuttgart, Germany

[2] Univ Adelaide, Adelaide, SA, Australia

来源：

PROCEEDINGS OF THE 2024 ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS, ETRA 2024 | 2024年

关键词：

Eye tracking; cognitive load; visual exploration; VQA; task performance; experimental design; INFORMATION;

D O I：

10.1145/3649902.3653519

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

We conducted an eye-tracking user study with 13 participants to investigate the influence of stimulus-question ordering and question modality on participants using visual question-answering (VQA) tasks. We examined cognitive load, task performance, and gaze allocations across five distinct experimental designs, aiming to identify setups that minimize the cognitive burden on participants. The collected performance and gaze data were analyzed using quantitative and qualitative methods. Our results indicate a significant impact of stimulus-question ordering on cognitive load and task performance, as well as a noteworthy effect of question modality on task performance. These findings offer insights for the experimental design of controlled user studies in visualization research.

引用

页数：7

共 9 条

[1] Cognitive load, working memory capacity and driving performance: A preliminary fNIRS and eye tracking study
Broadbent, David P.
D'Innocenzo, Giorgia
Ellmers, Toby J.
Parsler, Justin
Szameitat, Andre J.
Bishop, Daniel T.
TRANSPORTATION RESEARCH PART F-TRAFFIC PSYCHOLOGY AND BEHAVIOUR, 2023, 92 : 121 - 132
[2] VIRTUAL REALITY SPATIAL TASK PERFORMANCE ESTIMATION THROUGH COGNITIVE LOAD: EEG AND EYE TRACKING STUDY
Ledneva, Tatiana
Kovalev, Artem
PSYCHOPHYSIOLOGY, 2020, 57 : S69 - S69
[3] Optimizing Scatterplot-Matrices for Decision-Support: An Experimental Eye-Tracking Study Assessing Situational Cognitive Load
Perkhofer, Lisa
Hofer, Peter
INFORMATION SYSTEMS AND NEUROSCIENCE (NEUROIS RETREAT 2021), 2021, 52 : 63 - 76
[4] Effects of AR on Cognitive Processes: An Experimental Study on Object Manipulation, Eye-Tracking, and Behavior Observation in Design Education
Kim, Ju Yeon
Choi, Jin Kyung
SENSORS, 2025, 25 (06)
[5] Watching subtitled videos with the sound off affects viewers' comprehension, cognitive load, immersion, enjoyment, and gaze patterns: A mixed-methods eye-tracking study
Szarkowska, Agnieszka
Ragni, Valentina
Szkriba, Sonia
Black, Sharon
Orrego-Carmona, David
Kruger, Jan-Louis
PLOS ONE, 2024, 19 (10):
[6] Performance of healthy persons under pain in different cognitive load tasks: An event-related potential study on experimental pain individuals
Wang, Kangling
Cai, Guiyuan
Huang, Shimin
Li, Yuqi
Li, Rongdong
Wu, Wen
BRAIN AND BEHAVIOR, 2020, 10 (08):
[7] Value of Eye-Tracking Data for Classification of Information Processing-Intensive Handling Tasks: Quasi-Experimental Study on Cognition and User Interface Design
Wegner, Stephan
Lohmeyer, Quentin
Wahlen, Dimitri
Neumann, Sandra
Groebli, Jean-Claude
Meboldt, Mirko
JMIR HUMAN FACTORS, 2020, 7 (02):
[8] The Design of a Posture Instruction Atlas and the Prevention of Construction Workers' Work-Related Musculoskeletal Disorders (WMSDs): A Study on Attention Allocation and Cognitive Load Based on Eye Tracking
Ouyang, Yewei
Cheng, Cheng
Wang, Dan
He, Shiyi
Zheng, Lan
SUSTAINABILITY, 2023, 15 (19)
[9] Task-irrelevant decorative pictures increase cognitive load during text processing but have no effects on learning or working memory performance: an EEG and eye-tracking study
Scharinger, Christian
PSYCHOLOGICAL RESEARCH-PSYCHOLOGISCHE FORSCHUNG, 2024, 88 (04): : 1362 - 1388

← 1 →