A multi-componential analysis of emotions during complex learning with an intelligent multi-agent system

被引:138
作者
Harley, Jason M. [1 ,2 ]
Bouchet, Francois [3 ,4 ]
Hussain, M. Sazzad [5 ]
Azevedo, Roger [6 ]
Calvo, Rafael [5 ]
机构
[1] Univ Montreal, Dept Comp Sci & Operat Res, Montreal, PQ H3C 3J7, Canada
[2] McGill Univ, Dept Educ & Counselling Psychol, Montreal, PQ H3A 1Y2, Canada
[3] Univ Paris 06, Univ Sorbonne, UMR 7606, LIP6, F-75005 Paris, France
[4] CNRS, UMR 7606, LIP6, F-75005 Paris, France
[5] Univ Sydney, Sch Elect & Informat Engn, Sydney, NSW 2006, Australia
[6] N Carolina State Univ, Dept Psychol, Raleigh, NC USA
基金
美国国家科学基金会;
关键词
Emotions; Affect; Computer-based learning environments; Intelligent tutoring systems (ITS); AFFECTIVE TRANSITIONS; ACHIEVEMENT; DYNAMICS;
D O I
10.1016/j.chb.2015.02.013
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
This paper presents the evaluation of the synchronization of three emotional measurement methods (automatic facial expression recognition, self-report, electrodermal activity) and their agreement regarding learners' emotions. Data were collected from 67 undergraduates enrolled at a North American University whom learned about a complex science topic while interacting with MetaTutor, a multi-agent computerized learning environment. Videos of learners' facial expressions captured with a webcam were analyzed using automatic facial recognition software (FaceReader 5.0). Learners' physiological arousal was recorded using Affectiva's Q-Sensor 2.0 electrodermal activity measurement bracelet. Learners' self-reported their experience of 19 different emotional states on five different occasions during the learning session, which were used as markers to synchronize data from FaceReader and Q-Sensor. We found a high agreement between the facial and self-report data (75.6%), but low levels of agreement between them and the Q-Sensor data, suggesting that a tightly coupled relationship does not always exist between emotional response components. (C) 2015 Elsevier Ltd. All rights reserved.
引用
收藏
页码:615 / 625
页数:11
相关论文
共 54 条
[1]   Detecting Naturalistic Expressions of Nonbasic Affect Using Physiological Signals [J].
AlZoubi, Omar ;
D'Mello, Sidney K. ;
Calvo, Rafael A. .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2012, 3 (03) :298-310
[2]  
Alzoubi O, 2011, LECT NOTES COMPUT SC, V6974, P4, DOI 10.1007/978-3-642-24600-5_4
[3]  
[Anonymous], FACEREADER 5 0 COMP
[4]  
[Anonymous], 2013, Q SENS 2 0 APP SOFTW
[5]  
[Anonymous], 2014, Handbook of emotions in education
[6]  
[Anonymous], P MEASURING BEHAV
[7]   Emotion Sensors Go To School [J].
Arroyo, Ivon ;
Cooper, David G. ;
Burleson, Winslow ;
Woolf, Beverly Park ;
Muldner, Kasia ;
Christopherson, Robert .
ARTIFICIAL INTELLIGENCE IN EDUCATION: BUILDING LEARNING SYSTEMS THAT CARE: FROM KNOWLEDGE REPRESENTATION TO AFFECTIVE MODELLING, 2009, 200 :17-+
[8]  
Azevedo R., 2013, International handbook of metacognition and learning technologies
[9]  
Azevedo R., 2012, THEORETICAL FDN STUD, P171, DOI DOI 10.4324/9780203813799
[10]  
Azevedo R., 2013, INT HDB METACOGNITIO, P427