Multimodal Affect Recognition in Virtual Worlds: Avatars Mirroring Users' Affect

被引:0
|
作者
Gonzalez-Sanchez, Javier [1 ]
Chavez-Echeagaray, Maria Elena [1 ]
Gibson, David [2 ]
Atkinson, Robert [1 ]
机构
[1] Arizona State Univ, Tempe, AZ 85287 USA
[2] Curtin Univ, Perth, WA, Australia
关键词
affect recognition; affect mirroring; virtual worlds; second life; multimodal; framework; MODEL;
D O I
10.1109/ACII.2013.133
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Virtual worlds enable users' interactions through avatars. Avatars embody individual characteristics from their owners and exhibit those characteristics outward to the community. Motivated by the role of avatars in interpersonal communication, we integrated a generic real-time multimodal affect recognition hub as an input within an online virtual world to make an avatar mirror its owner's affect. Affect vectors (determined by pleasure, arousal, and dominance coordinates) in a continuous affective space are applied to characterize the user's affective state in real time.
引用
收藏
页码:724 / +
页数:2
相关论文
共 50 条
  • [1] Facial Affect Recognition in Depression Using Human Avatars
    Monferrer, Marta
    Garcia, Arturo S. S.
    Ricarte, Jorge J. J.
    Montes, Maria J.
    Fernandez-Sotos, Patricia
    Fernandez-Caballero, Antonio
    APPLIED SCIENCES-BASEL, 2023, 13 (03):
  • [2] Fusion Mappings for Multimodal Affect Recognition
    Kaechele, Markus
    Schels, Martin
    Thiam, Patrick
    Schwenker, Friedhelm
    2015 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI), 2015, : 307 - 313
  • [3] Worlds of affect: virtual geographies of video games
    Shaw, Ian Graham Ronald
    Warf, Barney
    ENVIRONMENT AND PLANNING A-ECONOMY AND SPACE, 2009, 41 (06): : 1332 - 1343
  • [4] Facial Affect Recognition by Patients with Schizophrenia Using Human Avatars
    Muros, Nora I.
    Garcia, Arturo S.
    Forner, Cristina
    Lopez-Arcas, Pablo
    Lahera, Guillermo
    Rodriguez-Jimenez, Roberto
    Nieto, Karen N.
    Latorre, Jose Miguel
    Fernandez-Caballero, Antonio
    Fernandez-Sotos, Patricia
    JOURNAL OF CLINICAL MEDICINE, 2021, 10 (09)
  • [5] Affect Recognition for Multimodal Natural Language Processing
    Soujanya Poria
    Ong Yew Soon
    Bing Liu
    Lidong Bing
    Cognitive Computation, 2021, 13 : 229 - 230
  • [6] Multimodal Affect Recognition in Intelligent Tutoring Systems
    Banda, Ntombikayise
    Robinson, Peter
    AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION, PT II, 2011, 6975 : 200 - 207
  • [7] Multimodal Affect Recognition Using Boltzmann Zippers
    Lu, Kun
    Zhang, Xin
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2013, E96D (11): : 2496 - 2499
  • [8] A Multimodal Database for Affect Recognition and Implicit Tagging
    Soleymani, Mohammad
    Lichtenauer, Jeroen
    Pun, Thierry
    Pantic, Maja
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2012, 3 (01) : 42 - 55
  • [9] Affect Recognition for Multimodal Natural Language Processing
    Poria, Soujanya
    Soon, Ong Yew
    Liu, Bing
    Bing, Lidong
    COGNITIVE COMPUTATION, 2021, 13 (02) : 229 - 230
  • [10] Expressive Avatars: Vitality in Virtual Worlds
    Ekdahl D.
    Osler L.
    Philosophy & Technology, 2023, 36 (2)