Differences in Emotion Recognition From Body and Face Cues Between Deaf and Hearing Individuals

被引:9
|
作者
Ferrari, Chiara [1 ]
Papagno, Costanza [1 ,2 ,3 ]
Todorov, Alexander [4 ]
Cattaneo, Zaira [1 ,5 ]
机构
[1] Univ Milano Bicocca, Dept Psychol, I-20126 Milan, Italy
[2] Univ Trento, CeRiN, I-38068 Rovereto, Italy
[3] Univ Trento, CIMeC, I-38068 Rovereto, Italy
[4] Princeton Univ, Dept Psychol, Princeton, NJ 08544 USA
[5] IRCCS Mondino Fdn, Pavia, Italy
关键词
Deafness; emotion; bodies; facial expressions; auditory deprivation; sign language; FUNCTIONAL SELECTIVITY; FACIAL EXPRESSION; BLIND INDIVIDUALS; SENSITIVE PERIOD; CHILDREN; PERCEPTION; ADULTS; ONSET; FEAR; ORGANIZATION;
D O I
10.1163/22134808-20191353
中图分类号
Q6 [生物物理学];
学科分类号
071011 ;
摘要
Deaf individuals may compensate for the lack of the auditory input by showing enhanced capacities in certain visual tasks. Here we assessed whether this also applies to recognition of emotions expressed by bodily and facial cues. In Experiment 1, we compared deaf participants and hearing controls in a task measuring recognition of the six basic emotions expressed by actors in a series of video-clips in which either the face, the body, or both the face and body were visible. In Experiment 2, we measured the weight of body and face cues in conveying emotional information when intense genuine emotions are expressed, a situation in which face expressions alone may have ambiguous valence. We found that deaf individuals were better at identifying disgust and fear from body cues (Experiment 1) and in integrating face and body cues in case of intense negative genuine emotions (Experiment 2). Our findings support the capacity of deaf individuals to compensate for the lack of the auditory input enhancing perceptual and attentional capacities in the spared modalities, showing that this capacity extends to the affective domain.
引用
收藏
页码:499 / 519
页数:21
相关论文
共 50 条
  • [21] Bi-modal emotion recognition from expressive face and body gestures
    Gunes, Hatice
    Piccardi, Massimo
    JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2007, 30 (04) : 1334 - 1345
  • [22] Universal Combined System: Speech Recognition, Emotion Recognition and Talking Head for Deaf and Hard of Hearing People
    Daassi-Gnaba, Hela
    Krahe, Jaime Lopez
    ASSISTIVE TECHNOLOGY FROM ADAPTED EQUIPMENT TO INCLUSIVE ENVIRONMENTS, 2009, 25 : 503 - 508
  • [23] Differences in Word Processing Skills of Deaf and Hearing Individuals Reading in Different Orthographies
    Kargin, Tevhide
    Guldenoglu, Birkan
    Miller, Paul
    Hauser, Peter
    Rathman, Christian
    Kubus, Okan
    Spurgeon, Erin
    JOURNAL OF DEVELOPMENTAL AND PHYSICAL DISABILITIES, 2012, 24 (01) : 65 - 83
  • [24] Differences in Word Processing Skills of Deaf and Hearing Individuals Reading in Different Orthographies
    Tevhide Kargin
    Birkan Guldenoglu
    Paul Miller
    Peter Hauser
    Christian Rathman
    Okan Kubus
    Erin Spurgeon
    Journal of Developmental and Physical Disabilities, 2012, 24 : 65 - 83
  • [25] Examining the differences of perceptions and experience with online health information accessibility between deaf and hearing individuals: A qualitative study
    Chandanabhumma, P. Paul
    Ratakonda, Samantha
    Panko, Tiffany
    Cuculick, Jessica
    Hauser, Peter
    Paasche-Orlow, Michael K.
    Fetters, Michael D.
    Mckee, Michael M.
    PATIENT EDUCATION AND COUNSELING, 2024, 122
  • [26] White matter connectivity between occipital and temporal regions involved in face and voice processing in hearing and early deaf individuals
    Benetti, Stefania
    Novello, Lisa
    Maffei, Chiara
    Rabini, Giuseppe
    Jovicich, Jorge
    Collignon, Olivier
    NEUROIMAGE, 2018, 179 : 263 - 274
  • [27] Medical Face Masks and Emotion Recognition from the Body: Insights from a Deep Learning Perspective
    Kegkeroglou, Nikolaos
    Filntisis, Panagiotis P.
    Maragos, Petros
    PROCEEDINGS OF THE 16TH ACM INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS, PETRA 2023, 2023, : 69 - 76
  • [28] The Impact of Assistive Technology on Communication Quality Between Deaf and Hearing Individuals
    Gugenheimer, Jan
    Plaumann, Katrin
    Schaub, Florian
    San Vito, Patrizia Di Campli
    Duck, Saskia
    Rabus, Melanie
    Rukzio, Enrico
    CSCW'17: PROCEEDINGS OF THE 2017 ACM CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK AND SOCIAL COMPUTING, 2017, : 669 - 682
  • [29] Supporting Medical Conversations between Deaf and Hearing Individuals with Tabletop Displays
    Piper, Anne Marie
    Hollan, James D.
    CSCW: 2008 ACM CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK, CONFERENCE PROCEEDINGS, 2008, : 147 - 156
  • [30] Transient Recapitulation of the Face Emotion Recognition Deficits of Schizophrenia in Healthy Individuals
    Corcoran, Cheryl
    Grinband, Jack
    Gowatsky, Jaimie
    Klim, Casimir
    Hoptman, Matthew
    Javitt, Daniel
    NEUROPSYCHOPHARMACOLOGY, 2017, 42 : S228 - S228