PERCEPTION OF THE PROSODIC FORMATIVE OF MULTIMODAL AFFECTIVE STATES

被引:0
|
作者
Barabanschikov, Vladimir A. [1 ]
Suvorova, Ekaterina, V [1 ]
Malionok, Arina., V [1 ]
机构
[1] Moscow State Univ Psychol & Educ, Moscow, Russia
来源
EKSPERIMENTALNAYA PSIKHOLOGIYA | 2024年 / 17卷 / 03期
关键词
multimodal dynamic states; vocal expression; accuracy of expression and identification of emotion; structure of categorical fields; cross-modal integration; EMOTION RECOGNITION; EXPRESSION; SPEECH; VOICE; CUES;
D O I
10.17759/exppsy.2024170303
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The features of the expression and perception of vocal expressions as one of the forming multimodal affective states of a person are studied. The experiment, designed on the basis of the Russian-language version of the Geneva Emotion Recognition Test (GERT), involved two groups of women aged 18-45, 72 women each. One group was shown audio-video clips of 14 affective states, lasting 3-5 seconds, played by 10 professional actors according to the Stanislavsky system. The other group was presented with audio clips extracted from the same clips through headphones. It was demanded to recognize the state of the actors using an interactive image of the Geneva Emotion Wheel. It is shown that vocal expressions differ from the corresponding multimodal states by a low average accuracy of expression and identification, a different configuration and a high spread of estimates, a closer dependence on the degree of arousal, individual ways of expression and a fuzzy extended structure of categorical fields. The range of possibilities that vocal expressions have, ready to be included in cross-modal integrations, is indicated.
引用
收藏
页码:30 / 51
页数:22
相关论文
共 50 条
  • [1] VIVID FACE PERCEPTION AS A CONSTRUCTIVE COMPONENT OF MULTIMODAL AFFECTIVE STATES
    Barabanschikov, Vladimir A.
    Suvorova, Ekaterina, V
    EKSPERIMENTALNAYA PSIKHOLOGIYA, 2024, 17 (04): : 4 - 27
  • [2] The role of voice quality and prosodic contour in affective speech perception
    Grichkovtsova, Ioulia
    Morel, Michel
    Lacheret, Anne
    SPEECH COMMUNICATION, 2012, 54 (03) : 414 - 429
  • [3] Multimodal dual perception fusion framework for multimodal affective analysis
    Lu, Qiang
    Sun, Xia
    Long, Yunfei
    Zhao, Xiaodi
    Zou, Wang
    Feng, Jun
    Wang, Xuxin
    INFORMATION FUSION, 2025, 115
  • [4] PERCEPTION AND AFFECTIVE STATES IN PLATO
    Boeri, Marcelo D.
    QUADERNI URBINATI DI CULTURA CLASSICA, 2007, 87 (03) : 71 - 93
  • [5] Unimodal and Multimodal Human Perception of Naturalistic Non-Basic Affective States during Human-Computer Interactions
    D'Mello, Sidney K.
    Dowell, Nia
    Graesser, Art
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2013, 4 (04) : 452 - 465
  • [6] Sound Emblems for Affective Multimodal Output of a Robotic Tutor: A Perception Study
    Hastie, Helen
    Dente, Pasquale
    Kuester, Dennis
    Kappas, Arvid
    ICMI'16: PROCEEDINGS OF THE 18TH ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2016, : 256 - 260
  • [7] COMBINED EFFECT OF FAMILIARITY AND AFFECTIVE STATES ON WORD PERCEPTION
    BROUCHON, M
    NOIZET, G
    BULLETIN DE PSYCHOLOGIE, 1966, 19 (8-12): : 611 - 617
  • [9] KASPAR: A PROSODIC MULTIMODAL SOFTWARE FOR DYSLEXIA
    Sbattella, Licia
    Tedesco, Roberto
    Cenceschi, Sonia
    ICERI2014: 7TH INTERNATIONAL CONFERENCE OF EDUCATION, RESEARCH AND INNOVATION, 2014, : 4742 - 4749
  • [10] PROSODIC PERCEPTION AND THE CEREBRAL HEMISPHERES
    VANLANCKER, D
    JOURNAL OF CLINICAL AND EXPERIMENTAL NEUROPSYCHOLOGY, 1987, 9 (01) : 58 - 58