Features and classifiers for emotion recognition from speech: a survey from 2000 to 2011

被引:261
作者
Anagnostopoulos, Christos-Nikolaos [1 ]
Iliou, Theodoros [1 ]
Giannoukos, Ioannis [1 ]
机构
[1] Univ Aegean, Cultural Technol & Commun Dept, Lesvos Isl 81100, Lesbos, Greece
关键词
Speech features; Emotion recognition; Classifiers; CLASSIFICATION; FUSION; AUDIO; ASR;
D O I
10.1007/s10462-012-9368-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Speaker emotion recognition is achieved through processing methods that include isolation of the speech signal and extraction of selected features for the final classification. In terms of acoustics, speech processing techniques offer extremely valuable paralinguistic information derived mainly from prosodic and spectral features. In some cases, the process is assisted by speech recognition systems, which contribute to the classification using linguistic information. Both frameworks deal with a very challenging problem, as emotional states do not have clear-cut boundaries and often differ from person to person. In this article, research papers that investigate emotion recognition from audio channels are surveyed and classified, based mostly on extracted and selected features and their classification methodology. Important topics from different classification techniques, such as databases available for experimentation, appropriate feature extraction and selection methods, classifiers and performance issues are discussed, with emphasis on research published in the last decade. This survey also provides a discussion on open trends, along with directions for future research on this topic.
引用
收藏
页码:155 / 177
页数:23
相关论文
共 100 条
[51]  
Lugger M, 2007, INT CONF ACOUST SPEE, P17
[52]  
Manning C., 1999, Foundations of statistical natural language processing
[53]   Detection of cough signals in continuous audio recordings using hidden Markov models [J].
Matos, Sergio ;
Birring, Surinder S. ;
Pavord, Ian D. ;
Evans, David H. .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2006, 53 (06) :1078-1083
[54]   Variational Gaussian Mixture Models for Speech Emotion Recognition [J].
Mishra, Harendra Kumar ;
Sekhar, C. Chandra .
ICAPR 2009: SEVENTH INTERNATIONAL CONFERENCE ON ADVANCES IN PATTERN RECOGNITION, PROCEEDINGS, 2009, :183-186
[55]   Ensemble methods for spoken emotion recognition in call-centres [J].
Morrison, Donn ;
Wang, Ruili ;
De Silva, Liyanage C. .
SPEECH COMMUNICATION, 2007, 49 (02) :98-112
[56]   An objective and subjective study of the role of semantics and prosodic features in building corpora for emotional TTS [J].
Navas, Eva ;
Hernáez, Inmaculada ;
Luengo, Iker .
IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2006, 14 (04) :1117-1127
[57]  
Neiberg D, 2006, INTERSPEECH 2006 AND 9TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE PROCESSING, VOLS 1-5, P809
[58]  
Nogueiras A., 2001, Proceedings of INTERSPEECH, P2679, DOI DOI 10.21437/EUROSPEECH.2001-627
[59]  
Nwe TL, 2003, INT CONF ACOUST SPEE, P9
[60]  
Ortony Andrew, 1988, The Cognitive Structure of Emotions, DOI 10.1017/CBO9780511571299