EEG emotion Enhancement using Task-specific Domain Adversarial Neural Network

被引:10
|
作者
Ding, Ke-Ming [1 ]
Kimura, Tsukasa
Fukui, Ken-ichi
Numao, Masayuki
机构
[1] Osaka Univ, Inst Sci & Ind Res ISIR, Suita, Osaka, Japan
关键词
electroencephalogram (EEG); emotion; Domain Adaptation; Cross-Phase; Cross-Subject;
D O I
10.1109/IJCNN52387.2021.9533310
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Electroencephalogram (EEG) signal has been widely applied in detecting human emotion. Individual differences limit the generalization in cross-subject classification since the release of emotion will be definitely different across persons even with the same emotion stimuli. Previous research utilizes domain adaptation to solve this problem in a leave-one-subject-out training that is learning common emotion-related features from many subjects and testing on a new subject, which requires abundant labeled data. This paper proposed a novel one-to-one domain adaptation method, the Task-specific Domain Adversarial Neural Network (T-DANN) which transfers knowledge from either one subject to predict on another subject or knowledge from one phase to predict on another phase within the same subject. Therefore, T-DANN is more flexible and requires much less data during training. T-DANN is an adversarial training method which adapts the conditional distribution between domains and adapts classification boundaries between classes simultaneously. Compared with data from different subjects, phase data from the same subject has much deeper correlation thus enhances the prediction of emotion in new phase. We evaluated our method on EEG emotion benchmark dataset SEED. The experiments showed that our proposed method outperformed other baseline methods in cross-subject adaptation. By cross-phase adaptation, our method achieved accuracy that approximately 3% lower than the state-of-the-art method but only used 1/14 labeled data, indicating the priority of our proposed method in real-time application.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Adversarial task-specific learning
    Fu, Xin
    Zhao, Yao
    Liu, Ting
    Wei, Yunchao
    Li, Jianan
    Wei, Shikui
    NEUROCOMPUTING, 2019, 362 : 118 - 128
  • [2] A Bi-Hemisphere Domain Adversarial Neural Network Model for EEG Emotion Recognition
    Li, Yang
    Zheng, Wenming
    Zong, Yuan
    Cui, Zhen
    Zhang, Tong
    Zhou, Xiaoyan
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2021, 12 (02) : 494 - 504
  • [3] Emotion Recognition Based on EEG Using Generative Adversarial Nets and Convolutional Neural Network
    Pan, Bo
    Zheng, Wei
    COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE, 2021, 2021
  • [4] TSANN-TG: Temporal-Spatial Attention Neural Networks with Task-Specific Graph for EEG Emotion Recognition
    Jiang, Chao
    Dai, Yingying
    Ding, Yunheng
    Chen, Xi
    Li, Yingjie
    Tang, Yingying
    BRAIN SCIENCES, 2024, 14 (05)
  • [5] Task-specific word identification from short texts using a convolutional neural network
    Yuan, Shuhan
    Wu, Xintao
    Xiang, Yang
    INTELLIGENT DATA ANALYSIS, 2018, 22 (03) : 533 - 550
  • [6] Reusing the Task-specific Classifier as a Discriminator: Discriminator-free Adversarial Domain Adaptation
    Chen, Lin
    Chen, Huaian
    Wei, Zhixiang
    Jin, Xin
    Tan, Xiao
    Jin, Yi
    Chen, Enhong
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 7171 - 7180
  • [7] Unsupervised Cross-Lingual Speech Emotion Recognition Using Domain Adversarial Neural Network
    Cai, Xiong
    Wu, Zhiyong
    Zhong, Kuo
    Su, Bin
    Dai, Dongyang
    Meng, Helen
    2021 12TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING (ISCSLP), 2021,
  • [8] Task-specific change of unconscious neural priming in the cerebral language network
    Nakamura, Kimihiro
    Dehaene, Stanislas
    Jobert, Antoinette
    Le Bihan, Denis
    Kouider, Sid
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2007, 104 (49) : 19643 - 19648
  • [9] Domain Adversarial Neural Network with Reliable Pseudo-labels Iteration for cross-subject EEG emotion recognition
    Ju, Xiangyu
    Su, Jianpo
    Dai, Sheng
    Wu, Xu
    Li, Ming
    Hu, Dewen
    KNOWLEDGE-BASED SYSTEMS, 2025, 316
  • [10] Domain adversarial learning with multiple adversarial tasks for EEG emotion recognition
    Ju, Xiangyu
    Wu, Xu
    Dai, Sheng
    Li, Ming
    Hu, Dewen
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 266