Analysis of Similarity and Differences in Brain Activities Between Perception and Production of Facial Expressions Using EEG Data and the NeuCube Spiking Neural Network Architecture

被引:5
|
作者
Kawano, Hideaki [1 ]
Seo, Akinori [1 ]
Doborjeh, Zohreh Gholami [2 ]
Kasabov, Nikola [2 ]
Doborjeh, Maryam Gholami [2 ]
机构
[1] Kyushu Inst Technol, Fac Engn, Kitakyushu, Fukuoka 8048550, Japan
[2] Auckland Univ Technol, Knowledge Engn & Discovery Res Inst, Auckland 1142, New Zealand
来源
NEURAL INFORMATION PROCESSING, ICONIP 2016, PT IV | 2016年 / 9950卷
关键词
Mirror neuron system; Facial expression; EEG data; NeuCube; Spiking neural network (SNN); RECOGNITION;
D O I
10.1007/978-3-319-46681-1_27
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper is a feasibility study of using the NeuCube spiking neural network (SNN) architecture for modeling EEG brain data related to perceiving versus mimicking facial expressions. It is demonstrated that the proposed model can be used to study the similarity and differences between corresponding brain activities as complex spatio-temporal patterns. Two SNN models are created for each of the 7 basic emotions for a group of Japanese subjects, one when subjects are perceiving an emotional face and another, when the same subjects are mimicking this emotion. The evolved connectivity in the two models are then subtracted to study the differences. Analysis of the models trained on the collected EEG data shows greatest similarity in sadness, and least similarity in happiness and fear, where differences in the T6 EEG channel area were observed. The study, being based on the well-known mirror neuron concept in the brain, is the first to analyze and visualize similarity and differences as evolved spatio-temporal patterns in a brain-like SNN model.
引用
收藏
页码:221 / 227
页数:7
相关论文
共 12 条
  • [1] A feasibility study of using the neucube spiking neural network architecture for modelling Alzheimer’s disease EEG data
    20152400933645
    Capecci, Elisa, 2015, Springer Science and Business Media Deutschland GmbH (37):
  • [2] Deep Learning of EEG Data in the NeuCube Brain-Inspired Spiking Neural Network Architecture for a Better Understanding of Depression
    Shah, Dhvani
    Wang, Grace Y.
    Doborjeh, Maryam
    Doborjeh, Zohreh
    Kasabov, Nikola
    NEURAL INFORMATION PROCESSING (ICONIP 2019), PT III, 2019, 11955 : 195 - 206
  • [3] NeuCube: A spiking neural network architecture for mapping, learning and understanding of spatio-temporal brain data
    Kasabov, Nikola K.
    NEURAL NETWORKS, 2014, 52 : 62 - 76
  • [4] Personalised Modelling on Integrated Clinical and EEG Spatio-Temporal Brain Data in the NeuCube Spiking Neural Network System
    Doborjeh, Maryam Gholami
    Kasabov, Nikola
    2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 1373 - 1378
  • [5] Emotion Recognition and Understanding Using EEG Data in A Brain-Inspired Spiking Neural Network Architecture
    Alzhrani, Wael
    Doborjeh, Maryam
    Doborjeh, Zohreh
    Kasabov, Nikola
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [6] Longitudinal Study of Alzheimer's Disease Degeneration through EEG Data Analysis with a NeuCube Spiking Neural Network Model
    Capecci, Elisa
    Doborjeh, Zohreh Gholami
    Mammone, Nadia
    La Foresta, Fabio
    Morabito, Francesco C.
    Kasabov, Nikola
    2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 1360 - 1366
  • [7] Analysis of connectivity in NeuCube spiking neural network models trained on EEG data for the understanding of functional changes in the brain: A case study on opiate dependence treatment
    Capecci, Elisa
    Kasabov, Nikola
    Wang, Grace Y.
    NEURAL NETWORKS, 2015, 68 : 62 - 77
  • [8] Dynamic 3D Clustering of Spatio-Temporal Brain Data in the NeuCube Spiking Neural Network Architecture on a Case Study of fMRI Data
    Doborjeh, Maryam Gholami
    Kasabov, Nikola
    NEURAL INFORMATION PROCESSING, ICONIP 2015, PT IV, 2015, 9492 : 191 - 198
  • [9] Utilizing a Brain Inspired Spiking Neural Network to better predict and identify Gaming Disorder using EEG data
    Burleigh, Tyrone L.
    Griffiths, Mark D.
    Sumich, Alex
    Doborjeh, Zohreh
    Kuss, Daria J.
    JOURNAL OF BEHAVIORAL ADDICTIONS, 2022, 11 : 202 - 202
  • [10] Framework for Knowledge Driven Optimisation Based Data Encoding for Brain Data Modelling Using Spiking Neural Network Architecture
    Sengupta, Neelava
    Scott, Nathan
    Kasabov, Nikola
    PROCEEDINGS OF THE FIFTH INTERNATIONAL CONFERENCE ON FUZZY AND NEURO COMPUTING (FANCCO - 2015), 2015, 415 : 109 - 118