Decoding Part-of-Speech from Human EEG Signals

被引:0
|
作者
Murphy, Alex [1 ]
Bohnet, Bernd [2 ]
McDonald, Ryan [3 ]
Noppeney, Uta [4 ]
机构
[1] Univ Birmingham, Birmingham, W Midlands, England
[2] Google Res, Mountain View, CA USA
[3] ASAPP, New York, NY USA
[4] Donders Inst Brain Cognit & Behav, Nijmegen, Netherlands
来源
PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS) | 2022年
关键词
MULTIVARIATE PATTERN-ANALYSIS; CLOSED-CLASS WORDS; BRAIN POTENTIALS; FREQUENCY; LENGTH; RESPONSES; LANGUAGE; TIME;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This work explores techniques to predict Part-of-Speech (PoS) tags from neural signals measured at millisecond resolution with electroencephalography (EEG) during text reading. We show that information about word length, frequency and word class is encoded by the brain at different poststimulus latencies. We then demonstrate that pretraining on averaged EEG data and data augmentation techniques boost PoS single-trial EEG decoding accuracy for Transformers (but not linear SVMs). Applying optimised temporally-resolved decoding techniques we show that Transformers outperform linear SVMs on PoS tagging of unigram and bigram data more strongly when information requires integration across longer time windows.
引用
收藏
页码:2201 / 2210
页数:10
相关论文
共 50 条
  • [21] A Practical Part-of-Speech Tagger for Bengali
    Sarkar, Kamal
    Gayen, Vivekananda
    2012 THIRD INTERNATIONAL CONFERENCE ON EMERGING APPLICATIONS OF INFORMATION TECHNOLOGY (EAIT), 2012, : 36 - 40
  • [22] Part-of-Speech Tagging by Latent Analogy
    Bellegarda, Jerome R.
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2010, 4 (06) : 985 - 993
  • [23] Part-of-Speech Tagging for Azerbaijani Language
    Mammadov, Samir
    Rustamov, Samir
    Mustafali, Ali
    Sadigov, Ziyaddin
    Mollayev, Rasim
    Mammadov, Zamir
    2018 IEEE 12TH INTERNATIONAL CONFERENCE ON APPLICATION OF INFORMATION AND COMMUNICATION TECHNOLOGIES (AICT), 2018, : 40 - 45
  • [24] Domain adaptation in part-of-speech tagging
    Institute of Exact and Natural Sciences, Federal University of Pará , Pará, Brazil
    不详
    Emerging Applic. of Nat. Lang. Proc.: Concepts and New Res., (52-72):
  • [25] Part-of-speech tagging without training
    Bressan, S
    Indradjaja, LS
    INTELLIGENCE IN COMMUNICATION SYSTEMS, 2004, 3283 : 112 - 119
  • [26] Part-of-speech enhanced context recognition
    Madsen, RE
    Larsen, J
    Hansen, LK
    MACHINE LEARNING FOR SIGNAL PROCESSING XIV, 2004, : 635 - 643
  • [27] Corpus based part-of-speech tagging
    Lv, Chengyao
    Liu, Huihua
    Dong, Yuanxing
    Chen, Yunliang
    INTERNATIONAL JOURNAL OF SPEECH TECHNOLOGY, 2016, 19 (03) : 647 - 654
  • [28] Part-Of-Speech Labeling for Reuters Database
    Cretulescu, R.
    David, A.
    Morariu, D.
    Vintan, L.
    2015 19TH INTERNATIONAL CONFERENCE ON SYSTEM THEORY, CONTROL AND COMPUTING (ICSTCC), 2015, : 117 - 122
  • [29] Part-of-speech tagging with minimal lexicalization
    Savova, V
    Peshkin, L
    RECENT ADVANCES IN NATURAL LANGUAGE PROCESSING III, 2004, 260 : 163 - 172
  • [30] Implementing an efficient part-of-speech tagger
    Carlberger, J
    Kann, V
    SOFTWARE-PRACTICE & EXPERIENCE, 1999, 29 (09): : 815 - 832