A Novel Linguistic-Aware Memory Structure for Enhancing the Response Generation

被引:0
|
作者
Si, Pengda [1 ]
Wang, Yiru [2 ]
Yang, Yujiu [1 ]
机构
[1] Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen, Peoples R China
[2] Tencent Inc, Shenzhen, Peoples R China
来源
关键词
D O I
10.1007/978-3-030-96419-1_4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
People will think of conversation experiences during a chat. Inspired by the phenomena, some previous works exploit relevant conversation utterances to enhance the response generation process. However, these methods only focus on semantic information while ignoring linguistic information. As a result, relevant sentences are not fully utilized. To address the problem, we design a novel memory structure to store linguistic information. Specifically, we conduct a memory bank on the relevant utterances, consisting a series of key-value pairs. And the memory structure is combined during the generation process. We conduct experiments on two public conversation datasets, and the results demonstrate the effectiveness of our memory structure.
引用
收藏
页码:35 / 43
页数:9
相关论文
共 50 条
  • [1] In defence of a linguistic-aware approach to natural language processing
    Perinan Pascual, Carlos
    ONOMAZEIN, 2012, (26): : 13 - 48
  • [2] LAAN: A Linguistic-Aware Attention Network for Sentiment Analysis
    Lei, Zeyang
    Yang, Yujiu
    Liu, Yi
    COMPANION PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2018 (WWW 2018), 2018, : 47 - 48
  • [3] Linguistic-Aware WordPiece Tokenization: Semantic Enrichment and OOV Mitigation
    Schoenle, Daniel
    Reich, Christoph
    Abdeslam, Djaffar Ould
    2024 6TH INTERNATIONAL CONFERENCE ON NATURAL LANGUAGE PROCESSING, ICNLP 2024, 2024, : 134 - 142
  • [4] Dynamic Working Memory for Context-Aware Response Generation
    Xu, Zhen
    Sun, Chengjie
    Long, Yinong
    Liu, Bingquan
    Wang, Baoxun
    Wang, Mingjiang
    Zhang, Min
    Wang, Xiaolong
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2019, 27 (09) : 1419 - 1431
  • [5] Response Generation via Structure-Aware Constraints
    Guan, Mengyu
    Wang, Zhongqing
    Zhou, Guodong
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2022, 21 (06)
  • [6] Linguistic structure and short term memory
    Pothos, EM
    Juola, P
    Ellis, NC
    PROCEEDINGS OF THE TWENTY FIRST ANNUAL CONFERENCE OF THE COGNITIVE SCIENCE SOCIETY, 1999, : 811 - 811
  • [7] Linguistic structure and short term memory
    Pothos, EM
    Juola, P
    BEHAVIORAL AND BRAIN SCIENCES, 2001, 24 (01) : 138 - +
  • [8] Memory Network for Linguistic Structure Parsing
    Li, Zuchao
    Guan, Chaoyu
    Zhao, Hai
    Wang, Rui
    Parnow, Kevin
    Zhang, Zhuosheng
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2020, 28 : 2743 - 2755
  • [9] Persona aware Response Generation with Emotions
    Firdaus, Mauajama
    Thangavelu, Naveen
    Ekbal, Asif
    Bhattacharyya, Pushpak
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [10] Topic Aware Neural Response Generation
    Xing, Chen
    Wu, Wei
    Wu, Yu
    Liu, Jie
    Huang, Yalou
    Zhou, Ming
    Ma, Wei-Ying
    THIRTY-FIRST AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 3351 - 3357