Multi-modal multi-view Bayesian semantic embedding for community question answering

被引:15
|
作者
Sang, Lei [1 ,2 ]
Xu, Min [2 ]
Qian, ShengSheng [3 ]
Wu, Xindong [4 ]
机构
[1] Hefei Univ Technol, Hefei, Anhui, Peoples R China
[2] Univ Technol Sydney, Sydney, NSW, Australia
[3] Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing, Peoples R China
[4] Univ Louisiana Lafayette, Lafayette, LA 70504 USA
关键词
Community question answering; Semantic embedding; Multi-modal; Multi-view; Topic model; Word embedding;
D O I
10.1016/j.neucom.2018.12.067
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Semantic embedding has demonstrated its value in latent representation learning of data, and can be effectively adopted for many applications. However, it is difficult to propose a joint learning framework for semantic embedding in Community Question Answer (CQA), because CQA data have multi-view and sparse properties. In this paper, we propose a generic Multi-modal Multi-view Semantic Embedding (MMSE) framework via a Bayesian model for question answering. Compared with existing semantic learning methods, the proposed model mainly has two advantages: (1) To deal with the multi-view property, we utilize the Gaussian topic model to learn semantic embedding from both local view and global view. (2) To deal with the sparse property of question answer pairs in CQA, social structure information is incorporated to enhance the quality of general text content semantic embedding from other answers by using the shared topic distribution to model the relationship between these two modalities (user relationship and text content). We evaluate our model for question answering and expert finding task, and the experimental results on two real-world datasets show the effectiveness of our MMSE model for semantic embedding learning. (C) 2018 Published by Elsevier B.V.
引用
收藏
页码:44 / 58
页数:15
相关论文
共 50 条
  • [21] Differentiated Attention with Multi-modal Reasoning for Video Question Answering
    Yao, Shentao
    Li, Kun
    Xing, Kun
    Wu, Kewei
    Xie, Zhao
    Guo, Dan
    2022 IEEE INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING, BIG DATA AND ALGORITHMS (EEBDA), 2022, : 525 - 530
  • [22] Holistic Multi-Modal Memory Network for Movie Question Answering
    Wang, Anran
    Anh Tuan Luu
    Foo, Chuan-Sheng
    Zhu, Hongyuan
    Tay, Yi
    Chandrasekhar, Vijay
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 489 - 499
  • [23] A Flexible Multi-view Multi-modal Imaging System for Outdoor Scenes
    Zhang, Meng
    Guo, Wenxuan
    Fan, Bohao
    Chen, Yifan
    Feng, Jianjiang
    Zhou, Jie
    2022 INTERNATIONAL CONFERENCE ON 3D VISION, 3DV, 2022, : 322 - 331
  • [24] Multi-modal multi-view video coding based on correlation analysis
    Jiang, Gang-Yi
    Zhang, Yun
    Yu, Mei
    Jisuanji Xuebao/Chinese Journal of Computers, 2007, 30 (12): : 2205 - 2211
  • [25] Understanding the Dynamics of Social Interactions: A Multi-Modal Multi-View Approach
    Trabelsi, Rim
    Varadarajan, Jagannadan
    Zhang, Le
    Jabri, Issam
    Pei, Yong
    Smach, Fethi
    Bouallegue, Ammar
    Moulin, Pierre
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2019, 15 (01)
  • [26] Replay: Multi-modal Multi-view Acted Videos for Casual Holography
    Shapovalov, Roman
    Kleiman, Yanir
    Rocco, Ignacio
    Novotny, David
    Vedaldi, Andrea
    Chen, Changan
    Kokkinos, Filippos
    Graham, Ben
    Neverova, Natalia
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 20281 - 20291
  • [27] A Unified Model for Longitudinal Multi-Modal Multi-View Prediction with Missingness
    Chen, Boqi
    Oliva, Junier
    Niethammer, Marc
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT XII, 2024, 15012 : 410 - 420
  • [28] Multi-View Visual Question Answering with Active Viewpoint Selection
    Qiu, Yue
    Satoh, Yutaka
    Suzuki, Ryota
    Iwata, Kenji
    Kataoka, Hirokatsu
    SENSORS, 2020, 20 (08)
  • [29] Multi-modal information retrieval with a semantic view mechanism
    Li, Q
    Yang, J
    Zhuang, YT
    19TH INTERNATIONAL CONFERENCE ON ADVANCED INFORMATION NETWORKING AND APPLICATIONS, VOL 1, PROCEEDINGS: AINA 2005, 2005, : 133 - 138
  • [30] Hierarchical Multi-Task Learning for Diagram Question Answering with Multi-Modal Transformer
    Yuan, Zhaoquan
    Peng, Xiao
    Wu, Xiao
    Xu, Changsheng
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 1313 - 1321