Few-shot Learning for Multi-modal Social Media Event Filtering

被引:3
|
作者
Nascimento, Jose [1 ]
Cardenuto, Joao Phillipe [1 ]
Yang, Jing [1 ]
Rocha, Anderson [1 ]
机构
[1] Univ Estadual Campinas, Inst Comp, Artificial Intelligence Lab Recod Ai, Campinas, SP, Brazil
基金
瑞典研究理事会; 巴西圣保罗研究基金会;
关键词
event filtering; few-shot learning; social media dataset;
D O I
10.1109/WIFS55849.2022.9975429
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Social media has become an important data source for event analysis. When collecting this type of data, most contain no useful information to a target event. Thus, it is essential to filter out those noisy data at the earliest opportunity for a human expert to perform further inspection. Most existing solutions for event filtering rely on fully supervised methods for training. However, in many real-world scenarios, having access to large number of labeled samples is not possible. To deal with a few labeled sample training problem for event filtering, we propose a graph-based few-shot learning pipeline. We also release the Brazilian Protest Dataset to test our method. To the best of our knowledge, this dataset is the first of its kind in event filtering that focuses on protests in multi-modal social media data, with most of the text in Portuguese. Our experimental results show that our proposed pipeline has comparable performance with only a few labeled samples (60) compared with a fully labeled dataset (3100). To facilitate the research community, we make our dataset and code available at https://github.com/jdnascim/7Set-AL.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] DISCRIMINATIVE HALLUCINATION FOR MULTI-MODAL FEW-SHOT LEARNING
    Pahde, Frederik
    Nabi, Moin
    Klein, Tassilo
    Jaehnichen, Patrick
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 156 - 160
  • [2] IMPROVE FEW-SHOT VOICE CLONING USING MULTI-MODAL LEARNING
    Zhang, Haitong
    Lin, Yue
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 8317 - 8321
  • [3] Few-shot adaptation of multi-modal foundation models: a survey
    Liu, Fan
    Zhang, Tianshu
    Dai, Wenwen
    Zhang, Chuanyi
    Cai, Wenwen
    Zhou, Xiaocong
    Chen, Delong
    ARTIFICIAL INTELLIGENCE REVIEW, 2024, 57 (10)
  • [4] Few-shot multi-modal registration with mono-modal knowledge transfer
    Wang, Peng
    Guo, Yi
    Wang, Yuanyuan
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 85
  • [5] Zero-Shot and Few-Shot Video Question Answering with Multi-Modal Prompts
    Engin, Deniz
    Avrithis, Yannis
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 2796 - 2802
  • [6] An Adaptive Dual-channel Multi-modal graph neural network for few-shot learning
    Yang, Jieyi
    Dong, Yihong
    Li, Guoqing
    KNOWLEDGE-BASED SYSTEMS, 2025, 310
  • [7] Multi-modal Few-shot Image Recognition with enhanced semantic and visual integration
    Dong, Chunru
    Wang, Lizhen
    Zhang, Feng
    Hua, Qiang
    IMAGE AND VISION COMPUTING, 2025, 157
  • [8] Text generation and multi-modal knowledge transfer for few-shot object detection
    Du, Yaoyang
    Liu, Fang
    Jiao, Licheng
    Li, Shuo
    Hao, Zehua
    Li, Pengfang
    Wang, Jiahao
    Wang, Hao
    Liu, Xu
    PATTERN RECOGNITION, 2025, 161
  • [9] A Few-Shot Modulation Recognition Method Based on Multi-Modal Feature Fusion
    Zha, Yanping
    Wang, Hongjun
    Shen, Zhexian
    Wang, Jiangzhou
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (07) : 10823 - 10828
  • [10] Multi-Modal Prototypes for Few-Shot Object Detection in Remote Sensing Images
    Liu, Yanxing
    Pan, Zongxu
    Yang, Jianwei
    Zhou, Peiling
    Zhang, Bingchen
    REMOTE SENSING, 2024, 16 (24)