Exploiting Visual Concepts to Improve Text-Based Image Retrieval

被引:0
|
作者
Tollari, Sabrina [1 ]
Detyniecki, Marcin [1 ]
Marsala, Christophe [1 ]
Fakeri-Tabrizi, Ali [1 ]
Amini, Massih-Reza [1 ]
Gallinari, Patrick [1 ]
机构
[1] Univ Paris 06, Lab Informat Paris 6, CNRS, UMR 7606, F-75016 Paris, France
来源
ADVANCES IN INFORMATION RETRIEVAL, PROCEEDINGS | 2009年 / 5478卷
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we study how to automatically exploit visual concepts in a text-based image retrieval task. First, we use Forest of Fuzzy Decision Trees (FFDTs) to automatically annotate images with visual concepts. Second, using optionally WordNet, we match visual concepts and textual query. Finally, we filter the text-based image retrieval result list using the FFDTs. This study is performed in the context of two tasks of the CLEF2008 international campaign: the Visual Concept Detection Task (VCDT) (17 visual concepts) and the photographic retrieval task (ImageCLEFphoto) (39 queries and 20k images). Our best VCDT run is the 4th best of the 53 submitted runs. The ImageCLEFphoto results show that there is a clear improvement, in terms of precision at 20, when using the visual concepts explicitly appearing in the query.
引用
收藏
页码:701 / 705
页数:5
相关论文
共 50 条
  • [1] EFFECTS OF CENTRALITY ON RETRIEVAL OF TEXT-BASED CONCEPTS
    ALBRECHT, JE
    OBRIEN, EJ
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 1991, 17 (05) : 932 - 939
  • [2] Image Sense Classification in Text-Based Image Retrieval
    Chang, Yih-Chen
    Chen, Hsin-Hsi
    INFORMATION RETRIEVAL TECHNOLOGY, PROCEEDINGS, 2009, 5839 : 124 - 135
  • [3] Exploiting Knowledge Graph to Improve Text-based Prediction
    Jiang, Shan
    Zhai, Chengxiang
    Mei, Qiaozhu
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 1407 - 1416
  • [4] A Scene Text-Based Image Retrieval System
    Thuy Ho
    Ngoc Ly
    2012 IEEE INTERNATIONAL SYMPOSIUM ON SIGNAL PROCESSING AND INFORMATION TECHNOLOGY (ISSPIT), 2012, : 79 - 84
  • [5] Image Captioning with Text-Based Visual Attention
    Chen He
    Haifeng Hu
    Neural Processing Letters, 2019, 49 : 177 - 185
  • [6] Image Captioning with Text-Based Visual Attention
    He, Chen
    Hu, Haifeng
    NEURAL PROCESSING LETTERS, 2019, 49 (01) : 177 - 185
  • [7] External query reformulation for text-based image retrieval
    Min, Jinming
    Jones, Gareth J. F.
    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2011, 7024 LNCS : 249 - 260
  • [8] External Query Reformulation for Text-Based Image Retrieval
    Min, Jinming
    Jones, Gareth J. F.
    STRING PROCESSING AND INFORMATION RETRIEVAL, 2011, 7024 : 249 - 260
  • [9] Implementation and Comparison of Text-Based Image Retrieval Schemes
    Zaidi, Syed Ali Jafar
    Buriro, Attaullah
    Riaz, Mohammad
    Mahoob, Athar
    Riaz, Mohammad Noman
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2019, 10 (01) : 611 - 618
  • [10] Using Visual Concepts and Fast Visual Diversity to Improve Image Retrieval
    Tollari, Sabrina
    Detyniecki, Marcin
    Fakeri-Tabrizi, Ali
    Marsala, Christophe
    Amini, Massih-Reza
    Gallinari, Patrick
    EVALUATING SYSTEMS FOR MULTILINGUAL AND MULTIMODAL INFORMATION ACCESS, 2009, 5706 : 577 - 584