Fine-grained similarity semantic preserving deep hashing for cross-modal retrieval

被引:0
|
作者
Li, Guoyou [1 ]
Peng, Qingjun [2 ]
Zou, Dexu [2 ]
Yang, Jinyue [2 ]
Shu, Zhenqiu [3 ]
机构
[1] Yunnan Power Grid Corp, Kunming, Peoples R China
[2] Yunnan Power Grid Corp, Elect Power Res Inst, Kunming, Peoples R China
[3] Kunming Univ Sci & Technol, Fac Informat Engn & Automat, Kunming, Peoples R China
基金
中国国家自然科学基金;
关键词
cross-modal fusion; similarity semantic preserving; quantization loss; deep hashing; intra-modal similarity; inter-modal similarity; fine-grained similarity; NETWORK;
D O I
10.3389/fphy.2023.1194573
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Cross-modal hashing methods have received wide attention in cross-modal retrieval owing to their advantages in computational efficiency and storage cost. However, most existing deep cross-modal hashing methods cannot employ both intra-modal and inter-modal similarities to guide the learning of hash codes and ignore the quantization loss of hash codes, simultaneously. To solve the above problems, we propose a fine-grained similarity semantic preserving deep hashing (FSSPDH) for cross-modal retrieval. Firstly, this proposed method learns different hash codes for different modalities to preserve the intrinsic property of each modality. Secondly, the fine-grained similarity matrix is constructed by using labels and data features, which not only maintains the similarity between and within modalities. In addition, quantization loss is used to learn hash codes and thus effectively reduce information loss caused during the quantization procedure. A large number of experiments on three public datasets demonstrate the advantage of the proposed FSSPDH method.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Efficient discrete cross-modal hashing with semantic correlations and similarity preserving
    Yang, Fan
    Zhang, Qiaoxi
    Ma, Fumin
    Ding, Xiaojian
    Liu, Yufeng
    Tong, Deyu
    INFORMATION SCIENCES, 2023, 643
  • [22] Fine-Grained Matching with Multi-Perspective Similarity Modeling for Cross-Modal Retrieval
    Xie, Xiumin
    Hou, Chuanwen
    Li, Zhixin
    UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, VOL 180, 2022, 180 : 2148 - 2158
  • [23] Deep semantic hashing with dual attention for cross-modal retrieval
    Jiagao Wu
    Weiwei Weng
    Junxia Fu
    Linfeng Liu
    Bin Hu
    Neural Computing and Applications, 2022, 34 : 5397 - 5416
  • [24] Semantic decomposition and enhancement hashing for deep cross-modal retrieval
    Fei, Lunke
    He, Zhihao
    Wong, Wai Keung
    Zhu, Qi
    Zhao, Shuping
    Wen, Jie
    PATTERN RECOGNITION, 2025, 160
  • [25] Deep semantic hashing with dual attention for cross-modal retrieval
    Wu, Jiagao
    Weng, Weiwei
    Fu, Junxia
    Liu, Linfeng
    Hu, Bin
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (07): : 5397 - 5416
  • [26] Deep Visual-Semantic Hashing for Cross-Modal Retrieval
    Cao, Yue
    Long, Mingsheng
    Wang, Jianmin
    Yang, Qiang
    Yu, Philip S.
    KDD'16: PROCEEDINGS OF THE 22ND ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2016, : 1445 - 1454
  • [27] Gaussian similarity preserving for cross-modal hashing
    Lin, Liuyin
    Shu, Xin
    NEUROCOMPUTING, 2022, 494 : 446 - 454
  • [28] Multi-Grained Similarity Preserving and Updating for Unsupervised Cross-Modal Hashing
    Wu, Runbing
    Zhu, Xinghui
    Yi, Zeqian
    Zou, Zhuoyang
    Liu, Yi
    Zhu, Lei
    APPLIED SCIENCES-BASEL, 2024, 14 (02):
  • [29] Semantic deep cross-modal hashing
    Lin, Qiubin
    Cao, Wenming
    He, Zhihai
    He, Zhiquan
    NEUROCOMPUTING, 2020, 396 (396) : 113 - 122
  • [30] Semantic consistency hashing for cross-modal retrieval
    Yao, Tao
    Kong, Xiangwei
    Fu, Haiyan
    Tian, Qi
    NEUROCOMPUTING, 2016, 193 : 250 - 259