Fine-grained similarity semantic preserving deep hashing for cross-modal retrieval

被引:0
|
作者
Li, Guoyou [1 ]
Peng, Qingjun [2 ]
Zou, Dexu [2 ]
Yang, Jinyue [2 ]
Shu, Zhenqiu [3 ]
机构
[1] Yunnan Power Grid Corp, Kunming, Peoples R China
[2] Yunnan Power Grid Corp, Elect Power Res Inst, Kunming, Peoples R China
[3] Kunming Univ Sci & Technol, Fac Informat Engn & Automat, Kunming, Peoples R China
基金
中国国家自然科学基金;
关键词
cross-modal fusion; similarity semantic preserving; quantization loss; deep hashing; intra-modal similarity; inter-modal similarity; fine-grained similarity; NETWORK;
D O I
10.3389/fphy.2023.1194573
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Cross-modal hashing methods have received wide attention in cross-modal retrieval owing to their advantages in computational efficiency and storage cost. However, most existing deep cross-modal hashing methods cannot employ both intra-modal and inter-modal similarities to guide the learning of hash codes and ignore the quantization loss of hash codes, simultaneously. To solve the above problems, we propose a fine-grained similarity semantic preserving deep hashing (FSSPDH) for cross-modal retrieval. Firstly, this proposed method learns different hash codes for different modalities to preserve the intrinsic property of each modality. Secondly, the fine-grained similarity matrix is constructed by using labels and data features, which not only maintains the similarity between and within modalities. In addition, quantization loss is used to learn hash codes and thus effectively reduce information loss caused during the quantization procedure. A large number of experiments on three public datasets demonstrate the advantage of the proposed FSSPDH method.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Multi-label adversarial fine-grained cross-modal retrieval
    Sun, Chunpu
    Zhang, Huaxiang
    Liu, Li
    Liu, Dongmei
    Wang, Lin
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2023, 117
  • [42] Cross-modal hashing with semantic deep embedding
    Yan, Cheng
    Bai, Xiao
    Wang, Shuai
    Zhou, Jun
    Hancock, Edwin R.
    NEUROCOMPUTING, 2019, 337 : 58 - 66
  • [43] Discriminative latent semantics-preserving similarity embedding hashing for cross-modal retrieval
    Chen Y.
    Tan J.
    Yang Z.
    Cheng Y.
    Chen R.
    Neural Computing and Applications, 2024, 36 (18) : 10655 - 10680
  • [44] Semantic-Guided Hashing for Cross-Modal Retrieval
    Chen, Zhikui
    Du, Jianing
    Zhong, Fangming
    Chen, Shi
    2019 IEEE FIFTH INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING SERVICE AND APPLICATIONS (IEEE BIGDATASERVICE 2019), 2019, : 182 - 190
  • [45] Semantic Disentanglement Adversarial Hashing for Cross-Modal Retrieval
    Meng, Min
    Sun, Jiaxuan
    Liu, Jigang
    Yu, Jun
    Wu, Jigang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (03) : 1914 - 1926
  • [46] SEMI-SUPERVISED SEMANTIC-PRESERVING HASHING FOR EFFICIENT CROSS-MODAL RETRIEVAL
    Wang, Xingzhi
    Liu, Xin
    Hu, Zhikai
    Wang, Nannan
    Fan, Wentao
    Du, Ji-Xiang
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 1006 - 1011
  • [47] Multilevel Deep Semantic Feature Asymmetric Network for Cross-Modal Hashing Retrieval
    Jiang, Xiaolong
    Fan, Jiabao
    Zhang, Jie
    Lin, Ziyong
    Li, Mingyong
    IEEE LATIN AMERICA TRANSACTIONS, 2024, 22 (08) : 621 - 631
  • [48] Deep noise mitigation and semantic reconstruction hashing for unsupervised cross-modal retrieval
    Zhang, Cheng
    Wan, Yuan
    Qiang, Haopeng
    NEURAL COMPUTING & APPLICATIONS, 2024, 36 (10): : 5383 - 5397
  • [49] Deep Semantic Correlation Learning based Hashing for Multimedia Cross-Modal Retrieval
    Gong, Xiaolong
    Huang, Linpeng
    Wang, Fuwei
    2018 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2018, : 117 - 126
  • [50] Multi-attention based semantic deep hashing for cross-modal retrieval
    Zhu, Liping
    Tian, Gangyi
    Wang, Bingyao
    Wang, Wenjie
    Zhang, Di
    Li, Chengyang
    APPLIED INTELLIGENCE, 2021, 51 (08) : 5927 - 5939