Discrete online cross-modal hashing with consistency preservation

被引:0
|
作者
Kang, Xiao [1 ]
Liu, Xingbo [2 ]
Xue, Wen [1 ]
Zhang, Xuening [1 ]
Nie, Xiushan [2 ,3 ]
Yin, Yilong
机构
[1] Shandong Univ, Sch Software, Jinan, Peoples R China
[2] Shandong Jianzhu Univ, Sch Comp Sci & Technol, Jinan, Peoples R China
[3] Shandong Yunhai Guochuang Cloud Comp Equipment Ind, Jinan, Peoples R China
基金
中国国家自然科学基金;
关键词
Cross-modal retrieval; Supervised online hashing; Continuous semantic embedding; Fine-grained similarity preserving; Modality deviation calibration;
D O I
10.1016/j.patcog.2024.110688
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Online cross-modal hashing has attracted widespread attention with the rapid expansion of large-scale streaming data, which can reduce storage requirements and enhance efficiency for online cross-modal retrieval. However, despite promising progress, existing methods still suffer from defective accuracy in a way, primarily attributed to two issues: insufficient semantic information exploitation and mismatched training-retrieval process. To address these challenges, we propose a novel supervised hashing method with dual consistency preservation, called Discrete Online Cross-Modal Hashing (DOCMH). On the one hand, we design more informative continuous semantic labels and fine-grained similarity graphs to preserve semantic consistency across different streaming data chunks and modality representations. On the other hand, we propose an effective modality deviation calibration mechanism for preserving learning process consistency between the training and retrieval phases. Extensive experiments on three widely used benchmark datasets demonstrate the superior performance of the proposed DOCMH under various scenarios.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Discrete online cross-modal hashing
    Zhan, Yu-Wei
    Wang, Yongxin
    Sun, Yu
    Wu, Xiao-Ming
    Luo, Xin
    Xu, Xin-Shun
    PATTERN RECOGNITION, 2022, 122
  • [2] Fast discrete cross-modal hashing with semantic consistency
    Yao, Tao
    Yan, Lianshan
    Ma, Yilan
    Yu, Hong
    Su, Qingtang
    Wang, Gang
    Tian, Qi
    NEURAL NETWORKS, 2020, 125 (125) : 142 - 152
  • [3] Fast Asymmetric and Discrete Cross-Modal Hashing With Semantic Consistency
    Teng, Shaohua
    Ning, Chengzhen
    Zhang, Wei
    Wu, NaiQi
    Zeng, Ying
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2023, 10 (02) : 577 - 589
  • [4] Cross-Modal Discrete Hashing
    Liong, Venice Erin
    Lu, Jiwen
    Tan, Yap-Peng
    PATTERN RECOGNITION, 2018, 79 : 114 - 129
  • [5] Asymmetric Discrete Cross-Modal Hashing
    Luo, Xin
    Zhang, Peng-Fei
    Wu, Ye
    Chen, Zhen-Duo
    Huang, Hua-Junjie
    Xu, Xin-Shun
    ICMR '18: PROCEEDINGS OF THE 2018 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, 2018, : 204 - 212
  • [6] Online Discriminative Cross-Modal Hashing
    Kang, Xiao
    Liu, Xingbo
    Zhang, Xuening
    Nie, Xiushan
    Yin, Yilong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (07) : 5242 - 5254
  • [7] Semantic consistency hashing for cross-modal retrieval
    Yao, Tao
    Kong, Xiangwei
    Fu, Haiyan
    Tian, Qi
    NEUROCOMPUTING, 2016, 193 : 250 - 259
  • [8] Discrete matrix factorization cross-modal hashing with multi-similarity consistency
    Li, Yiru
    Hu, Peiwen
    Li, Ying
    Peng, Shouyong
    Zhang, Xiaofeng
    Yue, Jun
    Yao, Tao
    COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (04) : 4195 - 4212
  • [9] Discrete matrix factorization cross-modal hashing with multi-similarity consistency
    Yiru Li
    Peiwen Hu
    Ying Li
    Shouyong Peng
    Xiaofeng Zhang
    Jun Yue
    Tao Yao
    Complex & Intelligent Systems, 2023, 9 : 4195 - 4212
  • [10] Online weighted hashing for cross-modal retrieval
    Jiang, Zining
    Weng, Zhenyu
    Li, Runhao
    Zhuang, Huiping
    Lin, Zhiping
    PATTERN RECOGNITION, 2025, 161