ONION: Online Semantic Autoencoder Hashing for Cross-Modal Retrieval

被引:0
|
作者
Zhang, Donglin [1 ]
Wu, Xiao-Jun [1 ]
Chen, Guoqing [2 ]
机构
[1] Jiangnan Univ, Sch Artificial Intelligence & Comp Sci, 1800 Lihu Ave, Wuxi 214122, Jiangsu, Peoples R China
[2] Jiangnan Univ, Sch Sci, 1800 Lihu Ave, Wuxi 214122, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Cross-modal retrieval; online hashing; autoencoder; discrete optimization;
D O I
10.1145/3572032
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Cross-modal hashing (CMH) has recently received increasing attention with the merit of speed and storage in performing large-scale cross-media similarity search. However, most existing cross-media approaches utilize the batch-based mode to update hash functions, without the ability to efficiently handle the online streaming multimedia data. Online hashing can effectively address the preceding issue by using the online learning scheme to incrementally update the hash functions. Nevertheless, the existing online CMH approaches still suffer from several challenges, such as (1) how to efficiently and effectively utilize the supervision information, (2) how to learn more powerful hash functions, and (3) how to solve the binary constraints. To mitigate these limitations, we present a novel online hashing approach named ONION (ONline semantIc autOencoder hashiNg). Specifically, it leverages the semantic autoencoder scheme to establish the correlations between binary codes and labels, delivering the power to obtain more discriminative hash codes. Besides, the proposed ONION directly utilizes the label inner product to build the connection between existing data and newly coming data. Therefore, the optimization is less sensitive to the newly arriving data. Equipping a discrete optimization scheme designed to solve the binary constraints, the quantization errors can be dramatically reduced. Furthermore, the hash functions are learned by the proposed autoencoder strategy, making the hash functions more powerful. Extensive experiments on three large-scale databases demonstrate that the performance of our ONION is superior to several recent competitive online and offline cross-media algorithms.
引用
收藏
页数:18
相关论文
共 50 条
  • [41] Hashing for Cross-Modal Similarity Retrieval
    Liu, Yao
    Yuan, Yanhong
    Huang, Qiaoli
    Huang, Zhixing
    2015 11TH INTERNATIONAL CONFERENCE ON SEMANTICS, KNOWLEDGE AND GRIDS (SKG), 2015, : 1 - 8
  • [42] Discriminative Latent Semantic Regression for Cross-Modal Hashing of Multimedia Retrieval
    Wan, Jianwu
    Wang, Yi
    2018 IEEE FOURTH INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM), 2018,
  • [43] Deep Multi-Level Semantic Hashing for Cross-Modal Retrieval
    Ji, Zhenyan
    Yao, Weina
    Wei, Wei
    Song, Houbing
    Pi, Huaiyu
    IEEE ACCESS, 2019, 7 : 23667 - 23674
  • [44] Latent semantic-enhanced discrete hashing for cross-modal retrieval
    Yun Liu
    Shujuan Ji
    Qiang Fu
    Jianli Zhao
    Zhongying Zhao
    Maoguo Gong
    Applied Intelligence, 2022, 52 : 16004 - 16020
  • [45] Robust Asymmetric Cross-Modal Hashing Retrieval With Dual Semantic Enhancement
    Teng, Shaohua
    Xu, Tuhong
    Zheng, Zefeng
    Wu, Naiqi
    Zhang, Wei
    Teng, Luyao
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (03) : 4340 - 4353
  • [46] Latent semantic-enhanced discrete hashing for cross-modal retrieval
    Liu, Yun
    Ji, Shujuan
    Fu, Qiang
    Zhao, Jianli
    Zhao, Zhongying
    Gong, Maoguo
    APPLIED INTELLIGENCE, 2022, 52 (14) : 16004 - 16020
  • [47] Semantic-alignment transformer and adversary hashing for cross-modal retrieval
    Sun, Yajun
    Wang, Meng
    Ma, Ying
    APPLIED INTELLIGENCE, 2024, 54 (17-18) : 7581 - 7602
  • [48] Efficient discrete latent semantic hashing for scalable cross-modal retrieval
    Lu, Xu
    Zhu, Lei
    Cheng, Zhiyong
    Song, Xuemeng
    Zhang, Huaxiang
    SIGNAL PROCESSING, 2019, 154 : 217 - 231
  • [49] Scalable semantic-enhanced supervised hashing for cross-modal retrieval
    Yang, Fan
    Ding, Xiaojian
    Liu, Yufeng
    Ma, Fumin
    Cao, Jie
    KNOWLEDGE-BASED SYSTEMS, 2022, 251
  • [50] Label-Based Deep Semantic Hashing for Cross-Modal Retrieval
    Weng, Weiwei
    Wu, Jiagao
    Yang, Lu
    Liu, Linfeng
    Hu, Bin
    NEURAL INFORMATION PROCESSING (ICONIP 2019), PT III, 2019, 11955 : 24 - 36