Perceptual Hashing Using Pretrained Vision Transformers

被引:0
|
作者
De Geest, Jelle [1 ]
De Smet, Patrick [2 ]
Bonetto, Lucio [2 ]
Lambert, Peter [1 ]
Van Wallendael, Glenn [1 ]
Mareen, Hannes [1 ]
机构
[1] Univ Ghent, Imec, Dept Elect & Informat Syst, Technol Pk Zwijnaarde 122, B-9052 Ghent, Belgium
[2] Natl Inst Criminalist & Criminol NICC, Vilvoordsesteenweg 100, B-1120 Brussels, Belgium
来源
2024 IEEE GAMING, ENTERTAINMENT, AND MEDIA CONFERENCE, GEM 2024 | 2024年
关键词
Perceptual Hashing; Vision Transformer; Image Forensics;
D O I
10.1109/GEM61861.2024.10585453
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The rapid evolution of digital image circulation has necessitated robust techniques for image identification and comparison, particularly for sensitive applications such as detecting Child Sexual Abuse Material (CSAM) and preventing the spread of harmful content online. Traditional perceptual hashing methods, while useful, fall short when exposed to some common image transformations, or when images are doctored to avoid detection, rendering them ineffective for nuanced comparisons. Addressing this challenge, this paper introduces a novel pretrained vision transformer artificial intelligence (AI) model approach that enhances the robustness and accuracy of perceptual hashing. Leveraging a pretrained Vision Transformer (ViT-L/14), our approach integrates visual and textual data processing to generate feature arrays that represent perceptual image hashes. Through a comprehensive evaluation using a dataset of 50,000 images, we demonstrate that our method offers significant improvements in detecting similarities for certain complex image transformations, aligning more closely with human visual perception than conventional methods. While our method presents certain initial drawbacks such as larger hash sizes and high computational complexity, its ability to better handle perceptual nuances presents a forward step in the realm of image forensics. The potential applications of this research extend to law enforcement, digital media management, and the broader domain of content verification, setting the stage for more secure and efficient digital content analysis.
引用
收藏
页码:19 / 24
页数:6
相关论文
共 50 条
  • [31] Pretrained Transformers for Text Ranking: BERT and Beyond
    Latour, Marilyne
    TRAITEMENT AUTOMATIQUE DES LANGUES, 2022, 63 (01): : 89 - 100
  • [32] Pretrained Transformers for Text Ranking: BERT and Beyond
    Yates, Andrew
    Nogueira, Rodrigo
    Lin, Jimmy
    WSDM '21: PROCEEDINGS OF THE 14TH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2021, : 1154 - 1156
  • [33] Defending against adversarial examples using perceptual image hashing
    Wu, Ke
    Wang, Zichi
    Zhang, Xinpeng
    Tang, Zhenjun
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (02)
  • [34] Robust perceptual image hashing using fuzzy color histogram
    Gharde, Nilesh Dilipkumar
    Thounaojam, Dalton Meitei
    Soni, Badal
    Biswas, Saroj Kr.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (23) : 30815 - 30840
  • [35] SEMANTIC VIDEO CARVING USING PERCEPTUAL HASHING AND OPTICAL FLOW
    Fang, Junbin
    Li, Sijin
    Xi, Guikai
    Jiang, Zoe
    Yiu, Siu-Ming
    Yu, Liyang
    Wang, Xuan
    Han, Qi
    Li, Qiong
    ADVANCES IN DIGITAL FORENSICS XIII, 2017, 511 : 223 - 244
  • [36] Robust perceptual image hashing using fuzzy color histogram
    Nilesh Dilipkumar Gharde
    Dalton Meitei Thounaojam
    Badal Soni
    Saroj Kr. Biswas
    Multimedia Tools and Applications, 2018, 77 : 30815 - 30840
  • [37] Detection of Malicious Video Modifications using Perceptual Video Hashing
    Sandeep, R.
    Bora, Prabin Kumar
    PROCEEDINGS OF THE 2020 5TH INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND SECURITY (ICCCS-2020), 2020,
  • [38] Tamper-Resistant Corpus Retrieval Using Perceptual Hashing
    Hu, Die
    Hu, Weili
    TEHNICKI VJESNIK-TECHNICAL GAZETTE, 2024, 31 (04): : 1223 - 1231
  • [39] Perceptual Image Hashing Using Surf for Tampered Image Detection
    Swetha, Chavva Sri Lakshmi Rama
    Divya Sri, Chakravaram
    Bharathi, B.
    Lecture Notes in Electrical Engineering, 2021, 708 : 453 - 461
  • [40] Compressive perceptual hashing tracking
    Chen, Long
    Li, Zheng
    Yang, Jian-Fei
    NEUROCOMPUTING, 2017, 239 : 69 - 80