UGEE-Net: Uncertainty-guided and edge-enhanced network for image splicing localization

被引:0
|
作者
Hao, Qixian [1 ]
Ren, Ruyong [1 ]
Niu, Shaozhang [1 ,2 ]
Wang, Kai [1 ]
Wang, Maosen [2 ]
Zhang, Jiwei [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Comp, Beijing Key Lab Intelligent Telecommun Software &, Beijing 100876, Peoples R China
[2] Southeast Digital Econ Dev Inst, Quzhou 324000, Peoples R China
基金
中国国家自然科学基金;
关键词
Image forensics; Image splicing; Novel dataset; Uncertainty guidance; Edge enhancement; ZERNIKE MOMENTS;
D O I
10.1016/j.neunet.2024.106430
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image splicing, a prevalent method for image tampering, has significantly undermined image authenticity. Existing methods for Image Splicing Localization (ISL) struggle with challenges like limited accuracy and subpar performance when dealing with imperceptible tampering and multiple tampered regions. We introduce an Uncertainty-Guided and Edge-Enhanced Network (UGEE-Net) for ISL to tackle these issues. UGEE-Net consists of two core tasks: uncertainty guidance and edge enhancement. We employ Bayesian learning to model uncertainty maps of tampered regions, directing the model's focus to challenging pixels. Simultaneously, we employ a frequency domain-auxiliary edge enhancement strategy to imbue localization features with global contour information and fine-grained local details. These mechanisms work in parallel, synergistically boosting performance. Additionally, we introduce a cross-level fusion and propagation mechanism that effectively utilizes contextual information for cross-layer feature integration and leverages channel-level correlations for cross-layer feature propagation, gradually enhancing the localization feature's details. Experiment results affirm UGEE-Net's superiority in terms of detection accuracy, robustness, and generalization capabilities. Furthermore, to meet the growing demand for high-quality datasets in image forensics, we present the HTSI12K dataset, which includes 12,000 spliced images with imperceptible tampering traces and diverse categories, rendering it suitable for realworld auxiliary model training.
引用
收藏
页数:23
相关论文
共 29 条
  • [1] ET: Edge-Enhanced Transformer for Image Splicing Detection
    Sun, Yu
    Ni, Rongrong
    Zhao, Yao
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 1232 - 1236
  • [2] DSSE-net: dual stream skip edge-enhanced network with forgery loss for image forgery localization
    Zheng, Aokun
    Huang, Tianqiang
    Huang, Wei
    Huang, Liqing
    Ye, Feng
    Luo, Haifeng
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (06) : 2323 - 2335
  • [3] Exposing image splicing traces in scientific publications via uncertainty-guided refinement
    Lin, Xun
    Tang, Wenzhong
    Wang, Haoran
    Liu, Yizhong
    Ju, Yakun
    Wang, Shuai
    Yu, Zitong
    PATTERNS, 2024, 5 (09):
  • [4] UFG-Net: Uncertainty and frequency guided network for image forgery localization
    Wang, Kai
    Hao, Qixian
    Niu, Shaozhang
    Zhang, Jiwei
    Zhang, Wen
    NEUROCOMPUTING, 2025, 624
  • [5] Edge-Enhanced with Feedback Attention Network for Image Super-Resolution
    Fu, Chunmei
    Yin, Yong
    SENSORS, 2021, 21 (06) : 1 - 16
  • [6] EEA-Net: edge-enhanced assistance network for infrared small target detection
    Wang, Chen
    Hu, Xiaopeng
    Gao, Xiang
    Wei, Haoyu
    Tao, Jiawei
    Wang, Fan
    MACHINE VISION AND APPLICATIONS, 2024, 35 (04)
  • [7] Edge-enhanced efficient network for remote sensing image super-resolution
    Zhang, Tianlin
    Chen, Hongzhen
    Chen, Shi
    Bian, Chunjiang
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (14) : 5324 - 5347
  • [8] EL-GAN: Edge-Enhanced Generative Adversarial Network for Layout-to-Image Generation
    Gao, Lin
    Wu, Lei
    Meng, Xiangxu
    COMPUTER GRAPHICS FORUM, 2022, 41 (07) : 407 - 418
  • [9] EEI-NET: EDGE-ENHANCED INTERPOLATION NETWORK FOR SEMANTIC SEGMENTATION OF HISTORICAL BUILDING POINT CLOUDS
    Xue, Yaqian
    Zhang, Ruiju
    Wang, Jian
    Zhao, Jianghong
    Pang, Lei
    GEOSPATIAL WEEK 2023, VOL. 10-1, 2023, : 239 - 245
  • [10] MSA-Net: Multi-scale attention network for image splicing localization
    Caiping Yan
    Huajian Wei
    Zhi Lan
    Hong Li
    Multimedia Tools and Applications, 2024, 83 : 20587 - 20604