UGEE-Net: Uncertainty-guided and edge-enhanced network for image splicing localization

被引:0
|
作者
Hao, Qixian [1 ]
Ren, Ruyong [1 ]
Niu, Shaozhang [1 ,2 ]
Wang, Kai [1 ]
Wang, Maosen [2 ]
Zhang, Jiwei [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Comp, Beijing Key Lab Intelligent Telecommun Software &, Beijing 100876, Peoples R China
[2] Southeast Digital Econ Dev Inst, Quzhou 324000, Peoples R China
基金
中国国家自然科学基金;
关键词
Image forensics; Image splicing; Novel dataset; Uncertainty guidance; Edge enhancement; ZERNIKE MOMENTS;
D O I
10.1016/j.neunet.2024.106430
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image splicing, a prevalent method for image tampering, has significantly undermined image authenticity. Existing methods for Image Splicing Localization (ISL) struggle with challenges like limited accuracy and subpar performance when dealing with imperceptible tampering and multiple tampered regions. We introduce an Uncertainty-Guided and Edge-Enhanced Network (UGEE-Net) for ISL to tackle these issues. UGEE-Net consists of two core tasks: uncertainty guidance and edge enhancement. We employ Bayesian learning to model uncertainty maps of tampered regions, directing the model's focus to challenging pixels. Simultaneously, we employ a frequency domain-auxiliary edge enhancement strategy to imbue localization features with global contour information and fine-grained local details. These mechanisms work in parallel, synergistically boosting performance. Additionally, we introduce a cross-level fusion and propagation mechanism that effectively utilizes contextual information for cross-layer feature integration and leverages channel-level correlations for cross-layer feature propagation, gradually enhancing the localization feature's details. Experiment results affirm UGEE-Net's superiority in terms of detection accuracy, robustness, and generalization capabilities. Furthermore, to meet the growing demand for high-quality datasets in image forensics, we present the HTSI12K dataset, which includes 12,000 spliced images with imperceptible tampering traces and diverse categories, rendering it suitable for realworld auxiliary model training.
引用
收藏
页数:23
相关论文
共 29 条
  • [21] Uncertainty-guided symmetric multilevel supervision network for 3D left atrium segmentation in late gadolinium-enhanced MRI
    Liu, Yashu
    Wang, Wei
    Luo, Gongning
    Wang, Kuanquan
    Liang, Dong
    Li, Shuo
    MEDICAL PHYSICS, 2022, 49 (07) : 4554 - 4565
  • [22] MRU-Net: A remote sensing image segmentation network for enhanced edge contour Detection
    Han, Jing
    Wang, Weiyu
    Lin, Yuqi
    Lyu, Xueqiang
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2023, 17 (12): : 3364 - 3382
  • [23] SCALE-Net: Scalable Vehicle Trajectory Prediction Network under Random Number of Interacting Vehicles via Edge-enhanced Graph Convolutional Neural Network
    Jeon, Hyeongseok
    Choi, Junwon
    Kum, Dongsuk
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 2095 - 2102
  • [24] DAE-Net: Dual Attention Mechanism and Edge Supervision Network for Image Manipulation Detection and Localization
    Shi, Chunyin
    Wang, Chengyou
    Zhou, Xiao
    Qin, Zhiliang
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [25] EE-Net: An edge-enhanced deep learning network for jointly identifying corneal micro-layers from optical coherence tomography
    Wang, Lei
    Shen, Meixiao
    Shi, Ce
    Zhou, Yuheng
    Chen, Yang
    Pu, Jiantao
    Chen, Hao
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 71
  • [26] EC-Net: General image tampering localization network based on edge distribution guidance and contrastive learning
    Hao, Qixian
    Ren, Ruyong
    Wang, Kai
    Niu, Shaozhang
    Zhang, Jiwei
    Wang, Maosen
    KNOWLEDGE-BASED SYSTEMS, 2024, 293
  • [27] CECL-Net: Contrastive Learning and Edge-Reconstruction-Driven Complementary Learning Network for Image Forgery Localization
    Dai, Gaoyuan
    Chen, Kai
    Huang, Linjie
    Chen, Longru
    An, Dongping
    Wang, Zhe
    Wang, Kai
    ELECTRONICS, 2024, 13 (19)
  • [28] DAE2GAN: Image super-resolution for remote sensing based on an improved edge-enhanced generative adversarial network with double-end attention mechanism
    Lin, Zhenyi
    Liu, Yijun
    Ye, Wujian
    Lin, Bili
    Zhou, Huihui
    JOURNAL OF APPLIED REMOTE SENSING, 2024, 18 (01)
  • [29] A Novel Attention-Guided Enhanced U-Net With Hybrid Edge-Preserving Structural Loss for Low-Dose CT Image Denoising
    Zubair, Muhammad
    Md Rais, Helmi
    Alazemi, Talal
    IEEE ACCESS, 2025, 13 : 6909 - 6923