Dual-Stream Fusion and Multi-scale Analysis: Introducing the Synergistic Dual-Stream Network (SDS-Net) for Image Manipulation Segmentation

被引:0
|
作者
Song, Huaqing [1 ]
Lin, Baichuan [1 ]
Xie, Lanchi [1 ]
机构
[1] Minist Publ Secur, Inst Forens Sci, Beijing, Peoples R China
关键词
image forensics; multiscale spatial pyramid; stream fusion; tampering localization; FORGERIES;
D O I
10.1002/aisy.202300749
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article introduces the synergistic dual-stream network (SDS-Net), a novel neural network architecture that significantly enhances the detection of image manipulations. SDS-Net employs a unique dual-stream fusion strategy that processes both RGB image and the corresponding noise map. It innovatively combines features computation from the different blocks of dual backbones, and leverages a multi-scale spatial pyramid pooling (MSPP) module to expand the receptive fields of shallow features. This approach not only enriches the feature representation, but also ensures the precise localization of manipulated regions. Extensive experiments conducted on various public datasets demonstrate the superiority of SDS-Net over several state-of-the-art methods. Introducing synergistic dual-stream network (SDS-Net), a groundbreaking deep learning framework for image manipulation detection. This innovative system employs a dual-stream fusion strategy, enhancing feature extraction capabilities and ensures precise localization of tampered regions. SDS-Net's unique approach significantly outperforms existing methods, offering robust and accurate detection across different datasets.image (c) 2024 WILEY-VCH GmbH
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Dual-stream enhancement encoder and attention optimization decoder for image manipulation localization
    Zhu, Ye
    Zhao, Xiaoxiang
    Yu, Yang
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2024, 39 (08) : 1103 - 1115
  • [42] A WAVELET-BASED DUAL-STREAM NETWORK FOR UNDERWATER IMAGE ENHANCEMENT
    Ma, Ziyin
    Oh, Changjae
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2769 - 2773
  • [43] Deep Dual-Stream Convolutional Neural Networks for Cardiac Image Semantic Segmentation
    Hu, Hengqi
    Fang, Bin
    Ran, Yuting
    Wei, Xuekai
    Xian, Weizhi
    Zhou, Mingliang
    Kwong, Sam
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (05) : 7440 - 7448
  • [44] Dual-stream Co-enhanced Network for Unsupervised Video Object Segmentation
    Zhu, Hongliang
    Yin, Hui
    Liu, Yanting
    Chen, Ning
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2024, 18 (04): : 938 - 958
  • [45] A dual-stream framework guided by adaptive Gaussian maps for interactive image segmentation®
    Ding, Zongyuan
    Wang, Tao
    Sun, Quansen
    Cui, Qiongjie
    Chen, Fuhua
    KNOWLEDGE-BASED SYSTEMS, 2021, 223
  • [46] Infrared and Visible Image Fusion Using Dual-stream Generative Adversarial Network with Multiple Discriminators
    Wu L.
    Kang J.
    Ji Y.
    Ma H.
    Binggong Xuebao/Acta Armamentarii, 2024, 45 (06): : 1799 - 1812
  • [47] DSSFN: A Dual-Stream Self-Attention Fusion Network for Effective Hyperspectral Image Classification
    Yang, Zian
    Zheng, Nairong
    Wang, Feng
    REMOTE SENSING, 2023, 15 (15)
  • [48] DSF-Net: Dual-Stream Fused Network for Video Frame Interpolation
    Zhang, Fuhua
    Yang, Chuang
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 1122 - 1126
  • [49] DSF-Net: Dual-Stream Fused Network for Video Frame Interpolation
    Zhang, Fuhua
    Yang, Chuang
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 1122 - 1126
  • [50] Indoor RGB-D Image Semantic Segmentation Based on Dual-Stream Weighted Gabor Convolutional Network Fusion
    Xuchu, Wang
    Huihuang, Liu
    Yanmin, Niu
    ACTA OPTICA SINICA, 2020, 40 (19)