Dual-Stream Fusion and Multi-scale Analysis: Introducing the Synergistic Dual-Stream Network (SDS-Net) for Image Manipulation Segmentation

被引:0
|
作者
Song, Huaqing [1 ]
Lin, Baichuan [1 ]
Xie, Lanchi [1 ]
机构
[1] Minist Publ Secur, Inst Forens Sci, Beijing, Peoples R China
关键词
image forensics; multiscale spatial pyramid; stream fusion; tampering localization; FORGERIES;
D O I
10.1002/aisy.202300749
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article introduces the synergistic dual-stream network (SDS-Net), a novel neural network architecture that significantly enhances the detection of image manipulations. SDS-Net employs a unique dual-stream fusion strategy that processes both RGB image and the corresponding noise map. It innovatively combines features computation from the different blocks of dual backbones, and leverages a multi-scale spatial pyramid pooling (MSPP) module to expand the receptive fields of shallow features. This approach not only enriches the feature representation, but also ensures the precise localization of manipulated regions. Extensive experiments conducted on various public datasets demonstrate the superiority of SDS-Net over several state-of-the-art methods. Introducing synergistic dual-stream network (SDS-Net), a groundbreaking deep learning framework for image manipulation detection. This innovative system employs a dual-stream fusion strategy, enhancing feature extraction capabilities and ensures precise localization of tampered regions. SDS-Net's unique approach significantly outperforms existing methods, offering robust and accurate detection across different datasets.image (c) 2024 WILEY-VCH GmbH
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Dual-Stream CoAtNet models for accurate breast ultrasound image segmentation
    Zaidkilani N.
    Garcia M.A.
    Puig D.
    Neural Computing and Applications, 2024, 36 (26) : 16427 - 16443
  • [32] Deep Dual-Stream Network with Scale Context Selection Attention Module for Semantic Segmentation
    Yifu Liu
    Chenfeng Xu
    Zhihong Chen
    Chao Chen
    Han Zhao
    Xinyu Jin
    Neural Processing Letters, 2020, 51 : 2281 - 2299
  • [33] Hepatic and portal vein segmentation with dual-stream deep neural network
    Xu, Jichen
    Jiang, Wei
    Wu, Jiayi
    Zhang, Wei
    Zhu, Zhenyu
    Xin, Jingmin
    Zheng, Nanning
    Wang, Bo
    MEDICAL PHYSICS, 2024, 51 (08) : 5441 - 5456
  • [34] Face spoofing detection based on multi-scale color inversion dual-stream convolutional neural network
    Shu, Xin
    Li, Xiaojie
    Zuo, Xin
    Xu, Dan
    Shi, Jinlong
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 224
  • [35] Modular dual-stream visual fusion network for visual question answering
    Xue, Lixia
    Wang, Wenhao
    Wang, Ronggui
    Yang, Juan
    VISUAL COMPUTER, 2025, 41 (01): : 549 - 562
  • [36] Dual-Stream Feature Fusion Network for Detection and ReID in Multi-object Tracking
    He, Qingyou
    Li, Liangqun
    PRICAI 2022: TRENDS IN ARTIFICIAL INTELLIGENCE, PT I, 2022, 13629 : 247 - 260
  • [37] A non-local dual-stream fusion network for laryngoscope recognition
    Wei, Ran
    Liang, Yan
    Geng, Lei
    Wang, Wei
    Wei, Mei
    AMERICAN JOURNAL OF OTOLARYNGOLOGY, 2025, 46 (01)
  • [38] Dual-stream feature fusion network for person re-identification
    Zhang, Wenbin
    Li, Zhaoyang
    Du, Haishun
    Tong, Jiangang
    Liu, Zhihua
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 131
  • [39] Joint dual-stream interaction and multi-scale feature extraction network for multi-spectral pedestrian detection
    Hu, Wenjun
    Fu, Chenglong
    Cao, Runlong
    Zang, Ying
    Wu, Xiao-Jun
    Shen, Shigen
    Gao, Xiao-Zhi
    APPLIED SOFT COMPUTING, 2023, 147
  • [40] Dual-Stream Fusion Network for Spatiotemporal Video Super-Resolution
    Tseng, Min-Yuan
    Chen, Yen-Chung
    Lee, Yi-Lun
    Lai, Wei-Sheng
    Tsai, Yi-Hsuan
    Chiu, Wei-Chen
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 2683 - 2692