Image Manipulation Detection With Cascade Hierarchical Graph Representation

被引:3
|
作者
Pan, Wenyan [1 ]
Ma, Wentao [2 ]
Zhao, Shan [3 ]
Gu, Lichuan [2 ]
Shi, Guolong [2 ]
Xia, Zhihua
Wang, Meng [3 ,4 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp Sci, Nanjing 210044, Peoples R China
[2] Anhui Agr Univ, Sch Informat & Artificial Intelligence, Hefei 230036, Peoples R China
[3] Hefei Univ Technol, Sch Comp & Informat Engn, Hefei 230009, Peoples R China
[4] Jinan Univ, Coll Cyber Secur, Guangzhou 510632, Peoples R China
基金
中国国家自然科学基金;
关键词
Image manipulation detection; network cascade; graph convolutional network; digital forensics; NETWORKS;
D O I
10.1109/TCSVT.2024.3390127
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recent image manipulation detection approaches primarily rely on sophisticated Convolutional Neural Network (CNN)-based models for region localization, while they tend to ignore: 1) the feature correlations that exist between manipulated and non-manipulated regions; 2) significance of multi-scale representations in detecting manipulated regions of varying sizes, consequently hampering the overall performance of image manipulation detection. To address these limitations, we propose a novel approach, called Cascade Hierarchical Graph Convolutional Network (Cas-HGCN), which comprehensively learns the feature correlations between manipulated and non-manipulated regions at different scales using the Feature Correlations Modeling (FCM) module. Specifically, the FCM module treats the grids in the hierarchical image/feature maps as nodes, constructs a fully-connected graph by connecting each node, and leverages it to learn and refine feature correlations across different scales in a cascading manner. This process results in high discriminability for distinguishing manipulated and non-manipulated regions. Extensive experiments conducted on three public datasets, namely CASIA, NIST, and Coverage, demonstrate the promising detection accuracy achieved by Cas-HGCN without the need for pre-training on large datasets, surpassing the performance of existing state-of-the-art competitors.
引用
收藏
页码:8672 / 8683
页数:12
相关论文
共 50 条
  • [31] Knowledge Graph Representation via Hierarchical Hyperbolic Neural Graph Embedding
    Wang, Shen
    Wei, Xiaokai
    dos Santos, Cicero Nogueira
    Wang, Zhiguo
    Nallapati, Ramesh
    Arnold, Andrew
    Yu, Philip S.
    2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 540 - 549
  • [32] Graph commute times for image representation
    Behmo, Regis
    Paragios, Nikos
    Prinet, Veronique
    2008 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-12, 2008, : 3871 - +
  • [33] CommPOOL: An interpretable graph pooling framework for hierarchical graph representation learning
    Tang, Haoteng
    Ma, Guixiang
    He, Lifang
    Huang, Heng
    Zhan, Liang
    NEURAL NETWORKS, 2021, 143 : 669 - 677
  • [34] Cascade Image Matting with Deformable Graph Refinement
    Yu, Zijian
    Li, Xuhui
    Huang, Huijuan
    Zheng, Wen
    Chen, Li
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 7147 - 7156
  • [35] Fine-Grained Privacy Detection with Graph-Regularized Hierarchical Attentive Representation Learning
    Chen, Xiaolin
    Song, Xuemeng
    Ren, Ruiyang
    Zhu, Lei
    Cheng, Zhiyong
    Nie, Liqiang
    ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2020, 38 (04)
  • [36] Proactive Image Manipulation Detection
    Asnani, Vishal
    Yin, Xi
    Hassner, Tal
    Liu, Sijia
    Liu, Xiaoming
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 15365 - 15374
  • [37] Face Image Manipulation Detection
    Wen, Lilong
    Xu, Dan
    2019 THE 5TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING, CONTROL AND ROBOTICS (EECR 2019), 2019, 533
  • [38] Hierarchical Representation of Objects Using Shock Graph Methods
    Hingway, S. P.
    Bhurchandi, K. M.
    IMAGE PROCESSING: ALGORITHMS AND SYSTEMS VIII, 2010, 7532
  • [39] HCL: Improving Graph Representation with Hierarchical Contrastive Learning
    Wang, Jun
    Li, Weixun
    Hou, Changyu
    Tang, Xin
    Qiao, Yixuan
    Fang, Rui
    Li, Pengyong
    Gao, Peng
    Xie, Guotong
    SEMANTIC WEB - ISWC 2022, 2022, 13489 : 108 - 124
  • [40] Hierarchical Prototype Networks for Continual Graph Representation Learning
    Zhang, Xikun
    Song, Dongjin
    Tao, Dacheng
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (04) : 4622 - 4636