MLPN: Multi-Scale Laplacian Pyramid Network for deepfake detection and localization

被引:0
|
作者
Zhang, Yibo [1 ,2 ]
Lin, Weiguo [1 ]
Xu, Junfeng [1 ]
Xu, Wanshang [1 ]
Xu, Yikun [1 ]
机构
[1] Commun Univ China, Sch Comp & Cyber Sci, Beijing 100024, Peoples R China
[2] North China Inst Sci & Technol, Sch Comp, Langfang 065201, Peoples R China
基金
中国国家自然科学基金;
关键词
Deepfake detection; Deepfake localization; Laplacian pyramid; DF;
D O I
10.1016/j.jisa.2025.103965
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sophisticated and realistic facial manipulation videos created by deepfake technology have become ubiquitous, leading to profound trust crises and security risks in contemporary society. However, various researchers concentrate on enhancing the precision and generalization of deepfake detection models, with little attention to forgery localization. Detecting deepfakes and identifying fake regions is a challenging task. We propose an end- to-end model for performing deepfake detection and forgery localization based on the Laplacian pyramid. The model is designed by an encoder-decoder architecture. Specifically, the encoder generates multi-scale features. The decoder gradually integrates multi-scale features and Laplacian residuals to reconstruct the prediction masks coarse-to-finely. Otherwise, we adopt a spatial pyramid pool approach to deal with high-level semantic features and integrate local and global information. Comprehensive experiments demonstrate that the proposed model performs satisfactorily in deepfake detection and localization.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Anomaly detection with multi-scale pyramid grid templates
    Li, Shifeng
    Cheng, Yan
    Zhao, Liuyang
    Wang, Yue
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (04) : 9929 - 9947
  • [22] Detection and Localization with Multi-scale Models
    Ohn-Bar, Eshed
    Trivedi, Mohan M.
    2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 1382 - 1387
  • [23] Simple feature pyramid network for weakly supervised object localization using multi-scale information
    Bongyeong Koo
    Han-Soo Choi
    Myungjoo Kang
    Multidimensional Systems and Signal Processing, 2021, 32 : 1185 - 1197
  • [24] Simple feature pyramid network for weakly supervised object localization using multi-scale information
    Koo, Bongyeong
    Choi, Han-Soo
    Kang, Myungjoo
    MULTIDIMENSIONAL SYSTEMS AND SIGNAL PROCESSING, 2021, 32 (04) : 1185 - 1197
  • [25] Promoting Monocular Depth Estimation by Multi-Scale Residual Laplacian Pyramid Fusion
    Zhang, Anmei
    Ma, Yunchao
    Liu, Jiangyu
    Sun, Jian
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 205 - 209
  • [26] GAN for Semantic Image Synthesis With Laplacian Pyramid and Multi-Scale Channel Attention
    Dong, Xinhua
    Li, Chuang
    Xu, Zhigang
    Han, Hongmu
    Jiang, Lifeng
    IEEE ACCESS, 2024, 12 : 178010 - 178021
  • [27] Dynamic Temporal Pyramid Network: A Closer Look at Multi-scale Modeling for Activity Detection
    Zhang, Da
    Dai, Xiyang
    Wang, Yuan-Fang
    COMPUTER VISION - ACCV 2018, PT IV, 2019, 11364 : 712 - 728
  • [28] MS-CSPN: MULTI-SCALE CASCADE SPATIAL PYRAMID NETWORK FOR OBJECT DETECTION
    Wang, Tianyuan
    Ma, Can
    Su, Haoshan
    Wang, Weiping
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1490 - 1494
  • [29] Construct Effective Geometry Aware Feature Pyramid Network for Multi-Scale Object Detection
    Dong, Jinpeng
    Huang, Yuhao
    Zhang, Songyi
    Chen, Shitao
    Zheng, Nanning
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 534 - 541
  • [30] Multi-scale Laplacian community detection in heterogeneous networks
    Villegas, Pablo
    Gabrielli, Andrea
    Poggialini, Anna
    Gili, Tommaso
    PHYSICAL REVIEW RESEARCH, 2025, 7 (01):