MLPN: Multi-Scale Laplacian Pyramid Network for deepfake detection and localization

被引:0
|
作者
Zhang, Yibo [1 ,2 ]
Lin, Weiguo [1 ]
Xu, Junfeng [1 ]
Xu, Wanshang [1 ]
Xu, Yikun [1 ]
机构
[1] Commun Univ China, Sch Comp & Cyber Sci, Beijing 100024, Peoples R China
[2] North China Inst Sci & Technol, Sch Comp, Langfang 065201, Peoples R China
基金
中国国家自然科学基金;
关键词
Deepfake detection; Deepfake localization; Laplacian pyramid; DF;
D O I
10.1016/j.jisa.2025.103965
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sophisticated and realistic facial manipulation videos created by deepfake technology have become ubiquitous, leading to profound trust crises and security risks in contemporary society. However, various researchers concentrate on enhancing the precision and generalization of deepfake detection models, with little attention to forgery localization. Detecting deepfakes and identifying fake regions is a challenging task. We propose an end- to-end model for performing deepfake detection and forgery localization based on the Laplacian pyramid. The model is designed by an encoder-decoder architecture. Specifically, the encoder generates multi-scale features. The decoder gradually integrates multi-scale features and Laplacian residuals to reconstruct the prediction masks coarse-to-finely. Otherwise, we adopt a spatial pyramid pool approach to deal with high-level semantic features and integrate local and global information. Comprehensive experiments demonstrate that the proposed model performs satisfactorily in deepfake detection and localization.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Augmented Multi-Scale Spatiotemporal Inconsistency Magnifier for Generalized DeepFake Detection
    Yu, Yang
    Zhao, Xiaohui
    Ni, Rongrong
    Yang, Siyuan
    Zhao, Yao
    Kot, Alex C.
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 8487 - 8498
  • [32] MPANET: MULTI-SCALE PYRAMID AGGREGATION NETWORK FOR STEREO MATCHING
    Zhu, Ziyu
    Guo, Wei
    Chen, Wei
    Li, Qiuping
    Zhao, Yong
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 2773 - 2777
  • [33] Multi-Scale Salient Object Detection with Pyramid Spatial Pooling
    Zhang, Jing
    Dai, Yuchao
    Porikli, Fatih
    He, Mingyi
    2017 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC 2017), 2017, : 1245 - 1250
  • [34] Feature Pyramid Hierarchies for Multi-scale Temporal Action Detection
    He, Jiayu
    Li, Guohui
    Lei, Jun
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 2158 - 2165
  • [35] Multi-scale convolution target detection algorithm with feature pyramid
    Lin Z.-J.
    Luo Z.
    Zhao L.
    Lu D.-M.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2019, 53 (03): : 533 - 540
  • [36] Multi-Scale Pyramid Squeeze Attention Similarity Optimization Classification Neural Network for ERP Detection
    Xu, Ruitian
    Allison, Brendan Z.
    Zhao, Xueqing
    Liang, Wei
    Wang, Xingyu
    Cichocki, Andrzej
    Jin, Jing
    NEURAL NETWORKS, 2025, 184
  • [37] A Multi-Scale Feature Pyramid Network for Detection and Instance Segmentation of Marine Ships in SAR Images
    Sun, Zequn
    Meng, Chunning
    Cheng, Jierong
    Zhang, Zhiqing
    Chang, Shengjiang
    REMOTE SENSING, 2022, 14 (24)
  • [38] Infrared Multi-Scale Small-Target Detection Algorithm Based on Feature Pyramid Network
    Shi, Sanxia
    Song, Yinglei
    APPLIED SCIENCES-BASEL, 2024, 14 (13):
  • [39] FEATURE-TRANSFERABLE PYRAMID NETWORK FOR DENSE MULTI-SCALE OBJECT DETECTION IN SAR IMAGES
    Zhou, Zheng
    Cui, Zongyong
    Cao, Zongjie
    Yang, Jianyu
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 647 - 650
  • [40] Multi-scale Learning based Malware Variant Detection using Spatial Pyramid Pooling Network
    Sriram, S.
    Vinayakumar, R.
    Sowmya, V
    Alazab, Mamoun
    Soman, K. P.
    IEEE INFOCOM 2020 - IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (INFOCOM WKSHPS), 2020, : 740 - 745