MLPN: Multi-Scale Laplacian Pyramid Network for deepfake detection and localization

被引:0
|
作者
Zhang, Yibo [1 ,2 ]
Lin, Weiguo [1 ]
Xu, Junfeng [1 ]
Xu, Wanshang [1 ]
Xu, Yikun [1 ]
机构
[1] Commun Univ China, Sch Comp & Cyber Sci, Beijing 100024, Peoples R China
[2] North China Inst Sci & Technol, Sch Comp, Langfang 065201, Peoples R China
基金
中国国家自然科学基金;
关键词
Deepfake detection; Deepfake localization; Laplacian pyramid; DF;
D O I
10.1016/j.jisa.2025.103965
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sophisticated and realistic facial manipulation videos created by deepfake technology have become ubiquitous, leading to profound trust crises and security risks in contemporary society. However, various researchers concentrate on enhancing the precision and generalization of deepfake detection models, with little attention to forgery localization. Detecting deepfakes and identifying fake regions is a challenging task. We propose an end- to-end model for performing deepfake detection and forgery localization based on the Laplacian pyramid. The model is designed by an encoder-decoder architecture. Specifically, the encoder generates multi-scale features. The decoder gradually integrates multi-scale features and Laplacian residuals to reconstruct the prediction masks coarse-to-finely. Otherwise, we adopt a spatial pyramid pool approach to deal with high-level semantic features and integrate local and global information. Comprehensive experiments demonstrate that the proposed model performs satisfactorily in deepfake detection and localization.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Multi-scale Pyramid Pooling Network for salient object detection
    Dakhia, Abdelhafid
    Wang, Tiantian
    Lu, Huchuan
    NEUROCOMPUTING, 2019, 333 : 211 - 220
  • [2] Multi-Scale Detail Enhanced Pyramid Network for Esophageal Lesion Detection
    Li, Chi
    Zhou, Yingyue
    Yao, Hanmin
    Li, Xiaoxia
    Qin, Jiamin
    Zhuang, Ming
    Wen, Liming
    Computer Engineering and Applications, 2024, 60 (04) : 229 - 236
  • [3] Multi-Scale Residual Aggregation Feature Pyramid Network for Object Detection
    Wang, Hongyang
    Wang, Tiejun
    ELECTRONICS, 2023, 12 (01)
  • [4] MULTI-SCALE PERMUTATION ENTROPY FOR AUDIO DEEPFAKE DETECTION
    Wang, Chenglong
    He, Jiayi
    Yi, Jiangyan
    Tao, Jianhua
    Zhang, Chu Yuan
    Zhang, Xiaohui
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 1406 - 1410
  • [5] Pyramid attention object detection network with multi-scale feature fusion
    Chen, Xiu
    Li, Yujie
    Nakatoh, Yoshihisa
    COMPUTERS & ELECTRICAL ENGINEERING, 2022, 104
  • [6] FEATURE FUSING OF FEATURE PYRAMID NETWORK FOR MULTI-SCALE PEDESTRIAN DETECTION
    Tesema, Fiseha B.
    Lin, Junpeng
    Ou, Jie
    Wu, Hong
    Zhu, William
    2018 15TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICCWAMTIP), 2018, : 10 - 13
  • [7] Group multi-scale attention pyramid network for traffic sign detection
    Shen, Lili
    You, Liang
    Peng, Bo
    Zhang, Chuhe
    NEUROCOMPUTING, 2021, 452 : 1 - 14
  • [8] DeepFake detection with multi-scale convolution and vision transformer
    Lin, Hao
    Huang, Wenmin
    Luo, Weiqi
    Lu, Wei
    DIGITAL SIGNAL PROCESSING, 2023, 134
  • [9] A Scale-Aware Pyramid Network for Multi-Scale Object Detection in SAR Images
    Tang, Linbo
    Tang, Wei
    Qu, Xin
    Han, Yuqi
    Wang, Wenzheng
    Zhao, Baojun
    REMOTE SENSING, 2022, 14 (04)
  • [10] SCALE-TRANSFERRABLE PYRAMID NETWORK FOR MULTI-SCALE SHIP DETECTION IN SAR IMAGES
    Liu, Nengyuan
    Cui, Zongyong
    Cao, Zongjie
    Pi, Yiming
    Lan, Hai
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 1 - 4