Face Forgery Detection via Multi-Feature Fusion and Local Enhancement

被引:5
|
作者
Zhang, Dengyong [1 ]
Chen, Jiahao [1 ]
Liao, Xin [2 ]
Li, Feng [1 ]
Chen, Jiaxin [1 ]
Yang, Gaobo [2 ]
机构
[1] Changsha Univ Sci & Technol, Sch Comp & Commun Engn, Changsha 410004, Peoples R China
[2] Hunan Univ, Coll Comp Sci & Elect Engn, Changsha 410082, Peoples R China
基金
中国国家自然科学基金;
关键词
Deepfakes; face forgery detection; spatial domain; noise domain;
D O I
10.1109/TCSVT.2024.3390945
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the rapid growth of Internet technology, security concerns have risen, particularly with the prevalence of Deepfakes, a popular visual forgery technique. Therefore, there is necessary to research more powerful methods to detect Deepfakes. However, many Convolutional Neural Networks-based detection methods struggle with cross-database performance, often overfitting to specific color textures. We observe that image noises can weaken the influence of color textures and expose the forgery traces in the noise domain. This is because tampering techniques, when altering face images, disrupt the consistency of feature distribution in the noise space. And the forgery traces in the noise space are complementary to the tampering artifacts present in the image space information. Therefore, we propose a novel face forgery detection network that combines spatial domain and noise domain. Our Dual Feature Fusion Module and Local Enhancement Attention Module contribute to more comprehensive feature representations, enhancing our method's discriminative ability. Experimental results demonstrate superior performance compared to existing methods on mainstream datasets. https://github.com/jhchen1998/DeepfakeDetection.
引用
收藏
页码:8972 / 8977
页数:6
相关论文
共 50 条
  • [31] Multi-Feature Fusion via Hierarchical Regression for Multimedia Analysis
    Yang, Yi
    Song, Jingkuan
    Huang, Zi
    Ma, Zhigang
    Sebe, Nicu
    Hauptmann, Alexander G.
    IEEE TRANSACTIONS ON MULTIMEDIA, 2013, 15 (03) : 572 - 581
  • [32] Ship trajectory anomaly detection based on multi-feature fusion
    Huang, Guanbin
    Lai, Shanyan
    Ye, Chunyang
    Zhou, Hui
    2021 IEEE INTERNATIONAL CONFERENCE ON SMART DATA SERVICES (SMDS 2021), 2021, : 72 - 81
  • [33] Traffic lights detection and recognition based on multi-feature fusion
    Wenhao Wang
    Shanlin Sun
    Mingxin Jiang
    Yunyang Yan
    Xiaobing Chen
    Multimedia Tools and Applications, 2017, 76 : 14829 - 14846
  • [34] Traffic lights detection and recognition based on multi-feature fusion
    Wang, Wenhao
    Sun, Shanlin
    Jiang, Mingxin
    Yan, Yunyang
    Chen, Xiaobing
    MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (13) : 14829 - 14846
  • [35] Multi-feature fusion-based strabismus detection for children
    Zhang, Guiying
    Xu, Wenjing
    Gong, Haotian
    Sun, Lilei
    Li, Cong
    Chen, Huicong
    Xiang, Daoman
    IET IMAGE PROCESSING, 2023, 17 (05) : 1590 - 1602
  • [36] An Image Edge Detection Algorithm Based on Multi-Feature Fusion
    Wang, Zhenzhou
    Li, Kangyang
    Wang, Xiang
    Lee, Antonio
    CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 73 (03): : 4995 - 5009
  • [37] Small insulator target detection based on multi-feature fusion
    Tang, Minan
    Liang, Kai
    Qiu, Jiandong
    IET IMAGE PROCESSING, 2023, 17 (05) : 1520 - 1533
  • [38] Implicit Offensive Speech Detection Based on Multi-feature Fusion
    Guo, Tengda
    Lin, Lianxin
    Liu, Hang
    Zheng, Chengping
    Tu, Zhijian
    Wang, Haizhou
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT II, KSEM 2023, 2023, 14118 : 27 - 38
  • [39] Multi-feature fusion CNNs for Drosophila embryo of interest detection
    Xu, Qingzhen
    Wang, Zhoutao
    Wang, Fengyun
    Gong, Yongyi
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2019, 531
  • [40] A flame detection algorithm based on video multi-feature fusion
    Zhang, Jinhua
    Zhuang, Jian
    Du, Haifeng
    Wang, Sun'an
    Li, Xiaohu
    ADVANCES IN NATURAL COMPUTATION, PT 2, 2006, 4222 : 784 - 792