Generalizing Face Forgery Detection by Suppressed Texture Network With Two-Branch Convolution

被引:1
|
作者
Zhang, Dengyong [1 ,2 ]
Li, Daijie [1 ,2 ]
Sangaiah, Arun Kumar [3 ,4 ,5 ]
Li, Feng [1 ,2 ]
Deng, Zelin [1 ,2 ]
Wu, Chengcheng [1 ,2 ]
机构
[1] Changsha Univ Sci & Technol, Hunan Prov Key Lab Intelligent Proc Big Data Trans, Changsha 410114, Peoples R China
[2] Changsha Univ Sci & Technol, Sch Comp & Commun Engn, Changsha 410114, Peoples R China
[3] Natl Yunlin Univ Sci & Technol, Int Grad Sch Artificial Intelligence, Touliu 64002, Taiwan
[4] Sunway Univ, Sch Engn & Technol, Petaling Jaya 47500, Selangor, Malaysia
[5] Chandigarh Univ, Chandigarh 140413, Punjab, India
基金
中国国家自然科学基金;
关键词
Forgery; Faces; Kernel; Convolution; Image texture; Feature extraction; Streaming media; Cyber-bullying detection; deep learning; deepfake (DF) detection; face manipulation; generalization ability;
D O I
10.1109/TCSS.2024.3441251
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of Internet technology, deepfake (DF) videos can spread rapidly through online platforms, providing a new way of cyberbullying by generating nude pictures of female victims and using their faces to generate pornographic movies, which bring potential harm to individuals, society, and the country. Recently, there have been some really impressive results with DF detection models. These models have shown excellent outstanding performance when they are trained and tested using data from the same dataset. However, detecting DF remains difficult when the data comes from challenging datasets. To address this issue, this article aims to enhance the model's generalization by taking full advantage of the learning and representation capabilities of convolutional neural networks (CNNs) to adaptively suppress image texture information and catch deeper and more universal forgery features. Specifically, we introduce the texture suppression module (TSM) as a first step to suppress image content while simultaneously revealing the differences between authentic and tampered regions. Then, we carefully designed the cross stream interaction module (CSIM) and the cross stream mix block (CSMB) module to fully exploit the extracted forgery traces. Our proposed model has demonstrated superior generalization performance in extensive experiments.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] Wavelet-Based Texture Mining and Enhancement for Face Forgery Detection
    Li, Xin
    Zhao, Hui
    Xu, Bingxin
    Liu, Hongzhe
    IET BIOMETRICS, 2025, 2025 (01)
  • [42] Recognition method of surface electromyographic signal based on two-branch network
    Wang, Wanliang
    Pan, Jie
    Wang, Zheng
    Pan, Jiayu
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2024, 58 (11): : 2208 - 2218
  • [43] A two-branch encoder-decoder network for image tampering localization
    Luo, Yuling
    Liang, Ce
    Qin, Sheng
    Liu, Junxiu
    Fu, Qiang
    Yang, Su
    APPLIED SOFT COMPUTING, 2024, 164
  • [44] Two-Branch Filtering Generative Network Based on Transformer for Image Inpainting
    Cao, Feihan
    Zhu, Qifeng
    Chang, Yasheng
    Sun, Min
    IEEE ACCESS, 2024, 12 : 182908 - 182922
  • [45] MDCF-Net: Multi-Scale Dual-Branch Network for Compressed Face Forgery Detection
    Zhou, Jiting
    Zhao, Xinrui
    Xu, Qian
    Zhang, Pu
    Zhou, Zhihao
    IEEE ACCESS, 2024, 12 : 58740 - 58749
  • [46] Scene representation using a new two-branch neural network model
    Parseh, Mohammad Javad
    Rahmanimanesh, Mohammad
    Keshavarzi, Parviz
    Azimifar, Zohreh
    VISUAL COMPUTER, 2024, 40 (09): : 6219 - 6244
  • [47] Performance of two-branch polarisation antenna diversity in an operational GSM network
    Sorensen, TB
    Nielsen, AO
    Mogensen, PE
    Tolstrup, M
    Steffensen, K
    48TH IEEE VEHICULAR TECHNOLOGY CONFERENCE, VOLS 1-3, 1998, : 741 - 746
  • [48] Two-Branch Deeper Graph Convolutional Network for Hyperspectral Image Classification
    Yu, Linzhou
    Peng, Jiangtao
    Chen, Na
    Sun, Weiwei
    Du, Qian
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [49] Two-branch encoding and iterative attention decoding network for semantic segmentation
    Hegui Zhu
    Min Zhang
    Xiangde Zhang
    Libo Zhang
    Neural Computing and Applications, 2021, 33 : 5151 - 5166
  • [50] ADFNet: A two-branch robotic grasping network based on attention mechanism
    Xie, Pengwei
    Hao, Nan
    Chen, Bo
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 7986 - 7991