Low-Quality Deepfake Detection via Unseen Artifacts

被引:0
|
作者
Chhabra S. [1 ,2 ]
Thakral K. [1 ]
Mittal S. [1 ]
Vatsa M. [1 ]
Singh R. [1 ]
机构
[1] Indian Institute of Technology Jodhpur, Jodhpur
[2] Indraprastha Institute of Information Technology Delhi, New Delhi
来源
关键词
Artifacts; compression; deepfake;
D O I
10.1109/TAI.2023.3299894
中图分类号
学科分类号
摘要
The proliferation of manipulated media over the Internet has become a major source of concern in recent times. With the wide variety of techniques being used to create fake media, it has become increasingly difficult to identify such occurrences. While existing algorithms perform well on the detection of such media, limited algorithms take the impact of compression into account. Different social media platforms use different compression factors and algorithms before sharing such images and videos, which amplifies the issues in their identification. Therefore, it has become imperative that fake media detection algorithms work well for data compressed at different factors. To this end, the focus of this article is detecting low-quality fake videos in the compressed domain. The proposed algorithm distinguishes real images and videos from altered ones by using a learned visibility matrix, which enforces the model to see unseen imperceptible artifacts in the data. As a result, the learned model is robust to loss of information due to data compression. The performance is evaluated on three publicly available datasets, namely Celeb-DF, FaceForensics, and FaceForensics++, with three manipulation techniques, viz., Deepfakes, Face2Face, and FaceSwap. Experimental results show that the proposed approach is robust under different compression factors and yields state-of-the-art performance on the FaceForensics++ and Celeb-DF datasets with 97.14% classification accuracy and 74.45% area under the curve, respectively. © 2020 IEEE.
引用
收藏
页码:1573 / 1585
页数:12
相关论文
共 50 条
  • [31] Pedestrian detection with super-resolution reconstruction for low-quality image
    Jin, Yi
    Zhang, Yue
    Cen, Yigang
    Li, Yidong
    Mladenovic, Vladimir
    Voronin, Viacheslav
    PATTERN RECOGNITION, 2021, 115
  • [32] Automatic Detection of Low-Quality Seismocardiogram Cycles Using the Outlier Approach
    Zakeri, V.
    Khosrow-Khavar, F.
    Tavakolian, K.
    WORLD CONGRESS ON MEDICAL PHYSICS AND BIOMEDICAL ENGINEERING, 2015, VOLS 1 AND 2, 2015, 51 : 1014 - 1017
  • [33] Online Detection of Low-Quality Synchrophasor Data Considering Frequency Similarity
    Ju, Wenyun
    Silva-Saravia, Horacio
    Nayak, Neeraj
    Yao, Wenxuan
    Zhang, Yichen
    Shi, Qingxin
    Ye, Fan
    IEEE TRANSACTIONS ON POWER DELIVERY, 2021, 36 (06) : 3988 - 3991
  • [34] Online Detection of Events With Low-Quality Synchrophasor Measurements Based on iForest
    Wu, Tong
    Angela Zhang, Ying-Jun
    Tang, Xiaoying
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (01) : 168 - 178
  • [35] TLC-smartphone in antibiotics determination and low-quality pharmaceuticals detection
    Gad, Asmaa G.
    Fayez, Yasmin Mohammed
    Kelani, Khadiga M.
    Mahmoud, Amr M.
    RSC ADVANCES, 2021, 11 (31) : 19196 - 19202
  • [36] DETECTION OF A HUMAN HEAD ON A LOW-QUALITY IMAGE AND ITS SOFTWARE IMPLEMENTATION
    Yudin, D.
    Ivanov, A.
    Shchendrygin, M.
    INTERNATIONAL WORKSHOP ON PHOTOGRAMMETRIC AND COMPUTER VISION TECHNIQUES FOR VIDEO SURVEILLANCE, BIOMETRICS AND BIOMEDICINE, 2019, 42-2 (W12): : 237 - 241
  • [37] Low-quality carbs: a mainstay for Americans
    Malochleb, Margaret
    FOOD TECHNOLOGY, 2019, 73 (11) : 10 - 12
  • [38] FINGERPRINT RECOGNITION IN LOW-QUALITY IMAGES
    COETZEE, L
    BOTHA, EC
    PATTERN RECOGNITION, 1993, 26 (10) : 1441 - 1460
  • [39] Identifying low-quality preclinical studies
    Zivin, Justin A.
    STROKE, 2008, 39 (10) : 2697 - 2698
  • [40] The Contagion Effect of Low-Quality Audits
    Francis, Jere R.
    Michas, Paul N.
    ACCOUNTING REVIEW, 2013, 88 (02): : 521 - 552