Exposing Deepfake Videos by Tracking Eye Movements

被引:13
|
作者
Li, Meng [1 ]
Liu, Beibei [1 ]
Hu, Yongjian [1 ,2 ]
Wang, Yufei [2 ]
机构
[1] South China Univ Technol, Sch Elect & Informat Engn, Guangzhou, Peoples R China
[2] Sino Singapore Int Joint Res Inst, Guangzhou, Guangdong, Peoples R China
关键词
D O I
10.1109/ICPR48806.2021.9413139
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
It has recently become a major threat to the public media that fake videos are rapidly spreading over the Internet. The advent of Deepfake, a deep-learning based toolkit, has facilitated a massive abuse of improper synthesized videos, which may influence the media credibility and human rights. A worldwide alert has been set off that finding ways to detect such fake videos is not only crucial but also urgent. This paper reports a novel approach to expose deepfake videos. We found that most fake videos are markedly different from the real ones in the way the eyes move. We are thus motivated to define four features that could well capture such differences. The features are then fed to SVM for classification. It is shown to be a promising approach that without high dimensional features and complicated neural networks, we are able to achieve competitive results on several public datasets. Moreover, the proposed features could well participate with other existing methods in the confrontation with deepfakes.
引用
收藏
页码:5184 / 5189
页数:6
相关论文
共 50 条
  • [41] Exposing Vulnerabilities of Deepfake Detection Systems with Robust Attacks
    Hussain, Shehzeen
    Neekhara, Paarth
    Dolhansky, Brian
    Bitton, Joanna
    Ferrer, Cristian Canton
    McAuley, Julian
    Koushanfar, Farinaz
    DIGITAL THREATS: RESEARCH AND PRACTICE, 2022, 3 (03):
  • [42] INFLUENCES OF HAND MOVEMENTS ON EYE-MOVEMENTS IN TRACKING TASKS IN MAN
    KOKEN, PW
    ERKELENS, CJ
    EXPERIMENTAL BRAIN RESEARCH, 1992, 88 (03) : 657 - 664
  • [43] Comparing eye movements recorded by search coil and infrared eye tracking
    Schmitt K.-U.
    Muser M.H.
    Lanz C.
    Walz F.
    Schwarz U.
    Journal of Clinical Monitoring and Computing, 2007, 21 (1) : 49 - 53
  • [44] Eye tracking study in children to assess mental calculation and eye movements
    Porras, Malena Manchado
    Knoop-van Campen, Carolien A. N.
    Gonzalez-Rosa, Javier J.
    Sanchez-Fernandez, Francisco L.
    Guzman, Jose I. Navarro
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [45] MYFix: Automated Fixation Annotation of Eye-Tracking Videos
    Alinaghi, Negar
    Hollendonner, Samuel
    Giannopoulos, Ioannis
    SENSORS, 2024, 24 (09)
  • [46] Observing Pictures and Videos of Creative Products: An Eye Tracking Study
    Berni, Aurora
    Maccioni, Lorenzo
    Borgianni, Yuri
    APPLIED SCIENCES-BASEL, 2020, 10 (04):
  • [47] Audio tracks do not influence eye movements when watching videos
    Coutrot, A.
    Ionescu, G.
    Guyader, N.
    Rivet, B.
    PERCEPTION, 2011, 40 : 137 - 137
  • [48] Effects of gaze-contingent stimulation on eye movements with natural videos
    Dorr, M
    Martinetz, T
    Gegenfurtner, KR
    Barth, E
    PERCEPTION, 2004, 33 : 134 - 134
  • [49] Cascaded-Hop For DeepFake Videos Detection
    Zhang, Dengyong
    Wu, Pengjie
    Li, Feng
    Zhu, Wenjie
    Sheng, Victor S.
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2022, 16 (05): : 1671 - 1686
  • [50] DeepFake Videos Detection Based on Texture Features
    Xu, Bozhi
    Liu, Jiarui
    Liang, Jifan
    Lu, Wei
    Zhang, Yue
    CMC-COMPUTERS MATERIALS & CONTINUA, 2021, 68 (01): : 1375 - 1388