An efficient cybersecurity framework for facial video forensics detection based on multimodal deep learning

被引:0
|
作者
Sedik, Ahmed [1 ]
Faragallah, Osama S. [2 ]
El-sayed, Hala S. [3 ]
El-Banby, Ghada M. [4 ]
El-Samie, Fathi E. Abd [5 ,8 ]
Khalaf, Ashraf A. M. [6 ]
El-Shafai, Walid [5 ,7 ]
机构
[1] Department of the Robots and Intelligent Machines, Faculty of AI, Kafrelsheikh University, Kafr El-Shaikh, Egypt
[2] Department of Information Technology, College of Computers and Information Technology, Taif University, P. O. Box 11099, Taif,21944, Saudi Arabia
[3] Department of Electrical Engineering, Faculty of Engineering, Menoufia University, Shebin El-Kom,32511, Egypt
[4] Department of Industrial Electronics and Control Engineering, Faculty of Electronic Engineering, Menoufia University, Menouf,32952, Egypt
[5] Department of Electronics and Electrical Communications Engineering, Faculty of Electronic Engineering, Menoufia University, Menouf,32952, Egypt
[6] Department of Electronics and Electrical Communications, Faculty of Engineering, Minia University, El Minya, Egypt
[7] Security Engineering Lab, Computer Science Department, Prince Sultan University, Riyadh,11586, Saudi Arabia
[8] Department of Information Technology, College of Computer and Information Sciences, Princess Nourah Bint Abdulrahman University, Riyadh,21974, Saudi Arabia
关键词
Classification results - Classification tasks - Conventional approach - Forensic detection - Internet of Things (IOT) - Recent researches - Security implementations - Video transmissions;
D O I
暂无
中图分类号
学科分类号
摘要
In cloud services and Internet-of-Things (IoT) applications, the cybersecurity in video transmission technologies has drawn much attention in recent researches due to the rapid growth of cyber-risks on both individuals and institutions. Unfortunately, the spoofing attack, a kind of cyber-risk, has increased the number of cyber-criminals in data transfer applications without being detected, especially in smart cities. Several applications based on online video communications, such as online testing and video conferences, are involved in smart cities. The video displays various variations of a person, which makes face recognition an important concept in security implementation. The face spoofing attacks are mainly based on the person's face replication by replaying a video or by printed photos. Therefore, video forgery detection and related spoof attack detection have become a new topic in cybersecurity research. From this perspective, this paper presents a deep learning approach for video face forensic detection with a cyber facial spoofing attack using two methodologies. The first methodology is based on a convolutional neural network (CNN) to extract features from the input video frames. The model has five convolutional layers followed by five pooling layers. The second methodology is based on convolutional long short-term memory (ConvLSTM). This model comprises two pooling layers, two convolutional layers, and a convolutional LSTM layer. Each methodology includes a fully-connected layer to interconnect between the feature map resulting from the feature extraction process and the classification layer. A SoftMax layer performs the classification task in each method. This paper aims to achieve an optimum modality for face forensic detection to overcome spoofing attacks. Simulation results reveal that the ConvLSTM with CNN methodology achieves better classification results as the extracted features are more comprehensive than those of other conventional approaches. Also, it achieves an accuracy of 99%, and the works presented in the literature achieve an accuracy levels up to 95%. © 2021, The Author(s), under exclusive licence to Springer-Verlag London Ltd., part of Springer Nature.
引用
收藏
页码:1251 / 1268
相关论文
共 50 条
  • [21] DEEP LEARNING FOR MULTIMODAL-BASED VIDEO INTERESTINGNESS PREDICTION
    Shen, Yuesong
    Demarty, Claire-Helene
    Duong, Ngoc Q. K.
    2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2017, : 1003 - 1008
  • [22] Special issue on Deep Learning in Image and Video Forensics
    Caldelli, Roberto
    Chaumont, Marc
    Li, Chang-Tsun
    Amerini, Irene
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2019, 75 : 199 - 200
  • [23] An Efficient Deep Learning Framework for Distracted Driver Detection
    Sajid, Faiqa
    Javed, Abdul Rehman
    Basharat, Asma
    Kryvinska, Natalia
    Afzal, Adil
    Rizwan, Muhammad
    IEEE ACCESS, 2021, 9 : 169270 - 169280
  • [24] An Efficient Deep Learning Framework for Distracted Driver Detection
    Sajid, Faiqa
    Javed, Abdul Rehman
    Basharat, Asma
    Kryvinska, Natalia
    Afzal, Adil
    Rizwan, Muhammad
    IEEE Access, 2021, 9 : 169270 - 169280
  • [25] Lightweight Attention Based Deep CNN Framework for Human Facial Emotion Detection from Video Sequences
    Krishna Kant
    Dipti B. Shah
    SN Computer Science, 6 (1)
  • [26] Hybrid deep-learning framework for object-based forgery detection in video
    Tan, Shunquan
    Chen, Baoying
    Zeng, Jishen
    Li, Bin
    Huang, Jiwu
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2022, 105
  • [27] Deep Learning Based Optimal Multimodal Fusion Framework for Intrusion Detection Systems for Healthcare Data
    Phong Thanh Nguyen
    Vy Dang Bich Huynh
    Khoa Dang Vo
    Phuong Thanh Phan
    Elhoseny, Mohamed
    Dac-Nhuong Le
    CMC-COMPUTERS MATERIALS & CONTINUA, 2021, 66 (03): : 2555 - 2571
  • [28] A multimodal facial cues based engagement detection system in e-learning context using deep learning approach
    Gupta, Swadha
    Kumar, Parteek
    Tekchandani, Rajkumar
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (18) : 28589 - 28615
  • [29] A multimodal facial cues based engagement detection system in e-learning context using deep learning approach
    Swadha Gupta
    Parteek Kumar
    Rajkumar Tekchandani
    Multimedia Tools and Applications, 2023, 82 : 28589 - 28615
  • [30] A unified multimodal classification framework based on deep metric learning
    Peng, Liwen
    Jian, Songlei
    Li, Minne
    Kan, Zhigang
    Qiao, Linbo
    Li, Dongsheng
    NEURAL NETWORKS, 2025, 181