Detection of AI-Created Images Using Pixel-Wise Feature Extraction and Convolutional Neural Networks

被引:0
|
作者
Martin-Rodriguez, Fernando [1 ]
Garcia-Mojon, Rocio [1 ]
Fernandez-Barciela, Monica [1 ]
机构
[1] Univ Vigo, AtlanTTic Res Ctr Telecommun Technol, Vigo 36310, Spain
关键词
artificial intelligence; AI images; photographs; PRNU; ELA; CCN; deep learning; IDENTIFICATION; DEEPFAKE;
D O I
10.3390/s23229037
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Generative AI has gained enormous interest nowadays due to new applications like ChatGPT, DALL E, Stable Diffusion, and Deepfake. In particular, DALL E, Stable Diffusion, and others (Adobe Firefly, ImagineArt, etc.) can create images from a text prompt and are even able to create photorealistic images. Due to this fact, intense research has been performed to create new image forensics applications able to distinguish between real captured images and videos and artificial ones. Detecting forgeries made with Deepfake is one of the most researched issues. This paper is about another kind of forgery detection. The purpose of this research is to detect photorealistic AI-created images versus real photos coming from a physical camera. Id est, making a binary decision over an image, asking whether it is artificially or naturally created. Artificial images do not need to try to represent any real object, person, or place. For this purpose, techniques that perform a pixel-level feature extraction are used. The first one is Photo Response Non-Uniformity (PRNU). PRNU is a special noise due to imperfections on the camera sensor that is used for source camera identification. The underlying idea is that AI images will have a different PRNU pattern. The second one is error level analysis (ELA). This is another type of feature extraction traditionally used for detecting image editing. ELA is being used nowadays by photographers for the manual detection of AI-created images. Both kinds of features are used to train convolutional neural networks to differentiate between AI images and real photographs. Good results are obtained, achieving accuracy rates of over 95%. Both extraction methods are carefully assessed by computing precision/recall and F1-score measurements.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] A DEEP LEARNING APPROACH TO SPINE SEGMENTATION USING A FEED-FORWARD CHAIN OF PIXEL-WISE CONVOLUTIONAL NETWORKS
    Whitehead, William
    Moran, Steven
    Gaonkar, Bilwaj
    Macyszyn, Luke
    Iyer, Subramanian
    2018 IEEE 15TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2018), 2018, : 868 - 871
  • [32] A novel feature extraction methodology using Siamese convolutional neural networks for intrusion detection
    Moustakidis, Serafeim
    Karlsson, Patrik
    CYBERSECURITY, 2020, 3 (01)
  • [33] A novel feature extraction methodology using Siamese convolutional neural networks for intrusion detection
    Serafeim Moustakidis
    Patrik Karlsson
    Cybersecurity, 3
  • [34] Automatic ear detection and feature extraction using Geometric Morphometrics and convolutional neural networks
    Cintas, Celia
    Quinto-Sanchez, Mirsha
    Acuna, Victor
    Paschetta, Carolina
    de Azevedo, Soledad
    Silva de Cerqueira, Caio Cesar
    Ramallo, Virginia
    Gallo, Carla
    Poletti, Giovanni
    Bortolini, Maria Catira
    Canizales-Quinteros, Samuel
    Rothhammer, Francisco
    Bedoya, Gabriel
    Ruiz-Linares, Andres
    Gonzalez-Jose, Rolando
    Delrieux, Claudio
    IET BIOMETRICS, 2017, 6 (03) : 211 - 223
  • [35] Detection of Diabetic Retinopathy using Convolutional Neural Networks for Feature Extraction and Classification (DRFEC)
    Das, Dolly
    Biswas, Saroj Kumar
    Bandyopadhyay, Sivaji
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (19) : 29943 - 30001
  • [36] Detection of Diabetic Retinopathy using Convolutional Neural Networks for Feature Extraction and Classification (DRFEC)
    Dolly Das
    Saroj Kumar Biswas
    Sivaji Bandyopadhyay
    Multimedia Tools and Applications, 2023, 82 : 29943 - 30001
  • [37] A Deep Convolutional Neural Network for Semantic Pixel-Wise Segmentation of Road and Pavement Surface Cracks
    Jenkins, Mark David
    Carr, Thomas Arthur
    Iglesias, Maria Insa
    Buggy, Tom
    Morison, Gordon
    2018 26TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2018, : 2120 - 2124
  • [38] Automated Pixel-Wise Pavement Crack Detection by Classification-Segmentation Networks
    Yu, Bin
    Meng, Xiangcheng
    Yu, Qiannan
    JOURNAL OF TRANSPORTATION ENGINEERING PART B-PAVEMENTS, 2021, 147 (02)
  • [39] Unsupervised Pixel-Wise Hyperspectral Anomaly Detection via Autoencoding Adversarial Networks
    Arisoy, Sertac
    Nasrabadi, Nasser M.
    Kayabol, Koray
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [40] Pixel-Wise Classification Method for High Resolution Remote Sensing Imagery Using Deep Neural Networks
    Guo, Rui
    Liu, Jianbo
    Li, Na
    Liu, Shibin
    Chen, Fu
    Cheng, Bo
    Duan, Jianbo
    Li, Xinpeng
    Ma, Caihong
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2018, 7 (03)