Detection of AI-Created Images Using Pixel-Wise Feature Extraction and Convolutional Neural Networks

被引:0
|
作者
Martin-Rodriguez, Fernando [1 ]
Garcia-Mojon, Rocio [1 ]
Fernandez-Barciela, Monica [1 ]
机构
[1] Univ Vigo, AtlanTTic Res Ctr Telecommun Technol, Vigo 36310, Spain
关键词
artificial intelligence; AI images; photographs; PRNU; ELA; CCN; deep learning; IDENTIFICATION; DEEPFAKE;
D O I
10.3390/s23229037
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Generative AI has gained enormous interest nowadays due to new applications like ChatGPT, DALL E, Stable Diffusion, and Deepfake. In particular, DALL E, Stable Diffusion, and others (Adobe Firefly, ImagineArt, etc.) can create images from a text prompt and are even able to create photorealistic images. Due to this fact, intense research has been performed to create new image forensics applications able to distinguish between real captured images and videos and artificial ones. Detecting forgeries made with Deepfake is one of the most researched issues. This paper is about another kind of forgery detection. The purpose of this research is to detect photorealistic AI-created images versus real photos coming from a physical camera. Id est, making a binary decision over an image, asking whether it is artificially or naturally created. Artificial images do not need to try to represent any real object, person, or place. For this purpose, techniques that perform a pixel-level feature extraction are used. The first one is Photo Response Non-Uniformity (PRNU). PRNU is a special noise due to imperfections on the camera sensor that is used for source camera identification. The underlying idea is that AI images will have a different PRNU pattern. The second one is error level analysis (ELA). This is another type of feature extraction traditionally used for detecting image editing. ELA is being used nowadays by photographers for the manual detection of AI-created images. Both kinds of features are used to train convolutional neural networks to differentiate between AI images and real photographs. Good results are obtained, achieving accuracy rates of over 95%. Both extraction methods are carefully assessed by computing precision/recall and F1-score measurements.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Convolutional Neural Network for Pixel-Wise Skyline Detection
    Frajberg, Darian
    Fraternali, Piero
    Torres, Rocio Nahime
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, PT II, 2017, 10614 : 12 - 20
  • [2] Pixel-wise Binarization of Musical Documents with Convolutional Neural Networks
    Calvo-Zaragoza, Jorge
    Vigliensoni, Gabriel
    Fujinaga, Ichiro
    PROCEEDINGS OF THE FIFTEENTH IAPR INTERNATIONAL CONFERENCE ON MACHINE VISION APPLICATIONS - MVA2017, 2017, : 362 - 365
  • [3] Pixel-wise confidence estimation for segmentation in Bayesian Convolutional Neural Networks
    Rémi Martin
    Luc Duong
    Machine Vision and Applications, 2023, 34
  • [4] Pixel-wise confidence estimation for segmentation in Bayesian Convolutional Neural Networks
    Martin, Remi
    Duong, Luc
    MACHINE VISION AND APPLICATIONS, 2023, 34 (01)
  • [5] A pixel-wise framework based on convolutional neural network for surface defect detection
    Dong, Guozhen
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2022, 19 (09) : 8786 - 8803
  • [6] Convolutional encoder-decoder networks for pixel-wise ear detection and segmentation
    Emersic, Ziga
    Gabriel, Luka L.
    Struc, Vitomir
    Peer, Peter
    IET BIOMETRICS, 2018, 7 (03) : 175 - 184
  • [7] Pixel-Wise Classification of Hyperspectral Images With 1D Convolutional SVM Networks
    Shafaey, Mayar A.
    Melgani, Farid
    Salem, Mohammed A. -M.
    Al-Berry, Maryam N.
    Ebied, Hala M.
    El-Dahshan, El-Sayed A.
    Tolba, Mohamed F.
    IEEE ACCESS, 2022, 10 : 133174 - 133185
  • [8] Pixel-Wise Classification of Hyperspectral Images With 1D Convolutional SVM Networks
    Shafaey, Mayar A.
    Melgani, Farid
    Salem, Mohammed A.-M.
    Al-Berry, Maryam N.
    Ebied, Hala M.
    El-Dahshan, El-Sayed A.
    Tolba, Mohamed F.
    IEEE Access, 2022, 10 : 133174 - 133185
  • [9] Lightweight pixel-wise segmentation for efficient concrete crack detection using hierarchical convolutional neural network
    Kim, Jin
    Shim, Seungbo
    Cha, Yohan
    Cho, Gye-Chun
    SMART MATERIALS AND STRUCTURES, 2021, 30 (04)
  • [10] Pixel-Wise Classification of High-Resolution Ground-Based Urban Hyperspectral Images with Convolutional Neural Networks
    Qamar, Farid
    Dobler, Gregory
    REMOTE SENSING, 2020, 12 (16)