Comprehensive exploration of diffusion models in image generation: a survey

被引:0
|
作者
Chen, Hang [1 ]
Xiang, Qian [2 ,3 ,4 ]
Hu, Jiaxin [1 ]
Ye, Meilin [1 ]
Yu, Chao [1 ]
Cheng, Hao [1 ]
Zhang, Lei [1 ]
机构
[1] Hubei Polytech Univ, Sch Elect & Elect Informat Engn, Huangshi 435003, Peoples R China
[2] Wuchang Shouyi Univ, Coll Informat Sci & Engn, Wuhan 430064, Peoples R China
[3] Gongqing Inst Sci & Technol, Jiujiang 332020, Peoples R China
[4] Wuhan Nanhua Ind Equipments Engn CO LTD, Wuhan 430200, Peoples R China
基金
中国国家自然科学基金;
关键词
Image generation; Diffusion models; Generative models; Data privacy; Data security; FAKE IMAGES; TEXT; SUPERRESOLUTION;
D O I
10.1007/s10462-025-11110-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The rapid development of deep learning technology has led to the emergence of diffusion models as a promising generative model with diverse applications. These include image generation, audio and video synthesis, molecular design, and text generation. The distinctive generation mechanism and exceptional generation quality of diffusion models have made them a valuable tool in these diverse fields. However, with the extensive deployment of diffusion models in the domain of image generation, concerns pertaining to data privacy, data security, and artistic ethics have emerged with increasing prominence. Given the accelerated pace of development in the field of diffusion models, the majority of extant surveys are deficient in two respects: firstly, they fail to encompass the latest advances in diffusion-based image synthesis; and secondly, they seldom consider the potential social implications of diffusion models. In order to address these issues, this paper presents a comprehensive survey of the most recent applications of diffusion models in the field of image generation. Furthermore, it provides an in-depth analysis of the potential social impacts that may result from their use. Firstly, this paper presents a systematic survey of the background principles and theoretical foundations of diffusion models. Subsequently, this paper provides a detailed examination of the most recent applications of diffusion models across a range of image generation subfields, including style transfer, image completion, image editing, super-resolution, and beyond. Finally, we present a comprehensive examination of these social issues, addressing data privacy concerns, such as the potential for data leakage and the implementation of protective measures during model training. We also analyse the risk of malicious exploitation of the model and the defensive strategies employed to mitigate such risks. Additionally, we examine the implications of the authenticity and originality of generated images on artistic creativity and copyright protection.
引用
收藏
页数:49
相关论文
共 50 条
  • [21] EmoGen: Emotional Image Content Generation with Text-to-Image Diffusion Models
    Yang, Jingyuan
    Feng, Jiawei
    Huang, Hui
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 6358 - 6368
  • [22] Diffusion Models for Non-autoregressive Text Generation: A Survey
    Li, Yifan
    Zhou, Kun
    Zhao, Wayne Xin
    Wen, Ji-Rong
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 6692 - 6701
  • [23] Denoising Diffusion Adversarial Models for Unconditional Medical Image Generation
    Dalmaz, Onat
    Saglam, Baturay
    Elmas, Gokberk
    Mirza, Muhammad
    Cukur, Tolga
    2023 31ST SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, SIU, 2023,
  • [24] Intelligent layout generation based on deep generative models: A comprehensive survey
    Shi, Yong
    Shang, Mengyu
    Qi, Zhiquan
    INFORMATION FUSION, 2023, 100
  • [25] Adversarial attacks and defenses on text-to-image diffusion models: A survey
    Zhang, Chenyu
    Hu, Mingwang
    Li, Wenhui
    Wang, Lanjun
    INFORMATION FUSION, 2025, 114
  • [26] Exploring Image Transformations with Diffusion Models: A Survey of Applications and Implementation Code
    Arellano, Silvia
    Otero, Beatriz
    Tous, Ruben
    MACHINE LEARNING, OPTIMIZATION, AND DATA SCIENCE, LOD 2023, PT II, 2024, 14506 : 19 - 33
  • [27] Anti-aliasing in image based shadow generation techniques: a comprehensive survey
    Kolivand, Hoshang
    Sunar, Mohd Shahrizal
    MULTIMEDIA TOOLS AND APPLICATIONS, 2015, 74 (18) : 7461 - 7487
  • [28] Anti-aliasing in image based shadow generation techniques: a comprehensive survey
    Hoshang Kolivand
    Mohd Shahrizal Sunar
    Multimedia Tools and Applications, 2015, 74 : 7461 - 7487
  • [29] MAM-E: Mammographic Synthetic Image Generation with Diffusion Models
    Montoya-del-Angel, Ricardo
    Sam-Millan, Karla
    Vilanova, Joan C.
    Marti, Robert
    SENSORS, 2024, 24 (07)
  • [30] Med-cDiff: Conditional Medical Image Generation with Diffusion Models
    Hung, Alex Ling Yu
    Zhao, Kai
    Zheng, Haoxin
    Yan, Ran
    Raman, Steven S.
    Terzopoulos, Demetri
    Sung, Kyunghyun
    BIOENGINEERING-BASEL, 2023, 10 (11):