Comprehensive exploration of diffusion models in image generation: a survey

被引:0
|
作者
Chen, Hang [1 ]
Xiang, Qian [2 ,3 ,4 ]
Hu, Jiaxin [1 ]
Ye, Meilin [1 ]
Yu, Chao [1 ]
Cheng, Hao [1 ]
Zhang, Lei [1 ]
机构
[1] Hubei Polytech Univ, Sch Elect & Elect Informat Engn, Huangshi 435003, Peoples R China
[2] Wuchang Shouyi Univ, Coll Informat Sci & Engn, Wuhan 430064, Peoples R China
[3] Gongqing Inst Sci & Technol, Jiujiang 332020, Peoples R China
[4] Wuhan Nanhua Ind Equipments Engn CO LTD, Wuhan 430200, Peoples R China
基金
中国国家自然科学基金;
关键词
Image generation; Diffusion models; Generative models; Data privacy; Data security; FAKE IMAGES; TEXT; SUPERRESOLUTION;
D O I
10.1007/s10462-025-11110-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The rapid development of deep learning technology has led to the emergence of diffusion models as a promising generative model with diverse applications. These include image generation, audio and video synthesis, molecular design, and text generation. The distinctive generation mechanism and exceptional generation quality of diffusion models have made them a valuable tool in these diverse fields. However, with the extensive deployment of diffusion models in the domain of image generation, concerns pertaining to data privacy, data security, and artistic ethics have emerged with increasing prominence. Given the accelerated pace of development in the field of diffusion models, the majority of extant surveys are deficient in two respects: firstly, they fail to encompass the latest advances in diffusion-based image synthesis; and secondly, they seldom consider the potential social implications of diffusion models. In order to address these issues, this paper presents a comprehensive survey of the most recent applications of diffusion models in the field of image generation. Furthermore, it provides an in-depth analysis of the potential social impacts that may result from their use. Firstly, this paper presents a systematic survey of the background principles and theoretical foundations of diffusion models. Subsequently, this paper provides a detailed examination of the most recent applications of diffusion models across a range of image generation subfields, including style transfer, image completion, image editing, super-resolution, and beyond. Finally, we present a comprehensive examination of these social issues, addressing data privacy concerns, such as the potential for data leakage and the implementation of protective measures during model training. We also analyse the risk of malicious exploitation of the model and the defensive strategies employed to mitigate such risks. Additionally, we examine the implications of the authenticity and originality of generated images on artistic creativity and copyright protection.
引用
收藏
页数:49
相关论文
共 50 条
  • [1] A Comprehensive Survey of Recent Transformers in Image, Video and Diffusion Models
    Le, Dinh Phu Cuong
    Wang, Dong
    Le, Viet-Tuan
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 80 (01): : 37 - 60
  • [2] A Comprehensive Survey of Image Generation Models Based on Deep Learning
    Li J.
    Zhang C.
    Zhu W.
    Ren Y.
    Annals of Data Science, 2025, 12 (1) : 141 - 170
  • [3] Human Image Generation: A Comprehensive Survey
    Jia, Zhen
    Zhang, Zhang
    Wang, Liang
    Tan, Tieniu
    ACM COMPUTING SURVEYS, 2024, 56 (11)
  • [4] Image captioning by diffusion models: A survey
    Daneshfar, Fatemeh
    Bartani, Ako
    Lotfi, Pardis
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 138
  • [5] Diffusion models in text generation: a survey
    Yi, Qiuhua
    Chen, Xiangfan
    Zhang, Chenwei
    Zhou, Zehai
    Zhu, Linan
    Kong, Xiangjie
    PEERJ COMPUTER SCIENCE, 2024, 10
  • [6] Diffusion Models: A Comprehensive Survey of Methods and Applications
    Yang, Ling
    Zhang, Zhilong
    Song, Yang
    Hong, Shenda
    Xu, Runsheng
    Zhao, Yue
    Zhang, Wentao
    Cui, Bin
    Yang, Ming-Hsuan
    ACM COMPUTING SURVEYS, 2024, 56 (04)
  • [7] Diffusion models in medical imaging: A comprehensive survey
    Kazerouni, Amirhossein
    Aghdam, Ehsan Khodapanah
    Heidari, Moein
    Azad, Reza
    Fayyaz, Mohsen
    Hacihaliloglu, Ilker
    Merhof, Dorit
    MEDICAL IMAGE ANALYSIS, 2023, 88
  • [8] Diffusion Models for Medical Image Computing: A Survey
    Shi, Yaqing
    Abulizi, Abudukelimu
    Wang, Hao
    Feng, Ke
    Abudukelimu, Nihemaiti
    Su, Youli
    Abudukelimu, Halidanmu
    TSINGHUA SCIENCE AND TECHNOLOGY, 2025, 30 (01): : 357 - 383
  • [9] Conditional Text Image Generation with Diffusion Models
    Zhu, Yuanzhi
    Li, Zhaohai
    Wang, Tianwei
    He, Mengchao
    Yao, Cong
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 14235 - 14245
  • [10] A Survey of Generative Models for Image and Video with Diffusion Model
    Koh, Byoung Soo
    Park, Hyeong Cheol
    Park, Jin Ho
    HUMAN-CENTRIC COMPUTING AND INFORMATION SCIENCES, 2024, 14