Style Transfer of Urban Road Images Using Generative Adversarial Networks With Structural Details

被引:2
|
作者
Li, Yaochen [1 ]
Wu, Xiao [2 ]
Lu, Danhui [2 ]
Li, Ling [2 ]
Liu, Yuehu [3 ]
Zhu, Li [2 ]
机构
[1] Xi An Jiao Tong Univ, Sch Software Engn, Xian, Peoples R China
[2] Xi An Jiao Tong Univ, Software Engn, Xian, Peoples R China
[3] Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot, Xian, Peoples R China
基金
中国国家自然科学基金;
关键词
Semantics; Image segmentation; Generators; Roads; Unmanned vehicles; Training data; Image reconstruction;
D O I
10.1109/MMUL.2020.3003945
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
To evaluate the driving behavior of unmanned vehicles, the testing of driving algorithms using urban road images is necessary. In this article, we propose a framework using generative adversarial networks (GANs) with structural information for image style transfer: StructureGAN and GradientGAN. Different types of urban image transfers are generated using the proposed framework, such as day to night, sunny to foggy, and summer to winter transfers. The proposed method can well maintain the integrity of foreground objects and the image structural information. Artifacts such as image distortion and foreground disappearance are eliminated. The experiments with the baseline methods indicate the effectiveness of the proposed framework, which can produce transferred images with high quality.
引用
收藏
页码:54 / 65
页数:12
相关论文
共 50 条
  • [1] Image Style Transfer with Generative Adversarial Networks
    Li, Ru
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 2950 - 2954
  • [2] Semantic Segmentation of Agricultural Images Based on Style Transfer Using Conditional and Unconditional Generative Adversarial Networks
    Madokoro, Hirokazu
    Takahashi, Kota
    Yamamoto, Satoshi
    Nix, Stephanie
    Chiyonobu, Shun
    Saruta, Kazuki
    Saito, Takashi K.
    Nishimura, Yo
    Sato, Kazuhito
    APPLIED SCIENCES-BASEL, 2022, 12 (15):
  • [3] Generative Adversarial Style Transfer Networks for Face Aging
    Palsson, Sveinn
    Agustsson, Eirikur
    Timofte, Radu
    Van Gool, Luc
    PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 2165 - 2173
  • [4] TACHIEGAN: GENERATIVE ADVERSARIAL NETWORKS FOR TACHIE STYLE TRANSFER
    Chen, Zihan
    Chen, Xuejin
    2022 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (IEEE ICMEW 2022), 2022,
  • [5] Road Extraction with UAV Images Based on Generative Adversarial Networks
    He L.
    Li Y.-X.
    Peng B.
    Wu H.-P.
    Dianzi Keji Daxue Xuebao/Journal of the University of Electronic Science and Technology of China, 2019, 48 (04): : 580 - 585
  • [6] PDEGAN: A Panoramic Style Transfer Based on Generative Adversarial Networks
    Wang, Qinghua
    Long, Xinling
    Huang, Jingwei
    Chen, Yang
    Yang, Lirong
    Zhang, Fuquan
    Journal of Network Intelligence, 2024, 9 (04): : 2112 - 2121
  • [7] MSGAN: Generative Adversarial Networks for Image Seasonal Style Transfer
    Zhang, Fuquan
    Wang, Chuansheng
    IEEE ACCESS, 2020, 8 : 104830 - 104840
  • [8] Digital ray: enhancing cataractous fundus images using style transfer generative adversarial networks to improve retinopathy detection
    Liu, Lixue
    Hong, Jiaming
    Wu, Yuxuan
    Liu, Shaopeng
    Wang, Kai
    Li, Mingyuan
    Zhao, Lanqin
    Liu, Zhenzhen
    Li, Longhui
    Cui, Tingxin
    Tsui, Ching-Kit
    Xu, Fabao
    Hu, Weiling
    Yun, Dongyuan
    Chen, Xi
    Shang, Yuanjun
    Bi, Shaowei
    Wei, Xiaoyue
    Lai, Yunxi
    Lin, Duoru
    Fu, Zhe
    Deng, Yaru
    Cai, Kaimin
    Xie, Yi
    Cao, Zizheng
    Wang, Dongni
    Zhang, Xulin
    Dongye, Meimei
    Lin, Haotian
    Wu, Xiaohang
    BRITISH JOURNAL OF OPHTHALMOLOGY, 2024, 108 (10) : 1423 - 1429
  • [9] Style Transfer Using Generative Adversarial Networks for Multi-site MRI Harmonization
    Liu, Mengting
    Maiti, Piyush
    Thomopoulos, Sophia
    Zhu, Alyssa
    Chai, Yaqiong
    Kim, Hosung
    Jahanshad, Neda
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT III, 2021, 12903 : 313 - 322
  • [10] Road Detection From Remote Sensing Images by Generative Adversarial Networks
    Shi, Qian
    Liu, Xiaoping
    Li, Xia
    IEEE ACCESS, 2018, 6 : 25486 - 25494