HDR image processing algorithm for portrait based on multi feature fusion

被引:0
|
作者
Wu, Chunlin [1 ]
Zhang, Yongai [1 ,2 ]
Lin, Zhixian [1 ]
Guo, Tailiang [2 ]
Lin, Pengfei [3 ]
Lin, Jianpu [1 ]
机构
[1] Fuzhou Univ, Sch Adv Mfg, Quanzhou 362200, Peoples R China
[2] Fuzhou Univ, Sch Phys & Informat Engn, Fuzhou 350108, Peoples R China
[3] Univ Tokyo, Grad Sch Informat Sci & Technol, Tokyo 1138657, Japan
关键词
deep learning; high dynamic range; skin feature extraction; attention mechanism; color reconstruction;
D O I
10.37188/CJLCD.2023-0255
中图分类号
O7 [晶体学];
学科分类号
0702 ; 070205 ; 0703 ; 080501 ;
摘要
Deep learning based high dynamic range (HDR ) image processing algorithms has the problem of skin color deviation when processing images containing human figures. In response to this issue, this article proposes a portrait HDR image processing algorithm based on multi feature fusion-U(2)HDRnet. This algorithm consists of three parts: skin feature extraction module, trilateral feature extraction module and color reconstruction module. Firstly, the skin feature extraction module separates the color and position information of the skin region. Secondly, the trilateral feature extraction module extracts local features, global features and semantic features of the image, and fuses them with skin features. Finally, the color reconstruction module interpolates the grid in terms of space and color depth. In addition, this article adds an improved fusion module of self attention and convolution to improve the processing performance of HDR. At the same time, this article also produces the PortraitHDR dataset for portraits, filling the gap in the dataset in this field. The test results show that the PSNR of U(2)HDRnet reaches 31. 42 dB, and the SSIM reaches 0. 985, both of which are superior to the commonly used HDR algorithms. They obtain high-quality portrait HDR images while avoiding skin distortion.
引用
收藏
页码:1024 / 1036
页数:13
相关论文
共 24 条
  • [1] SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
    Badrinarayanan, Vijay
    Kendall, Alex
    Cipolla, Roberto
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) : 2481 - 2495
  • [2] Dual Attention Network for Scene Segmentation
    Fu, Jun
    Liu, Jing
    Tian, Haijie
    Li, Yong
    Bao, Yongjun
    Fang, Zhiwei
    Lu, Hanqing
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3141 - 3149
  • [3] Deep Bilateral Learning for Real-Time Image Enhancement
    Gharbi, Michael
    Chen, Jiawen
    Barron, Jonathan T.
    Hasinoff, Samuel W.
    Durand, Fredo
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (04):
  • [4] From Garment to Skin: The visuAAL Skin Segmentation Dataset
    Hashemifard, Kooshan
    Florez-Revuelta, Francisco
    [J]. IMAGE ANALYSIS AND PROCESSING, ICIAP 2022 WORKSHOPS, PT I, 2022, 13373 : 59 - 70
  • [5] Neighborhood Attention Transformer
    Hassani, Ali
    Walton, Steven
    Li, Jiachen
    Li, Shen
    Shi, Humphrey
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 6185 - 6194
  • [6] Huang HM, 2020, INT CONF ACOUST SPEE, P1055, DOI [10.1109/icassp40776.2020.9053405, 10.1109/ICASSP40776.2020.9053405]
  • [7] FHDR: HDR Image Reconstruction from a Single LDR Image using Feedback Network
    Khan, Zeeshan
    Khanna, Mukul
    Raman, Shanmuganathan
    [J]. 2019 7TH IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (IEEE GLOBALSIP), 2019,
  • [8] Fast and Accurate Image Super-Resolution with Deep Laplacian Pyramid Networks
    Lai, Wei-Sheng
    Huang, Jia-Bin
    Ahuja, Narendra
    Yang, Ming-Hsuan
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (11) : 2599 - 2613
  • [9] HSVNet: Reconstructing HDR Image from a Single Exposure LDR Image with CNN
    Lee, Min Jung
    Rhee, Chi-hyoung
    Lee, Chang Ha
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (05):
  • [10] Sky Optimization: Semantically aware image processing of skies in low-light photography
    Liba, Orly
    Cai, Longqi
    Tsai, Yun-Ta
    Eban, Elad
    Movshovitz-Attias, Yair
    Pritch, Yael
    Chen, Huizhong
    Barron, Jonathan T.
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 2230 - 2238