Multi-Stream Fusion Network With Generalized Smooth L1 Loss for Single Image Dehazing

被引:21
|
作者
Zhu, Xinshan [1 ,2 ]
Li, Shuoshi [1 ]
Gan, Yongdong [1 ]
Zhang, Yun [1 ]
Sun, Biao [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] State Key Lab Digital Publishing Technol, Beijing 100871, Peoples R China
基金
中国国家自然科学基金;
关键词
Image dehazing; convolutional neural networks; feature fusion; loss function; supervision learning; VISIBILITY; FRAMEWORK; WEATHER; VISION;
D O I
10.1109/TIP.2021.3108022
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Single image dehazing is an important but challenging computer vision problem. For the problem, an end-toend convolutional neural network, named multi-stream fusion network (MSFNet), is proposed in this paper. MSFNet is built following the encoder-decoder network structure. The encoder is a three-stream network to produce features at three resolution levels. Residual dense blocks (RDBs) are used for feature extraction. The resizing blocks serve as bridges to connect different streams. The features from different streams are fused in a full connection manner by a feature fusion block, with stream- wise and channel-wise attention mechanisms. The decoder directly regresses the dehazed image from coarse to fine by the use of RDBs and the skip connections. To train the network, we design a generalized smooth L-1 loss function, which is a parametric loss family and permits to adjust the insensitivity to the outliers by varying the parameter settings. Moreover, to guide MSFNet to capture the valid features in each stream, we propose the multi-scale supervision learning strategy, where the loss at each resolution level is computed and summed as the final loss. Extensive experimental results demonstrate that the proposed MSFNet achieves superior performance on both synthetic and real-world images, as compared with the state-of-the-art single image dehazing methods.
引用
收藏
页码:7620 / 7635
页数:16
相关论文
共 50 条
  • [21] Multi-scale feature fusion pyramid attention network for single image dehazing
    Liu, Jianlei
    Liu, Peng
    Zhang, Yuanke
    IET IMAGE PROCESSING, 2023, 17 (09) : 2726 - 2735
  • [22] Multi-scale recurrent attention gated fusion network for single image dehazing
    Zhang, Xiangfen
    Yang, Shuo
    Zhang, Qingyi
    Yuan, Feiniu
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 101
  • [23] Joint strong edge and multi-stream adaptive fusion network for non-uniform image deblurring
    Li, Zihan
    Cui, Guangmang
    Zhao, Jufeng
    Xiang, Qinlei
    He, Bintao
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2022, 89
  • [24] Multi-stream fusion network for continuous gesture recognition based on sEMG
    Li J.
    Zou C.
    Tang D.
    Sun Y.
    Fan H.
    Li B.
    Tang X.
    International Journal of Wireless and Mobile Computing, 2024, 26 (04): : 374 - 383
  • [25] Towards interpretable sleep stage classification with a multi-stream fusion network
    Jingrui Chen
    Xiaomao Fan
    Ruiquan Ge
    Jing Xiao
    Ruxin Wang
    Wenjun Ma
    Ye Li
    BMC Medical Informatics and Decision Making, 25 (1)
  • [26] GLOBAL FEATURE FUSION ATTENTION NETWORK FOR SINGLE IMAGE DEHAZING
    Luo, Jie
    Bu, Qirong
    Zhang, Lei
    Feng, Jun
    2021 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2021,
  • [27] Multi-focus image fusion based on L1 image transform
    Shuang Yu
    Xiongfei Li
    Mingrui Ma
    Xiaoli Zhang
    Shiping Chen
    Multimedia Tools and Applications, 2021, 80 : 5673 - 5700
  • [28] Multi-focus image fusion based on L1 image transform
    Yu, Shuang
    Li, Xiongfei
    Ma, Mingrui
    Zhang, Xiaoli
    Chen, Shiping
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (04) : 5673 - 5700
  • [29] SegAN: Adversarial Network with Multi-scale L1 Loss for Medical Image Segmentation
    Yuan Xue
    Tao Xu
    Han Zhang
    L. Rodney Long
    Xiaolei Huang
    Neuroinformatics, 2018, 16 : 383 - 392
  • [30] Density-aware Single Image De-raining using a Multi-stream Dense Network
    Zhang, He
    Patel, Vishal M.
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 695 - 704