Multi-Stream Fusion Network With Generalized Smooth L1 Loss for Single Image Dehazing

被引:21
|
作者
Zhu, Xinshan [1 ,2 ]
Li, Shuoshi [1 ]
Gan, Yongdong [1 ]
Zhang, Yun [1 ]
Sun, Biao [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] State Key Lab Digital Publishing Technol, Beijing 100871, Peoples R China
基金
中国国家自然科学基金;
关键词
Image dehazing; convolutional neural networks; feature fusion; loss function; supervision learning; VISIBILITY; FRAMEWORK; WEATHER; VISION;
D O I
10.1109/TIP.2021.3108022
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Single image dehazing is an important but challenging computer vision problem. For the problem, an end-toend convolutional neural network, named multi-stream fusion network (MSFNet), is proposed in this paper. MSFNet is built following the encoder-decoder network structure. The encoder is a three-stream network to produce features at three resolution levels. Residual dense blocks (RDBs) are used for feature extraction. The resizing blocks serve as bridges to connect different streams. The features from different streams are fused in a full connection manner by a feature fusion block, with stream- wise and channel-wise attention mechanisms. The decoder directly regresses the dehazed image from coarse to fine by the use of RDBs and the skip connections. To train the network, we design a generalized smooth L-1 loss function, which is a parametric loss family and permits to adjust the insensitivity to the outliers by varying the parameter settings. Moreover, to guide MSFNet to capture the valid features in each stream, we propose the multi-scale supervision learning strategy, where the loss at each resolution level is computed and summed as the final loss. Extensive experimental results demonstrate that the proposed MSFNet achieves superior performance on both synthetic and real-world images, as compared with the state-of-the-art single image dehazing methods.
引用
收藏
页码:7620 / 7635
页数:16
相关论文
共 50 条
  • [31] RGB-D Saliency Detection by Multi-stream Late Fusion Network
    Chen, Hao
    Li, Youfu
    Su, Dan
    COMPUTER VISION SYSTEMS, ICVS 2017, 2017, 10528 : 459 - 468
  • [32] Multi-scale depth information fusion network for image dehazing
    Guodong Fan
    Zhen Hua
    Jinjiang Li
    Applied Intelligence, 2021, 51 : 7262 - 7280
  • [33] Multi-Stream Threshold Shrinkage and Fusion Network for Product Surface Defect Detection
    Geng, Yubiao
    Yue, Zhiyuan
    Yan, Qiming
    Sun, Yubao
    Computer Engineering and Applications, 2023, 59 (10) : 162 - 170
  • [34] A Novel Diminish Smooth L1 Loss Model with Generative Adversarial Network
    Sutanto, Arief Rachman
    Kang, Dae-Ki
    INTELLIGENT HUMAN COMPUTER INTERACTION, PT I, 2021, 12615 : 361 - 368
  • [35] Multi-scale depth information fusion network for image dehazing
    Fan, Guodong
    Hua, Zhen
    Li, Jinjiang
    APPLIED INTELLIGENCE, 2021, 51 (10) : 7262 - 7280
  • [36] MSNet: A Multi-Stream Fusion Network for Remote Sensing Spatiotemporal Fusion Based on Transformer and Convolution
    Li, Weisheng
    Cao, Dongwen
    Peng, Yidong
    Yang, Chao
    REMOTE SENSING, 2021, 13 (18)
  • [37] Content Feature and Style Feature Fusion Network for Single Image Dehazing
    Yang A.-P.
    Liu J.
    Xing J.-N.
    Li X.-X.
    He Y.-Q.
    Zidonghua Xuebao/Acta Automatica Sinica, 2023, 49 (04): : 769 - 777
  • [38] Deep Multi-Model Fusion for Single-Image Dehazing
    Deng, Zijun
    Zhu, Lei
    Hu, Xiaowei
    Fu, Chi-Wing
    Xu, Xuemiao
    Zhang, Qing
    Qin, Jing
    Heng, Pheng-Ann
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 2453 - 2462
  • [39] Multi-scale Optimal Fusion model for single image dehazing
    Zhao, Dong
    Xu, Long
    Yan, Yihua
    Chen, Jie
    Duan, Ling-Yu
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2019, 74 : 253 - 265
  • [40] Multi-stream and multi-scale fusion rib fracture segmentation network based on UXNet
    Liu, Yusi
    Zhang, Liyuan
    Jiang, Zhengang
    QUANTITATIVE IMAGING IN MEDICINE AND SURGERY, 2025, 15 (01) : 230 - 248