Multi-Stream Fusion Network With Generalized Smooth L1 Loss for Single Image Dehazing

被引:21
|
作者
Zhu, Xinshan [1 ,2 ]
Li, Shuoshi [1 ]
Gan, Yongdong [1 ]
Zhang, Yun [1 ]
Sun, Biao [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] State Key Lab Digital Publishing Technol, Beijing 100871, Peoples R China
基金
中国国家自然科学基金;
关键词
Image dehazing; convolutional neural networks; feature fusion; loss function; supervision learning; VISIBILITY; FRAMEWORK; WEATHER; VISION;
D O I
10.1109/TIP.2021.3108022
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Single image dehazing is an important but challenging computer vision problem. For the problem, an end-toend convolutional neural network, named multi-stream fusion network (MSFNet), is proposed in this paper. MSFNet is built following the encoder-decoder network structure. The encoder is a three-stream network to produce features at three resolution levels. Residual dense blocks (RDBs) are used for feature extraction. The resizing blocks serve as bridges to connect different streams. The features from different streams are fused in a full connection manner by a feature fusion block, with stream- wise and channel-wise attention mechanisms. The decoder directly regresses the dehazed image from coarse to fine by the use of RDBs and the skip connections. To train the network, we design a generalized smooth L-1 loss function, which is a parametric loss family and permits to adjust the insensitivity to the outliers by varying the parameter settings. Moreover, to guide MSFNet to capture the valid features in each stream, we propose the multi-scale supervision learning strategy, where the loss at each resolution level is computed and summed as the final loss. Extensive experimental results demonstrate that the proposed MSFNet achieves superior performance on both synthetic and real-world images, as compared with the state-of-the-art single image dehazing methods.
引用
收藏
页码:7620 / 7635
页数:16
相关论文
共 50 条
  • [1] AMSFF-Net: Attention-Based Multi-Stream Feature Fusion Network for Single Image Dehazing
    Memon, Sanaullah
    Arain, Rafaqat Hussain
    Mallah, Ghulam Ali
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 90
  • [2] Multi-stream feature aggregation network with multi-scale supervision for single image dehazing
    Wu, Junjiang
    Tao, Haibo
    Xiao, Kai
    Chu, Jun
    Leng, Lu
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 139
  • [3] A Multi-Stream Fusion Network for Image Splicing Localization
    Siopi, Maria
    Kordopatis-Zilos, Giorgos
    Charitidis, Polychronis
    Kompatsiaris, Ioannis
    Papadopoulos, Symeon
    MULTIMEDIA MODELING, MMM 2023, PT II, 2023, 13834 : 611 - 622
  • [4] A Novel Multi-Stream Fusion Network for Underwater Image Enhancement
    Tang, Guijin
    Duan, Lian
    Zhao, Haitao
    Liu, Feng
    CHINA COMMUNICATIONS, 2024, 21 (02) : 166 - 182
  • [5] A Novel Multi-Stream Fusion Network for Underwater Image Enhancement
    Guijin Tang
    Lian Duan
    Haitao Zhao
    Feng Liu
    China Communications, 2024, 21 (02) : 166 - 182
  • [6] Multi-Stream Fusion Network for Multi-Distortion Image Super-Resolution
    Wen, Yang
    Xu, Yupeng
    Sheng, Bin
    Li, Ping
    Bi, Lei
    Kim, Jinman
    He, Xiangui
    Xu, Xun
    ADVANCES IN COMPUTER GRAPHICS, CGI 2021, 2021, 13002 : 242 - 251
  • [7] Remote Sensing Image Fusion Based on Generative Adversarial Network with Multi-stream Fusion Architecture
    Lei Dajiang
    Zhang Ce
    Li Zhixing
    Wu Yu
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2020, 42 (08) : 1942 - 1949
  • [8] Remote Sensing Image Fusion Based on Generative Adversarial Network with Multi-stream Fusion Architecture
    Lei D.
    Zhang C.
    Li Z.
    Wu Y.
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2020, 42 (08): : 1942 - 1949
  • [9] Multi-Scale and Multi-Stream Fusion Network for Pansharpening
    Jian, Lihua
    Wu, Shaowu
    Chen, Lihui
    Vivone, Gemine
    Rayhana, Rakiba
    Zhang, Di
    REMOTE SENSING, 2023, 15 (06)
  • [10] Gated Fusion Network for Single Image Dehazing
    Ren, Wenqi
    Ma, Lin
    Zhang, Jiawei
    Pan, Jinshan
    Cao, Xiaochun
    Liu, Wei
    Yang, Ming-Hsuan
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 3253 - 3261