Multi-Stream Fusion Network With Generalized Smooth L1 Loss for Single Image Dehazing

被引:21
|
作者
Zhu, Xinshan [1 ,2 ]
Li, Shuoshi [1 ]
Gan, Yongdong [1 ]
Zhang, Yun [1 ]
Sun, Biao [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] State Key Lab Digital Publishing Technol, Beijing 100871, Peoples R China
基金
中国国家自然科学基金;
关键词
Image dehazing; convolutional neural networks; feature fusion; loss function; supervision learning; VISIBILITY; FRAMEWORK; WEATHER; VISION;
D O I
10.1109/TIP.2021.3108022
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Single image dehazing is an important but challenging computer vision problem. For the problem, an end-toend convolutional neural network, named multi-stream fusion network (MSFNet), is proposed in this paper. MSFNet is built following the encoder-decoder network structure. The encoder is a three-stream network to produce features at three resolution levels. Residual dense blocks (RDBs) are used for feature extraction. The resizing blocks serve as bridges to connect different streams. The features from different streams are fused in a full connection manner by a feature fusion block, with stream- wise and channel-wise attention mechanisms. The decoder directly regresses the dehazed image from coarse to fine by the use of RDBs and the skip connections. To train the network, we design a generalized smooth L-1 loss function, which is a parametric loss family and permits to adjust the insensitivity to the outliers by varying the parameter settings. Moreover, to guide MSFNet to capture the valid features in each stream, we propose the multi-scale supervision learning strategy, where the loss at each resolution level is computed and summed as the final loss. Extensive experimental results demonstrate that the proposed MSFNet achieves superior performance on both synthetic and real-world images, as compared with the state-of-the-art single image dehazing methods.
引用
收藏
页码:7620 / 7635
页数:16
相关论文
共 50 条
  • [41] Omnidirectional Image Quality Assessment by Distortion Discrimination Assisted Multi-Stream Network
    Zhou, Yu
    Sun, Yanjing
    Li, Leida
    Gu, Ke
    Fang, Yuming
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (04) : 1767 - 1777
  • [42] Multi-Stream Dense View Reconstruction Network for Light Field Image Compression
    Liu, Deyang
    Huang, Yan
    Fang, Yuming
    Zuo, Yifan
    An, Ping
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 4400 - 4414
  • [43] Single Fog Image dehazing via fast Multi-scale Image Fusion
    Gao, Yin
    Lan, Xiaodong
    Cai, Rongsheng
    Li, Jun
    IFAC PAPERSONLINE, 2019, 52 (24): : 225 - 230
  • [44] Medical image segmentation based on active fusion-transduction of multi-stream features?
    Shu, Yucheng
    Zhang, Jing
    Xiao, Bin
    Li, Weisheng
    KNOWLEDGE-BASED SYSTEMS, 2021, 220
  • [45] Automated detection for Retinopathy of Prematurity with knowledge distilling from multi-stream fusion network
    Shen, Yingshan
    Luo, Zhitao
    Xu, Muxin
    Liang, Zhihao
    Fan, Xiaomao
    Lu, Xiaohe
    KNOWLEDGE-BASED SYSTEMS, 2023, 269
  • [46] Multi-Stream Fusion Network for Skeleton-Based Construction Worker Action Recognition
    Tian, Yuanyuan
    Liang, Yan
    Yang, Haibin
    Chen, Jiayu
    SENSORS, 2023, 23 (23)
  • [47] Nighttime Image Dehazing Based on Multi-Scale Gated Fusion Network
    Zhao, Bo
    Wu, Han
    Ma, Zhiyang
    Fu, Huini
    Ren, Wenqi
    Liu, Guizhong
    ELECTRONICS, 2022, 11 (22)
  • [48] Multi-scale residual attention network for single image dehazing
    Sheng, Jiechao
    Lv, Guoqiang
    Du, Gang
    Wang, Zi
    Feng, Qibin
    DIGITAL SIGNAL PROCESSING, 2022, 121
  • [49] Lightweight Multi-scale Attentional Network for Single Image Dehazing
    Zong, Ping
    Li, Jinjiang
    Hua, Zhen
    2022 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, COMPUTER VISION AND MACHINE LEARNING (ICICML), 2022, : 401 - 405
  • [50] Single image dehazing based on convolutional neural network and multiple attention fusion
    Ming, Jinyi
    Cai, Zhidan
    Li, Shirong
    Bi, Sikai
    Ning, Yongxin
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (04)