DAWN: Direction-aware Attention Wavelet Network for Image Deraining

被引:13
|
作者
Jiang, Kui [1 ]
Liu, Wenxuan [2 ]
Wang, Zheng [3 ]
Zhong, Xian [2 ]
Jiang, Junjun [1 ]
Lin, Chia-Wen [4 ]
机构
[1] Harbin Inst Technol, Harbin, Peoples R China
[2] Wuhan Univ Technol, Wuhan, Peoples R China
[3] Wuhan Univ, Wuhan, Peoples R China
[4] Natl Tsing Hua Univ, Hsinchu, Taiwan
基金
中国国家自然科学基金;
关键词
Image Deraining; Direction attention; Wavelet decomposition; QUALITY ASSESSMENT; RAIN REMOVAL; DECOMPOSITION;
D O I
10.1145/3581783.3611697
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Single image deraining aims to remove rain perturbation while restoring the clean background scene from a rain image. However, existing methods tend to produce blurry and over-smooth outputs, lacking some textural details. Wavelet transform can depict the contextual and textural information of an image at different levels, showing impressive capability of learning structural information in the images to avoid artifacts, and thus has been recently explored to consider the inherent overlap of background and rain perturbation in both the pixel domain and the frequency embedding space. However, the existing wavelet-based methods ignore the heterogeneous degradation for different coefficients due to the inherent directional characteristics of rain streaks, leading to inter-frequency conflicts and compromised deraining results. To address this issue, we propose a novel Direction-aware Attention Wavelet Network (DAWN) for rain streaks removal. DAWN has several key distinctions from existing wavelet transform-based methods: 1) introducing the vector decomposition to parameterize the learning procedure, where the rain streaks are derived into the vertical (V) and horizontal (H) components to learn the specific representation; 2) a novel direction-aware attention module (DAM) to fit the projection and transformation parameters to characterize the direction-specific rain components, which helps accurate texture restoration; 3) exploring practical composite constraints on the structure, details, and chrominance aspects for high-quality background restoration. Our proposed DAWN delivers significant performance gains on nine datasets across image deraining and object detection tasks, exceeding the state-of-the-art method MPRNet by 0.88 dB in PSNR on the Test1200 dataset with only 35.5% computation cost.
引用
收藏
页码:7065 / 7074
页数:10
相关论文
共 50 条
  • [21] Multispectral attention-based network for single image deraining
    Gao, Weihao
    Zhang, Yongjun
    Jian, Huachun
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (01) : 691 - 701
  • [22] Multi-level wavelet network based on CNN-Transformer hybrid attention for single image deraining
    Bin Liu
    Siyan Fang
    Neural Computing and Applications, 2023, 35 : 22387 - 22404
  • [23] Multispectral attention-based network for single image deraining
    Weihao Gao
    Yongjun Zhang
    Huachun Jian
    Signal, Image and Video Processing, 2024, 18 : 691 - 701
  • [24] Multi-level wavelet network based on CNN-Transformer hybrid attention for single image deraining
    Liu, Bin
    Fang, Siyan
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (30): : 22387 - 22404
  • [25] Complementary Parallel Residual Attention Network for Single Image Deraining
    Gai, Shan
    Yin, Minglei
    Zhi, Yuan
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2025, 44 (02) : 1400 - 1425
  • [26] Direction-aware attention aggregation for single-stage hazy-weather crowd counting
    Kong, Weihang
    Shen, Jienan
    Li, He
    Liu, Jiayu
    Zhang, Junge
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 225
  • [27] DiResNet: Direction-Aware Residual Network for Road Extraction in VHR Remote Sensing Images
    Ding, Lei
    Bruzzone, Lorenzo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (12): : 10243 - 10254
  • [28] Context-detail-aware United Network for Single Image Deraining
    Hsu, Wei-Yen
    Lin, Hsien-Wen
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (05)
  • [29] DWTN: deep wavelet transform network for lightweight single image deraining
    Tao, Wenyin
    Yan, Xuefeng
    Wang, Yongzhen
    Wei, Mingqiang
    ADVANCES IN CONTINUOUS AND DISCRETE MODELS, 2024, 2024 (01):
  • [30] Self-Supervised Monocular Depth Estimation by Direction-aware Cumulative Convolution Network
    Han, Wencheng
    Yin, Junbo
    Shen, Jianbing
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 8579 - 8589