DAWN: Direction-aware Attention Wavelet Network for Image Deraining

被引:13
|
作者
Jiang, Kui [1 ]
Liu, Wenxuan [2 ]
Wang, Zheng [3 ]
Zhong, Xian [2 ]
Jiang, Junjun [1 ]
Lin, Chia-Wen [4 ]
机构
[1] Harbin Inst Technol, Harbin, Peoples R China
[2] Wuhan Univ Technol, Wuhan, Peoples R China
[3] Wuhan Univ, Wuhan, Peoples R China
[4] Natl Tsing Hua Univ, Hsinchu, Taiwan
基金
中国国家自然科学基金;
关键词
Image Deraining; Direction attention; Wavelet decomposition; QUALITY ASSESSMENT; RAIN REMOVAL; DECOMPOSITION;
D O I
10.1145/3581783.3611697
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Single image deraining aims to remove rain perturbation while restoring the clean background scene from a rain image. However, existing methods tend to produce blurry and over-smooth outputs, lacking some textural details. Wavelet transform can depict the contextual and textural information of an image at different levels, showing impressive capability of learning structural information in the images to avoid artifacts, and thus has been recently explored to consider the inherent overlap of background and rain perturbation in both the pixel domain and the frequency embedding space. However, the existing wavelet-based methods ignore the heterogeneous degradation for different coefficients due to the inherent directional characteristics of rain streaks, leading to inter-frequency conflicts and compromised deraining results. To address this issue, we propose a novel Direction-aware Attention Wavelet Network (DAWN) for rain streaks removal. DAWN has several key distinctions from existing wavelet transform-based methods: 1) introducing the vector decomposition to parameterize the learning procedure, where the rain streaks are derived into the vertical (V) and horizontal (H) components to learn the specific representation; 2) a novel direction-aware attention module (DAM) to fit the projection and transformation parameters to characterize the direction-specific rain components, which helps accurate texture restoration; 3) exploring practical composite constraints on the structure, details, and chrominance aspects for high-quality background restoration. Our proposed DAWN delivers significant performance gains on nine datasets across image deraining and object detection tasks, exceeding the state-of-the-art method MPRNet by 0.88 dB in PSNR on the Test1200 dataset with only 35.5% computation cost.
引用
收藏
页码:7065 / 7074
页数:10
相关论文
共 50 条
  • [1] Direction-aware Feature-level Frequency Decomposition for Single Image Deraining
    Deng, Sen
    Feng, Yidan
    Wei, Mingqiang
    Xie, Haoran
    Chen, Yiping
    Li, Jonathan
    Zhang, Xiao-Ping
    Qin, Jing
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 650 - 656
  • [2] Wavelet Approximation-Aware Residual Network for Single Image Deraining
    Hsu, Wei-Yen
    Chang, Wei-Chi
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (12) : 15979 - 15995
  • [3] WAVELET CHANNEL ATTENTION MODULE WITH A FUSION NETWORK FOR SINGLE IMAGE DERAINING
    Yang, Hao-Hsiang
    Yang, Chao-Han Huck
    Wang, Yu-Chiang Frank
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 883 - 887
  • [4] A Lightweight Direction-Aware Network for Vehicle Detection
    Yang, Luxia
    Hou, Yilin
    Zhang, Hongrui
    Zhang, Chuanghui
    IEEE ACCESS, 2025, 13 : 27516 - 27526
  • [5] Wavelet Frequency Division Self-Attention Transformer Image Deraining Network
    Fang, Siyan
    Liu, Bin
    Computer Engineering and Applications, 2024, 60 (06) : 259 - 273
  • [6] Direction-aware feedback network for robust lane detection
    Kim, Jinhee
    Kim, Wonjun
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (15) : 21697 - 21717
  • [7] Selective Wavelet Attention Learning for Single Image Deraining
    Huaibo Huang
    Aijing Yu
    Zhenhua Chai
    Ran He
    Tieniu Tan
    International Journal of Computer Vision, 2021, 129 : 1282 - 1300
  • [8] Direction-aware feedback network for robust lane detection
    Jinhee Kim
    Wonjun Kim
    Multimedia Tools and Applications, 2022, 81 : 21697 - 21717
  • [9] Selective Wavelet Attention Learning for Single Image Deraining
    Huang, Huaibo
    Yu, Aijing
    Chai, Zhenhua
    He, Ran
    Tan, Tieniu
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (04) : 1282 - 1300
  • [10] Direction-aware KNN queries for moving objects in a road network
    Dong Tianyang
    Yuan Lulu
    Cheng Qiang
    Cao Bin
    Fan Jing
    World Wide Web, 2019, 22 : 1765 - 1797