DAWN: Direction-aware Attention Wavelet Network for Image Deraining

被引:13
|
作者
Jiang, Kui [1 ]
Liu, Wenxuan [2 ]
Wang, Zheng [3 ]
Zhong, Xian [2 ]
Jiang, Junjun [1 ]
Lin, Chia-Wen [4 ]
机构
[1] Harbin Inst Technol, Harbin, Peoples R China
[2] Wuhan Univ Technol, Wuhan, Peoples R China
[3] Wuhan Univ, Wuhan, Peoples R China
[4] Natl Tsing Hua Univ, Hsinchu, Taiwan
基金
中国国家自然科学基金;
关键词
Image Deraining; Direction attention; Wavelet decomposition; QUALITY ASSESSMENT; RAIN REMOVAL; DECOMPOSITION;
D O I
10.1145/3581783.3611697
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Single image deraining aims to remove rain perturbation while restoring the clean background scene from a rain image. However, existing methods tend to produce blurry and over-smooth outputs, lacking some textural details. Wavelet transform can depict the contextual and textural information of an image at different levels, showing impressive capability of learning structural information in the images to avoid artifacts, and thus has been recently explored to consider the inherent overlap of background and rain perturbation in both the pixel domain and the frequency embedding space. However, the existing wavelet-based methods ignore the heterogeneous degradation for different coefficients due to the inherent directional characteristics of rain streaks, leading to inter-frequency conflicts and compromised deraining results. To address this issue, we propose a novel Direction-aware Attention Wavelet Network (DAWN) for rain streaks removal. DAWN has several key distinctions from existing wavelet transform-based methods: 1) introducing the vector decomposition to parameterize the learning procedure, where the rain streaks are derived into the vertical (V) and horizontal (H) components to learn the specific representation; 2) a novel direction-aware attention module (DAM) to fit the projection and transformation parameters to characterize the direction-specific rain components, which helps accurate texture restoration; 3) exploring practical composite constraints on the structure, details, and chrominance aspects for high-quality background restoration. Our proposed DAWN delivers significant performance gains on nine datasets across image deraining and object detection tasks, exceeding the state-of-the-art method MPRNet by 0.88 dB in PSNR on the Test1200 dataset with only 35.5% computation cost.
引用
收藏
页码:7065 / 7074
页数:10
相关论文
共 50 条
  • [31] Direction-aware neural style transfer with texture enhancement
    Wu, Hao
    Sun, Zhengxing
    Zhang, Yan
    Li, Qian
    NEUROCOMPUTING, 2019, 370 : 39 - 55
  • [32] APANet: Asymmetrical Parallax Attention Network for Efficient Stereo Image Deraining
    Wang, Chenglong
    Yan, Tao
    Huang, Weilong
    Chen, Xianglong
    Xu, Ke
    Chang, Xiaojun
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2025, 11 : 101 - 115
  • [33] Recurrent RLCN-Guided Attention Network for Single Image Deraining
    Li, Yizhou
    Monno, Yusuke
    Okutomi, Masatoshi
    PROCEEDINGS OF 17TH INTERNATIONAL CONFERENCE ON MACHINE VISION APPLICATIONS (MVA 2021), 2021,
  • [34] Scene Polarization 3D Imaging Technology Based on Direction-Aware Network ( Invited)
    Zhang Junjie
    Liu Fei
    Wang Xin
    He Piao
    Fan Zhao
    Shao Xiaopeng
    LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (02)
  • [35] Direction-aware Spatial Context Features for Shadow Detection
    Hu, Xiaowei
    Zhu, Lei
    Fu, Chi-Wing
    Qin, Jing
    Heng, Pheng-Ann
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 7454 - 7462
  • [36] Recurrent wavelet structure-preserving residual network for single image deraining
    Hsu, Wei-Yen
    Chang, Wei-Chi
    PATTERN RECOGNITION, 2023, 137
  • [37] Direction-aware routing protocol for mobile ad hoc networks
    Chung, WH
    Kuo, SY
    Chen, SI
    2002 INTERNATIONAL CONFERENCE ON COMMUNICATIONS, CIRCUITS AND SYSTEMS AND WEST SINO EXPOSITION PROCEEDINGS, VOLS 1-4, 2002, : 165 - 169
  • [38] A two-stage network with wavelet transformation for single-image deraining
    Yang, Hao
    Zhou, Dongming
    Li, Miao
    Zhao, Qian
    VISUAL COMPUTER, 2023, 39 (09): : 3887 - 3903
  • [39] A two-stage network with wavelet transformation for single-image deraining
    Hao Yang
    Dongming Zhou
    Miao Li
    Qian Zhao
    The Visual Computer, 2023, 39 : 3887 - 3903
  • [40] Progressive Direction-Aware Pose Grammar for Human Pose Estimation
    Zhou, Lu
    Chen, Yingying
    Wang, Jinqiao
    IEEE TRANSACTIONS ON BIOMETRICS, BEHAVIOR, AND IDENTITY SCIENCE, 2023, 5 (04): : 593 - 605