Uncertainty-guided Siamese Transformer Network for salient object detection

被引:0
|
作者
Han, Pengfei [1 ]
Huang, Ju [1 ,3 ]
Yang, Jian [2 ]
Li, Xuelong [1 ,3 ]
机构
[1] Northwestern Polytech Univ, Sch Artificial Intelligence Opt & Elect iOPEN, Xian 710072, Shaanxi, Peoples R China
[2] Northwest Univ, Sch Math, Xian 710072, Shaanxi, Peoples R China
[3] Shanghai Artificial Intelligence Lab, Shanghai 200232, Peoples R China
基金
中国国家自然科学基金;
关键词
Salient object detection; Optical remote sensing image; Feature representation; Iterative refinement module; REGION DETECTION;
D O I
10.1016/j.eswa.2025.126690
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Salient object detection acts with pivotal effect upon the analytical aspects of remote sensing images. However, the complexity of scene interference, diverse object shapes, and blurred boundaries in remote sensing images make it challenging for existing methods to accurately locate salient objects, predict clear boundaries, enhance feature representation, and effectively suppress background noise. To alleviate such issues, an Uncertainty- guided Siamese Transformer Network (USTNet) is proposed. This network constructs a Spatial-Semantic Complementary Feature Representation Module (SSRM) to effectively capture the global contextual information and fine-grained feature representations in remote sensing images, thereby better integrating multi-level and multi-scale features in these images and enhancing the expressive power of salient object detection. Meanwhile, an Uncertainty-guided Iterative Refinement Module (UIRM) based on foreground-background uncertainty modeling is designed, which dynamically estimates and rectifies the ambiguity and uncertainty between foreground and background features, gradually refining the representation and boundary description of salient regions. Extensive experiments demonstrate in which the suggested approaches have gained properties beyond the cutting-edge methods across multiple benchmark remote sensing image datasets. It significantly improves the accuracy of detecting objects that stand out in complicated contextual sceneries, boundary retention capability, and overall efficiency, showcasing its superior performance and broad applicability in complex remote sensing image analysis.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Uncertainty-Guided Transformer Reasoning for Camouflaged Object Detection
    Yang, Fan
    Zhai, Qiang
    Li, Xin
    Huang, Rui
    Luo, Ao
    Cheng, Hong
    Fan, Deng-Ping
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 4126 - 4135
  • [2] Semi-Supervised Video Salient Object Detection Based on Uncertainty-Guided Pseudo Labels
    Piao, Yongri
    Lu, Chenyang
    Zhang, Miao
    Lu, Huchuan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [3] Uncertainty-Guided Segmentation Network for Geospatial Object Segmentation
    Jia, Hongyu
    Yang, Wenwu
    Wang, Lin
    Li, Haolin
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 5824 - 5833
  • [4] SiaTrans: Siamese transformer network for RGB-D salient object detection with depth image classification
    Jia, XingZhao
    DongYe, ChangLei
    Peng, YanJun
    IMAGE AND VISION COMPUTING, 2022, 127
  • [5] Uncertainty-guided transformer for brain tumor segmentation
    Zan Chen
    Chenxu Peng
    Wenlong Guo
    Lei Xie
    Shanshan Wang
    Qichuan Zhuge
    Caiyun Wen
    Yuanjing Feng
    Medical & Biological Engineering & Computing, 2023, 61 : 3289 - 3301
  • [6] Uncertainty-guided transformer for brain tumor segmentation
    Chen, Zan
    Peng, Chenxu
    Guo, Wenlong
    Xie, Lei
    Wang, Shanshan
    Zhuge, Qichuan
    Wen, Caiyun
    Feng, Yuanjing
    MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2023, 61 (12) : 3289 - 3301
  • [7] Collaborative compensative transformer network for salient object detection
    Chen, Jun
    Zhang, Heye
    Gong, Mingming
    Gao, Zhifan
    PATTERN RECOGNITION, 2024, 154
  • [8] SDETR: ATTENTION-GUIDED SALIENT OBJECT DETECTION WITH TRANSFORMER
    Liu, Guanze
    Xu, Bo
    Huang, Han
    Lu, Cheng
    Guo, Yandong
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 1611 - 1615
  • [9] Uncertainty-Guided Probabilistic Transformer for Complex Action Recognition
    Guo, Hongji
    Wang, Hanjing
    Ji, Qiang
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 20020 - 20029
  • [10] Siamese Network for RGB-D Salient Object Detection and Beyond
    Fu, Keren
    Fan, Deng-Ping
    Ji, Ge-Peng
    Zhao, Qijun
    Shen, Jianbing
    Zhu, Ce
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (09) : 5541 - 5559