Cross-domain few-shot semantic segmentation for the astronaut work environment

被引:0
|
作者
Sun, Qingwei [1 ,2 ]
Chao, Jiangang [2 ,3 ]
Lin, Wanhong [2 ,3 ]
机构
[1] Space Engn Univ, Dept Aerosp Sci & Technol, Beijing 101416, Peoples R China
[2] China Astronaut Res & Training Ctr, Beijing 100094, Peoples R China
[3] China Astronaut Res & Training Ctr, Natl Key Lab Human Factors Engn, Beijing 100094, Peoples R China
关键词
Few-shot semantic segmentation; Cross-domain; Astronaut training;
D O I
10.1016/j.asr.2024.08.069
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
The study of few-shot semantic segmentation (FSS) for the astronaut work environment (AWE) is of significant importance as it enables the segmentation of unknown categories. However, general FSS methods are predicated on the assumption that the training and testing data belong to the same domain. When this assumption is invalid, the model's performance is significantly degraded. We propose a more general approach, whereby the model is trained on a generic dataset and tested on a dedicated AWE dataset. This challenging task is referred to as cross-domain few-shot semantic segmentation (CD-FSS). A novel model, namely FTDCNet, is proposed, which comprises a domain-agnostic feature transformation module and a domain-constrained transformer. The FTDCNet model demonstrates superior performance compared to the state-of-the-art (SOTA) model, with an accuracy improvement of 11.83% and 11.42% under 1-shot and 5-shot settings, respectively. (c) 2024 COSPAR. Published by Elsevier B.V. All rights are reserved, including those for text and data mining, AI training, and similar technologies.
引用
收藏
页码:5934 / 5949
页数:16
相关论文
共 50 条
  • [1] Cross-Domain Few-Shot Semantic Segmentation
    Lei, Shuo
    Zhang, Xuchao
    He, Jianfeng
    Chen, Fanglan
    Du, Bowen
    Lu, Chang-Tien
    COMPUTER VISION - ECCV 2022, PT XXX, 2022, 13690 : 73 - 90
  • [2] Pixel-by-Pixel Cross-Domain Alignment for Few-Shot Semantic Segmentation
    Tavera, Antonio
    Cermelli, Fabio
    Masone, Carlo
    Caputo, Barbara
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 1959 - 1968
  • [3] APSeg: Auto-Prompt Network for Cross-Domain Few-Shot Semantic Segmentation
    He, Weizhao
    Zhang, Yang
    Zhuo, Wei
    Shen, Linlin
    Yang, Jiaqi
    Deng, Songhe
    Sun, Liang
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 23762 - 23772
  • [4] Domain-Rectifying Adapter for Cross-Domain Few-Shot Segmentation
    Su, Jiapeng
    Fan, Qi
    Pei, Wenjie
    Lu, Guangming
    Chen, Fanglin
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 24036 - 24045
  • [5] Rethinking cross-domain semantic relation for few-shot image generation
    Gou, Yao
    Li, Min
    Lv, Yilong
    Zhang, Yusen
    Xing, Yuhang
    He, Yujie
    APPLIED INTELLIGENCE, 2023, 53 (19) : 22391 - 22404
  • [6] Rethinking cross-domain semantic relation for few-shot image generation
    Yao Gou
    Min Li
    Yilong Lv
    Yusen Zhang
    Yuhang Xing
    Yujie He
    Applied Intelligence, 2023, 53 : 22391 - 22404
  • [7] Remember the Difference: Cross-Domain Few-Shot Semantic Segmentation via Meta-Memory Transfer
    Wang, Wenjian
    Duan, Lijuan
    Wang, Yuxi
    En, Qing
    Fan, Junsong
    Zhang, Zhaoxiang
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 7055 - 7064
  • [8] Cross-Domain Few-Shot Graph Classification
    Hassani, Kaveh
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 6856 - 6864
  • [9] Understanding Cross-Domain Few-Shot Learning Based on Domain Similarity and Few-Shot Difficulty
    Oh, Jaehoon
    Kim, Sungnyun
    Ho, Namgyu
    Kim, Jin-Hwa
    Song, Hwanjun
    Yun, Se-Young
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [10] Adapt Before Comparison: A New Perspective on Cross-Domain Few-Shot Segmentation
    Herzog, Jonas
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 23605 - 23615