Meta-Learning Based Domain Prior With Application to Optical-ISAR Image Translation

被引:3
|
作者
Liao, Huaizhang [1 ]
Xia, Jingyuan [1 ]
Yang, Zhixiong [1 ]
Pan, Fulin [1 ]
Liu, Zhen [1 ]
Liu, Yongxiang [1 ]
机构
[1] Natl Univ Def Technol, Coll Elect Engn, Changsha 410073, Peoples R China
基金
中国国家自然科学基金;
关键词
Training; Optical imaging; Optical scattering; Metalearning; Feature extraction; Task analysis; Scattering; Image translation; meta-learning; generative model; ISAR image processing;
D O I
10.1109/TCSVT.2023.3318401
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper focuses on generating Inverse Synthetic Aperture Radar (ISAR) images from optical images, in particular, for orbit space targets. ISAR images are widely applied in space target observation and classification tasks, whereas, limited to the expensive cost of ISAR sample collection, training deep learning-based ISAR image classifiers with insufficient samples and generating ISAR samples from emulation optical images via image translation techniques have attracted increasing attention. Image translation has highlighted significant success and popularity in computer vision, remote sensing and data generation societies. However, most of the existing methods are implemented under the discipline of extracting the explicit pixel-level features and do not perform effectively while entailing translation to domains with specific implicit features, such as ISAR image does. We propose a meta-learning based domain prior to implicit feature modelling and apply it to CycleGAN and UNIT models to realize effective translations between the ISAR and optical domains. Two representative implicit features, ISAR scattering distribution feature from the physical domain and the classification identifying feature from the task domain, are elaborately formulated with explicit modelling in statistic form. A meta-learning based training scheme is introduced to leverage the mutual knowledge of domain priors across different samples, and thus allows few-shot learning capacity with dramatically reduced training samples. Extensive simulations validate that the obtained ISAR images have better visible-authenticity and training-effectiveness than the existing image translation approaches on various synthetic datasets. Source codes are available at https://github.com/XYLGroup/MLDP.
引用
收藏
页码:7041 / 7056
页数:16
相关论文
共 50 条
  • [31] Lifelong Domain Word Embedding via Meta-Learning
    Xu, Hu
    Liu, Bing
    Shu, Lei
    Yu, Philip S.
    PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 4510 - 4516
  • [32] MULTI-INITIALIZATION META-LEARNING WITH DOMAIN ADAPTATION
    Chen, Zhengyu
    Wang, Donglin
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1390 - 1394
  • [33] Cross-domain Resemblance Detection based on Meta-learning for Cloud Storage
    Li, Baisong
    Tian, Wenlong
    Li, Ruixuan
    Xiao, Weijun
    Fu, Zhongming
    Ye, Xuming
    Duan, Renjiao
    Li, Yusheng
    Xu, Zhiyong
    2022 IEEE INTERNATIONAL PERFORMANCE, COMPUTING, AND COMMUNICATIONS CONFERENCE, IPCCC, 2022,
  • [34] Spectral-Spatial Distribution Consistent Network Based on Meta-Learning for Cross-Domain Hyperspectral Image Classification
    Zhang, Xiangrong
    Zhen, Qi
    Li, Zhenyu
    Han, Xiao
    Chen, Puhua
    Tang, Xu
    Jiao, Licheng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [35] Application of Context-Based Meta-Learning Schemes for an Industrial Device
    Kalisch, Mateusz
    ADVANCES IN TECHNICAL DIAGNOSTICS, 2018, 10 : 487 - 497
  • [36] Application of meta-learning in cyberspace security:a survey
    Aimin Yang
    Chaomeng Lu
    Jie Li
    Xiangdong Huang
    Tianhao Ji
    Xichang Li
    Yichao Sheng
    Digital Communications and Networks, 2023, 9 (01) : 67 - 78
  • [37] Leveraging Meta-Learning To Improve Unsupervised Domain Adaptation
    Farhadi, Amirfarhad
    Sharifi, Arash
    COMPUTER JOURNAL, 2023, 67 (05): : 1838 - 1850
  • [38] Application of meta-learning in cyberspace security: a survey
    Yang, Aimin
    Lu, Chaomeng
    Li, Jie
    Huang, Xiangdong
    Ji, Tianhao
    Li, Xichang
    Sheng, Yichao
    DIGITAL COMMUNICATIONS AND NETWORKS, 2023, 9 (01) : 67 - 78
  • [39] Domain Adaptive Meta-Learning for Dialogue State Tracking
    Zeng, Jiali
    Yin, Yongjing
    Liu, Yang
    Ge, Yubin
    Su, Jinsong
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2021, 29 : 2493 - 2501
  • [40] Semi-supervised Meta-learning with Disentanglement for Domain-Generalised Medical Image Segmentation
    Liu, Xiao
    Thermos, Spyridon
    O'Neil, Alison
    Tsaftaris, Sotirios A.
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT II, 2021, 12902 : 307 - 317