Meta-Learning Based Domain Prior With Application to Optical-ISAR Image Translation

被引:3
|
作者
Liao, Huaizhang [1 ]
Xia, Jingyuan [1 ]
Yang, Zhixiong [1 ]
Pan, Fulin [1 ]
Liu, Zhen [1 ]
Liu, Yongxiang [1 ]
机构
[1] Natl Univ Def Technol, Coll Elect Engn, Changsha 410073, Peoples R China
基金
中国国家自然科学基金;
关键词
Training; Optical imaging; Optical scattering; Metalearning; Feature extraction; Task analysis; Scattering; Image translation; meta-learning; generative model; ISAR image processing;
D O I
10.1109/TCSVT.2023.3318401
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper focuses on generating Inverse Synthetic Aperture Radar (ISAR) images from optical images, in particular, for orbit space targets. ISAR images are widely applied in space target observation and classification tasks, whereas, limited to the expensive cost of ISAR sample collection, training deep learning-based ISAR image classifiers with insufficient samples and generating ISAR samples from emulation optical images via image translation techniques have attracted increasing attention. Image translation has highlighted significant success and popularity in computer vision, remote sensing and data generation societies. However, most of the existing methods are implemented under the discipline of extracting the explicit pixel-level features and do not perform effectively while entailing translation to domains with specific implicit features, such as ISAR image does. We propose a meta-learning based domain prior to implicit feature modelling and apply it to CycleGAN and UNIT models to realize effective translations between the ISAR and optical domains. Two representative implicit features, ISAR scattering distribution feature from the physical domain and the classification identifying feature from the task domain, are elaborately formulated with explicit modelling in statistic form. A meta-learning based training scheme is introduced to leverage the mutual knowledge of domain priors across different samples, and thus allows few-shot learning capacity with dramatically reduced training samples. Extensive simulations validate that the obtained ISAR images have better visible-authenticity and training-effectiveness than the existing image translation approaches on various synthetic datasets. Source codes are available at https://github.com/XYLGroup/MLDP.
引用
收藏
页码:7041 / 7056
页数:16
相关论文
共 50 条
  • [1] Learning to Transfer: Unsupervised Domain Translation via Meta-Learning
    Lin, Jianxin
    Wang, Yijun
    Chen, Zhibo
    He, Tianyu
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 11507 - 11514
  • [2] Domain Adaptation for Medical Image Segmentation: A Meta-Learning Method
    Zhang, Penghao
    Li, Jiayue
    Wang, Yining
    Pan, Judong
    JOURNAL OF IMAGING, 2021, 7 (02)
  • [3] Domain Disentangled Meta-Learning
    Zhang, Xin
    Li, Yanhua
    Zhang, Ziming
    Zhang, Zhi-Li
    PROCEEDINGS OF THE 2023 SIAM INTERNATIONAL CONFERENCE ON DATA MINING, SDM, 2023, : 541 - 549
  • [4] A Sparse Aperture ISAR Imaging and Autofocusing Method Based on Meta-Learning Framework
    Li, Ruize
    Zhang, Shuanghui
    Liu, Yongxiang
    Li, Xiang
    IEEE TRANSACTIONS ON ANTENNAS AND PROPAGATION, 2024, 72 (04) : 3529 - 3544
  • [5] Meta-Learning Assisted Source Domain Optimization for Transfer Learning Based Optical Fiber Nonlinear Equalization
    Zhang, Jing
    Xu, Tao
    Jin, Taowei
    Jiang, Wenshan
    Hu, Shaohua
    Huang, Xiatao
    Xu, Bo
    Yu, Zhenming
    Yi, Xingwen
    Qiu, Kun
    JOURNAL OF LIGHTWAVE TECHNOLOGY, 2023, 41 (05) : 1269 - 1277
  • [6] Learning to Generalize: Meta-Learning for Domain Generalization
    Li, Da
    Yang, Yongxin
    Song, Yi-Zhe
    Hospedales, Timothy M.
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 3490 - 3497
  • [7] Research and application of meta-learning based ITMS system
    Zhang, Y
    Gu, JJ
    Wang, M
    Jiang, L
    2003 IEEE INTELLIGENT TRANSPORTATION SYSTEMS PROCEEDINGS, VOLS. 1 & 2, 2003, : 602 - 607
  • [8] Meta-learning for Adaptive Image Segmentation
    Sellaouti, Aymen
    Jaafra, Yasmina
    Hamouda, Atef
    IMAGE ANALYSIS AND RECOGNITION, ICIAR 2014, PT I, 2014, 8814 : 187 - 197
  • [9] Image quality assessment based on meta-learning and distortion perception
    Wan, Bingchen
    Zhang, Xuande
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2024, 39 (11) : 1519 - 1531
  • [10] Towards generalization on real domain for single image dehazing via meta-learning
    Ren, Wenqi
    Sun, Qiyu
    Zhao, Chaoqiang
    Tang, Yang
    CONTROL ENGINEERING PRACTICE, 2023, 133