Meta-Learning Based Domain Prior With Application to Optical-ISAR Image Translation

被引:3
|
作者
Liao, Huaizhang [1 ]
Xia, Jingyuan [1 ]
Yang, Zhixiong [1 ]
Pan, Fulin [1 ]
Liu, Zhen [1 ]
Liu, Yongxiang [1 ]
机构
[1] Natl Univ Def Technol, Coll Elect Engn, Changsha 410073, Peoples R China
基金
中国国家自然科学基金;
关键词
Training; Optical imaging; Optical scattering; Metalearning; Feature extraction; Task analysis; Scattering; Image translation; meta-learning; generative model; ISAR image processing;
D O I
10.1109/TCSVT.2023.3318401
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper focuses on generating Inverse Synthetic Aperture Radar (ISAR) images from optical images, in particular, for orbit space targets. ISAR images are widely applied in space target observation and classification tasks, whereas, limited to the expensive cost of ISAR sample collection, training deep learning-based ISAR image classifiers with insufficient samples and generating ISAR samples from emulation optical images via image translation techniques have attracted increasing attention. Image translation has highlighted significant success and popularity in computer vision, remote sensing and data generation societies. However, most of the existing methods are implemented under the discipline of extracting the explicit pixel-level features and do not perform effectively while entailing translation to domains with specific implicit features, such as ISAR image does. We propose a meta-learning based domain prior to implicit feature modelling and apply it to CycleGAN and UNIT models to realize effective translations between the ISAR and optical domains. Two representative implicit features, ISAR scattering distribution feature from the physical domain and the classification identifying feature from the task domain, are elaborately formulated with explicit modelling in statistic form. A meta-learning based training scheme is introduced to leverage the mutual knowledge of domain priors across different samples, and thus allows few-shot learning capacity with dramatically reduced training samples. Extensive simulations validate that the obtained ISAR images have better visible-authenticity and training-effectiveness than the existing image translation approaches on various synthetic datasets. Source codes are available at https://github.com/XYLGroup/MLDP.
引用
收藏
页码:7041 / 7056
页数:16
相关论文
共 50 条
  • [41] Meta-forests: Domain generalization on random forests with meta-learning
    Sun, Yuyang
    Kosmas, Panagiotis
    ASIAN CONFERENCE ON MACHINE LEARNING, VOL 222, 2023, 222
  • [42] Image-Based Deep Reinforcement Meta-Learning for Autonomous Lunar Landing
    Scorsoglio, Andrea
    D'Ambrosio, Andrea
    Ghilardi, Luca
    Gaudet, Brian
    Curti, Fabio
    Furfaro, Roberto
    JOURNAL OF SPACECRAFT AND ROCKETS, 2022, 59 (01) : 153 - 165
  • [43] Survey of Few-Shot Image Classification Based on Deep Meta-Learning
    Zhou, Bojun
    Chen, Zhiyu
    Computer Engineering and Applications, 2024, 60 (08) : 1 - 15
  • [44] Meta-Learning for Low-Resource Neural Machine Translation
    Gu, Jiatao
    Wang, Yong
    Chen, Yun
    Cho, Kyunghyun
    Li, Victor O. K.
    2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 3622 - 3631
  • [45] Curriculum-Based Meta-learning
    Zhang, Ji
    Song, Jingkuan
    Yao, Yazhou
    Gao, Lianli
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 1838 - 1846
  • [46] Blind light field image quality assessment based on deep meta-learning
    Ma, Jian
    Zhang, Xiaoyin
    Wang, Junbo
    OPTICS LETTERS, 2023, 48 (23) : 6184 - 6187
  • [47] META-LEARNING PERSPECTIVE FOR PERSONALIZED IMAGE AESTHETICS ASSESSMENT
    Wang, Weining
    Su, Junjie
    Li, Lemin
    Xu, Xiangmin
    Luo, Jiebo
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 1875 - 1879
  • [48] A Meta-Learning Method for Histopathology Image Classification Based on LSTM-Model
    Wen, Quan
    Yan, Jiazi
    Liu, Boling
    Meng, Daying
    Li, Siyi
    TENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2018), 2019, 11069
  • [49] A meta-learning approach for selecting image segmentation algorithm
    Aguiar, Gabriel Jonas
    Mantovani, Rafael Gomes
    Mastelini, Saulo M.
    de Carvalho, Andre C. P. F. L.
    Campos, Gabriel F. C.
    Barbon Junior, Sylvio
    PATTERN RECOGNITION LETTERS, 2019, 128 : 480 - 487
  • [50] Depixelation and image restoration with meta-learning in fiber-bundle-based endomicroscopy
    Yao, Bowen
    Huang, Boyi
    Li, Xiang
    Qi, Jinpeng
    Li, Yuan
    Shao, Yonghong
    Qu, Junle
    Gu, YueQing
    Li, Jia
    OPTICS EXPRESS, 2022, 30 (04): : 5038 - 5050