Meta-Learning Based Domain Prior With Application to Optical-ISAR Image Translation

被引:3
|
作者
Liao, Huaizhang [1 ]
Xia, Jingyuan [1 ]
Yang, Zhixiong [1 ]
Pan, Fulin [1 ]
Liu, Zhen [1 ]
Liu, Yongxiang [1 ]
机构
[1] Natl Univ Def Technol, Coll Elect Engn, Changsha 410073, Peoples R China
基金
中国国家自然科学基金;
关键词
Training; Optical imaging; Optical scattering; Metalearning; Feature extraction; Task analysis; Scattering; Image translation; meta-learning; generative model; ISAR image processing;
D O I
10.1109/TCSVT.2023.3318401
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper focuses on generating Inverse Synthetic Aperture Radar (ISAR) images from optical images, in particular, for orbit space targets. ISAR images are widely applied in space target observation and classification tasks, whereas, limited to the expensive cost of ISAR sample collection, training deep learning-based ISAR image classifiers with insufficient samples and generating ISAR samples from emulation optical images via image translation techniques have attracted increasing attention. Image translation has highlighted significant success and popularity in computer vision, remote sensing and data generation societies. However, most of the existing methods are implemented under the discipline of extracting the explicit pixel-level features and do not perform effectively while entailing translation to domains with specific implicit features, such as ISAR image does. We propose a meta-learning based domain prior to implicit feature modelling and apply it to CycleGAN and UNIT models to realize effective translations between the ISAR and optical domains. Two representative implicit features, ISAR scattering distribution feature from the physical domain and the classification identifying feature from the task domain, are elaborately formulated with explicit modelling in statistic form. A meta-learning based training scheme is introduced to leverage the mutual knowledge of domain priors across different samples, and thus allows few-shot learning capacity with dramatically reduced training samples. Extensive simulations validate that the obtained ISAR images have better visible-authenticity and training-effectiveness than the existing image translation approaches on various synthetic datasets. Source codes are available at https://github.com/XYLGroup/MLDP.
引用
收藏
页码:7041 / 7056
页数:16
相关论文
共 50 条
  • [21] META-LEARNING APPLICATIONS IN DIGITAL IMAGE PROCESSING
    Silva, Aristofanes Correa
    PROCEEDINGS OF THE 2020 INTERNATIONAL CONFERENCE ON SYSTEMS, SIGNALS AND IMAGE PROCESSING (IWSSIP), 27TH EDITION, 2020, : 19 - 20
  • [22] MetaSeg: A survey of meta-learning for image segmentation
    Sun J.
    Li Y.
    Cognitive Robotics, 2021, 1 : 83 - 91
  • [23] Application of Meta-learning Framework Based on Multiple-Capsule Intelligent Neural Systems in Image Classification
    Wang, Qingjun
    Wang, Gang
    Kou, Guangjie
    Zang, Mujun
    Wang, Harry
    NEURAL PROCESSING LETTERS, 2021, 53 (04) : 2581 - 2602
  • [24] A META-LEARNING APPROACH FOR MEDICAL IMAGE REGISTRATION
    Park, Heejung
    Lee, Gyeong Min
    Kim, Soopil
    Ryu, Ga Hyung
    Jeong, Areum
    Sagong, Min
    Park, Sang Hyun
    2022 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (IEEE ISBI 2022), 2022,
  • [25] A Few Shot Image Ensemble Classification Algorithm Based on Meta-Learning
    Peng, He
    Qun, Liu
    PROCEEDINGS OF 2021 2ND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND INFORMATION SYSTEMS (ICAIIS '21), 2021,
  • [26] Personalized Meta-Learning for Domain Agnostic Learning from Demonstration
    Schrum, Mariah L.
    Hedlund-Botti, Erin
    Gombolay, Matthew C.
    PROCEEDINGS OF THE 2022 17TH ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION (HRI '22), 2022, : 1179 - 1181
  • [27] Meta-seg: A survey of meta-learning for image segmentation
    Luo, Shuai
    Li, Yujie
    Gao, Pengxiang
    Wang, Yichuan
    Serikawa, Seiichi
    PATTERN RECOGNITION, 2022, 126
  • [28] Meta-learning based relation and representation learning networks for single-image deraining
    Gao, Xinjian
    Wang, Yang
    Cheng, Jun
    Xu, Mingliang
    Wang, Meng
    PATTERN RECOGNITION, 2021, 120
  • [29] CDAML: a cluster-based domain adaptive meta-learning model for cross domain recommendation
    Jiajie Xu
    Jiayu Song
    Yu Sang
    Lihua Yin
    World Wide Web, 2023, 26 : 989 - 1003
  • [30] CDAML: a cluster-based domain adaptive meta-learning model for cross domain recommendation
    Xu, Jiajie
    Song, Jiayu
    Sang, Yu
    Yin, Lihua
    WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2023, 26 (03): : 989 - 1003