Open set HRRP recognition with few samples based on multi-modality prototypical networks

被引:10
|
作者
Tian, Long [1 ]
Chen, Bo [1 ]
Guo, Zekun [1 ]
Du, Chuan [2 ]
Peng, Yang [1 ]
Liu, Hongwei [1 ]
机构
[1] Xidian Univ, Natl Lab Radar Signal Proc, Xian 710071, Peoples R China
[2] Sun Yat sen Univ, Electronicsand Commun Engn, Shenzhen 518107, Peoples R China
关键词
Multi-modality prototypical network  (MMPN); High-resolution range profile (HRRP); Open set recognition; STATISTICAL RECOGNITION; TARGET; CLASSIFICATION; MODEL;
D O I
10.1016/j.sigpro.2021.108391
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Learning from a few high-resolution range profiles (HRRPs) with multi-modality property caused by sen-sitivity of the target aspect remains a challenge in radar HRRP-based target recognition. Despite recent advances in HRRP recognition based on deep neural networks (DNNs), thanks to their powerful expressive ability, the standard supervised deep learning paradigm does not offer a satisfactory solution for learning new classes rapidly from a few HRRPs. In this work, we employ ideas from metric learning based on dis-criminative neural features and from recent advances that augment neural networks with FiLM layers to adapt to multi-modality input data. We first define open set learning problem on HRRP recognition task. Then, we propose a multi-modality prototypical network (MMPN) to attack the problem. Our framework learns a modality-aware network that maps a few labelled HRRPs and unlabelled HRRPs to their labels via a well defined metric space with episodic-based meta-learning strategy, obviating the need for fine-tuning to adapt to new classes. Finally, a synthetic HRRP data, called RareHRRP, is developed to evaluate that the proposed model generalize well and is efficient in computation. (c) 2021 Published by Elsevier B.V.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Multi-modality in gene regulatory networks with slow promoter kinetics
    Al-Radhawi, M. Ali
    Del Vecchio, Domitilla
    Sontag, Eduardo D.
    PLOS COMPUTATIONAL BIOLOGY, 2019, 15 (02)
  • [42] Collaborative multi-modality target classification in distributed sensor networks
    Wang, XL
    Qi, HR
    Iyengar, SS
    PROCEEDINGS OF THE FIFTH INTERNATIONAL CONFERENCE ON INFORMATION FUSION, VOL I, 2002, : 285 - 290
  • [43] Deep Multi-Modality Adversarial Networks for Unsupervised Domain Adaptation
    Ma, Xinhong
    Zhang, Tianzhu
    Xu, Changsheng
    IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (09) : 2419 - 2431
  • [44] HarMI: Human Activity Recognition Via Multi-Modality Incremental Learning
    Zhang, Xiao
    Yu, Hongzheng
    Yang, Yang
    Gu, Jingjing
    Li, Yujun
    Zhuang, Fuzhen
    Yu, Dongxiao
    Ren, Zhaochun
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (03) : 939 - 951
  • [45] Skeleton Sequence and RGB Frame Based Multi-Modality Feature Fusion Network for Action Recognition
    Zhu, Xiaoguang
    Zhu, Ye
    Wang, Haoyu
    Wen, Honglin
    Yan, Yan
    Liu, Peilin
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2022, 18 (03)
  • [46] Multi-modality Network with Visual and Geometrical Information for Micro Emotion Recognition
    Guo, Jianzhu
    Zhou, Shuai
    Wu, Jinlin
    Wan, Jun
    Zhu, Xiangyu
    Lei, Zhen
    Li, Stan Z.
    2017 12TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2017), 2017, : 814 - 819
  • [47] A New, Open-Source, Multi-Modality Digital Breast Phantom
    Graff, Christian G.
    MEDICAL IMAGING 2016: PHYSICS OF MEDICAL IMAGING, 2016, 9783
  • [48] Learning based Multi-modality Image and Video Compression
    Lu, Guo
    Zhong, Tianxiong
    Geng, Jing
    Hu, Qiang
    Xu, Dong
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 6073 - 6082
  • [49] Object Tracking Based on Multi-modality Dictionary Learning
    Wang, Jing
    Zhu, Hong
    Xue, Shan
    Shi, Jing
    IMAGE AND GRAPHICS (ICIG 2017), PT II, 2017, 10667 : 129 - 138
  • [50] MMA: a multi-view and multi-modality benchmark dataset for human action recognition
    Zan Gao
    Tao-tao Han
    Hua Zhang
    Yan-bing Xue
    Guang-ping Xu
    Multimedia Tools and Applications, 2018, 77 : 29383 - 29404