Automatic Metric Search for Few-Shot Learning

被引:7
|
作者
Zhou, Yuan [1 ]
Hao, Jieke [1 ]
Huo, Shuwei [1 ]
Wang, Boyu [2 ,3 ,4 ]
Ge, Leijiao [1 ]
Kung, Sun-Yuan [5 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Univ Western Ontario, Dept Comp Sci, London, ON N6A 5B7, Canada
[3] Univ Western Ontario, Brain Mind Inst, London, ON N6A 5B7, Canada
[4] Vector Inst, Toronto, ON, Canada
[5] Princeton Univ, Dept Elect Engn, Princeton, NJ 08540 USA
基金
中国国家自然科学基金;
关键词
Automated machine learning; few-shot learning (FSL); image classification; neural architecture search;
D O I
10.1109/TNNLS.2023.3238729
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot learning (FSL) aims to learn a model that can identify unseen classes using only a few training samples from each class. Most of the existing FSL methods adopt a manually predefined metric function to measure the relationship between a sample and a class, which usually require tremendous efforts and domain knowledge. In contrast, we propose a novel model called automatic metric search (Auto-MS), in which an Auto-MS space is designed for automatically searching task-specific metric functions. This allows us to further develop a new searching strategy to facilitate automated FSL. More specifically, by incorporating the episode-training mechanism into the bilevel search strategy, the proposed search strategy can effectively optimize the network weights and structural parameters of the few-shot model. Extensive experiments on the miniImageNet and tieredImageNet datasets demonstrate that the proposed Auto-MS achieves superior performance in FSL problems.
引用
收藏
页码:10098 / 10109
页数:12
相关论文
共 50 条
  • [21] Interpolative Metric Learning for Few-Shot Specific Emitter Identification
    Wang, Cheng
    Fu, Xue
    Wang, Yu
    Gui, Guan
    Gacanin, Haris
    Sari, Hikmet
    Adachi, Fumiyuki
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (12) : 16851 - 16855
  • [22] Multi-distance metric network for few-shot learning
    Farong Gao
    Lijie Cai
    Zhangyi Yang
    Shiji Song
    Cheng Wu
    International Journal of Machine Learning and Cybernetics, 2022, 13 : 2495 - 2506
  • [23] Recognizing Medical Search Query Intent by Few-shot Learning
    Wang, Yaqing
    Wang, Song
    Li, Yanyan
    Dou, Dejing
    PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 502 - 512
  • [24] EMAS: Efficient Meta Architecture Search for Few-Shot Learning
    Liu, Dongkai
    Li, Jiaxing
    Chen, Honglong
    Liu, Baodi
    Lu, Xiaoping
    Liu, Weifeng
    2022 IEEE 34TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, ICTAI, 2022, : 638 - 643
  • [25] Few-shot parts surface defect detection based on the metric learning
    Yu C.
    Sa L.
    Ma X.
    Chen X.
    Zhao X.
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2020, 41 (07): : 214 - 223
  • [26] Few-Shot Hyperspectral Image Classification With Deep Fuzzy Metric Learning
    Tang, Haojin
    Zhang, Chao
    Tang, Dong
    Lin, Xin
    Yang, Xiaofei
    Xie, Weixin
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2025, 22
  • [27] Few-Shot Metric Transfer Learning Network for Surface Defect Detection
    Huang J.
    Zheng C.
    Zhang J.
    Wang B.
    Chen P.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2021, 34 (05): : 407 - 414
  • [28] Distribution Consistency Based Covariance Metric Networks for Few-Shot Learning
    Li, Wenbin
    Xu, Jinglin
    Huo, Jing
    Wang, Lei
    Gao, Yang
    Luo, Jiebo
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 8642 - 8649
  • [29] Analyzing Few-Shot Neural Architecture Search in a Metric-Driven Framework
    Ly-Manson, Timotee
    Leonardon, Mathieu
    El Bey, Abdeldjalil Aissa
    Hacene, Ghouthi Boukli
    Mauch, Lukas
    INTERNATIONAL CONFERENCE ON AUTOMATED MACHINE LEARNING, 2024, 256
  • [30] TADAM: Task dependent adaptive metric for improved few-shot learning
    Oreshkin, Boris N.
    Rodriguez, Pau
    Lacoste, Alexandre
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31