Trapezoidal Step Scheduler for Model-Agnostic Meta-Learning in Medical Imaging

被引:0
|
作者
Voon, Wingates [1 ]
Hum, Yan Chai [1 ]
Tee, Yee Kai [1 ]
Yap, Wun-She [2 ]
Lai, Khin Wee [3 ]
Nisar, Humaira [4 ]
Mokayed, Hamam [5 ]
机构
[1] Univ Tunku Abdul Rahman, Lee Kong Chian Fac Engn & Sci, Dept Mechatron & Biomed Engn, Sungai Long, Malaysia
[2] Univ Tunku Abdul Rahman, Lee Kong Chian Fac Engn & Sci, Dept Elect & Elect Engn, Sungai Long, Malaysia
[3] Univ Malaya, Dept Biomed Engn, Kuala Lumpur, Malaysia
[4] Univ Tunku Abdul Rahman, Fac Engn & Green Technol, Dept Elect Engn, Kampar, Malaysia
[5] Lulea Univ Technol, Dept Comp Sci Elect & Space Engn, Lulea, Sweden
关键词
Few-shot learning; Medical image classification; Trapezoidal step scheduler; Model-agnostic meta-learning;
D O I
10.1016/j.patcog.2024.111316
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Model-Agnostic Meta-learning (MAML) is a widely adopted few-shot learning (FSL) method designed to mitigate the dependency on large, labeled datasets of deep learning-based methods in medical imaging analysis. However, MAML's reliance on a fixed number of gradient descent (GD) steps for task adaptation results in computational inefficiency and task-level overfitting. To address this issue, we introduce Tra-MAML, which optimizes the balance between model adaptation capacity and computational efficiency through a trapezoidal step scheduler (TRA). The TRA scheduler dynamically adjusts the number of GD steps in the inner optimization loop: initially increasing the steps uniformly to reduce variance, maintaining the maximum number of steps to enhance adaptation capacity, and finally decreasing the steps uniformly to mitigate overfitting. Our evaluation of TraMAML against selected FSL methods across four medical imaging datasets demonstrates its superior performance. Notably, Tra-MAML outperforms MAML by 13.36% on the BreaKHis40X dataset in the 3-way 10-shot scenario.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Domain-Invariant Speaker Vector Projection by Model-Agnostic Meta-Learning
    Kang, Jiawen
    Liu, Ruiqi
    Li, Lantian
    Cai, Yunqi
    Wang, Dong
    Zheng, Thomas Fang
    INTERSPEECH 2020, 2020, : 3825 - 3829
  • [32] Meta-LSTM in hydrology: Advancing runoff predictions through model-agnostic meta-learning
    Cai, Kaixuan
    He, Jinxin
    Li, Qingliang
    Wei, Shangguan
    Li, Lu
    Hu, Huiming
    JOURNAL OF HYDROLOGY, 2024, 639
  • [33] Memory-Based Optimization Methods for Model-Agnostic Meta-Learning and Personalized Federated Learning
    Wang, Bokun
    Yuan, Zhuoning
    Ying, Yiming
    Yang, Tianbao
    JOURNAL OF MACHINE LEARNING RESEARCH, 2023, 24
  • [34] Specific Emitter Identification via Sparse Bayesian Learning Versus Model-Agnostic Meta-Learning
    He, Boxiang
    Wang, Fanggang
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2023, 18 : 3677 - 3691
  • [35] ROBUST MAML: PRIORITIZATION TASK BUFFER WITH ADAPTIVE LEARNING PROCESS FOR MODEL-AGNOSTIC META-LEARNING
    Thanh Nguyen
    Tung Luu
    Trung Pham
    Rakhimkul, Sanzhar
    Yoo, Chang D.
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 3460 - 3464
  • [36] Model-Agnostic Meta-Learning for Fast Text-Dependent Speaker Embedding Adaptation
    Lin, Weiwei
    Mak, Man-Wai
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2023, 31 : 1866 - 1876
  • [37] Few-Shot Bearing Anomaly Detection via Model-Agnostic Meta-Learning
    Zhang, Shen
    Ye, Fei
    Wang, Bingnan
    Habetler, Thomas G.
    2020 23RD INTERNATIONAL CONFERENCE ON ELECTRICAL MACHINES AND SYSTEMS (ICEMS), 2020, : 1341 - 1346
  • [38] Few-Shot Bearing Fault Diagnosis Based on Model-Agnostic Meta-Learning
    Zhang, Shen
    Ye, Fei
    Wang, Bingnan
    Habetler, Thomas G.
    IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, 2021, 57 (05) : 4754 - 4764
  • [39] Bayesian Model-Agnostic Meta-Learning with Matrix-Valued Kernels for Quality Estimation
    Obamuyide, Abiola
    Fomicheva, Marina
    Specia, Lucia
    REPL4NLP 2021: PROCEEDINGS OF THE 6TH WORKSHOP ON REPRESENTATION LEARNING FOR NLP, 2021, : 223 - 230
  • [40] Model-Agnostic Learning to Meta-Learn
    Devos, Arnout
    Dandi, Yatin
    NEURIPS 2020 WORKSHOP ON PRE-REGISTRATION IN MACHINE LEARNING, VOL 148, 2020, 148 : 155 - 175