Editorial for Special Issue on Large-scale Pre-training: Data, Models, and Fine-tuning

被引:1
|
作者
Wen, Ji-Rong [1 ]
Huang, Zi [2 ]
Zhang, Hanwang [3 ]
机构
[1] Renmin Univ China, Beijing, Peoples R China
[2] Univ Queensland, Brisbane, Qld, Australia
[3] Nanyang Technol Univ, Singapore, Singapore
关键词
Compendex;
D O I
10.1007/s11633-023-1431-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
引用
收藏
页码:145 / 146
页数:2
相关论文
共 50 条
  • [21] MISS: A Generative Pre-training and Fine-Tuning Approach for Med-VQA
    Chen, Jiawei
    Yang, Dingkang
    Jiang, Yue
    Lei, Yuxuan
    Zhang, Lihua
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING-ICANN 2024, PT VIII, 2024, 15023 : 299 - 313
  • [22] FACTPEGASUS: Factuality-Aware Pre-training and Fine-tuning for Abstractive Summarization
    Wan, David
    Bansal, Mohit
    NAACL 2022: THE 2022 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES, 2022, : 1010 - 1028
  • [23] Evaluation of pre-training impact on fine-tuning for remote sensing scene classification
    Yuan, Man
    Liu, Zhi
    Wang, Fan
    REMOTE SENSING LETTERS, 2019, 10 (01) : 49 - 58
  • [24] Fine-tuning and multilingual pre-training for abstractive summarization task for the Arabic language
    Kahla, Mram
    Novak, Attila
    Yang, Zijian Gyozo
    ANNALES MATHEMATICAE ET INFORMATICAE, 2023, 57 : 24 - 35
  • [25] KNOWLEDGE DISTILLATION FROM BERT IN PRE-TRAINING AND FINE-TUNING FOR POLYPHONE DISAMBIGUATION
    Sun, Hao
    Tan, Xu
    Gan, Jun-Wei
    Zhao, Sheng
    Han, Dongxu
    Liu, Hongzhi
    Qin, Tao
    Liu, Tie-Yan
    2019 IEEE AUTOMATIC SPEECH RECOGNITION AND UNDERSTANDING WORKSHOP (ASRU 2019), 2019, : 168 - 175
  • [26] WuDaoCorpora: A super large-scale Chinese corpora for pre-training language models
    Yuan, Sha
    Zhao, Hanyu
    Du, Zhengxiao
    Ding, Ming
    Liu, Xiao
    Cen, Yukuo
    Zou, Xu
    Yang, Zhilin
    Tang, Jie
    AI OPEN, 2021, 2 : 65 - 68
  • [27] Synthetic Augmentation with Large-Scale Unconditional Pre-training
    Ye, Jiarong
    Ni, Haomiao
    Jin, Peng
    Huang, Sharon X.
    Xue, Yuan
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT II, 2023, 14221 : 754 - 764
  • [28] SelfPAB: large-scale pre-training on accelerometer data for human activity recognition
    Logacjov, Aleksej
    Herland, Sverre
    Ustad, Astrid
    Bach, Kerstin
    APPLIED INTELLIGENCE, 2024, 54 (06) : 4545 - 4563
  • [29] SelfPAB: large-scale pre-training on accelerometer data for human activity recognition
    Aleksej Logacjov
    Sverre Herland
    Astrid Ustad
    Kerstin Bach
    Applied Intelligence, 2024, 54 : 4545 - 4563
  • [30] Adaptive Fine-Tuning for Large-Scale Complex Nonlinear Systems
    Kosmatopoulos, Elias
    Papageorgiou, Markos
    Papamichail, Loannis
    Aboudolas, Kostas
    Papadaki, Dimitra
    Betsis, Loannis
    2008 3RD INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGIES: FROM THEORY TO APPLICATIONS, VOLS 1-5, 2008, : 257 - 264