Exploring the Benefits of Training Expert Language Models over Instruction Tuning

被引：0
|
作者：
Jang, Joel [1 ]
Kim, Seungone [1 ]
Ye, Seonghyeon [1 ]
Kim, Doyoung [1 ]
Logeswaran, Lajanugen [2 ]
Lee, Moontae [2 ,3 ]
Lee, Kyungjae [2 ]
Seo, Minjoon [1 ]
机构：
[1] KAIST, Korea, Republic of
[2] LG AI Research, Korea, Republic of
[3] University of Illinois, Chicago, United States
来源：
Proceedings of Machine Learning Research | 2023年 / 202卷
关键词：
Compilation and indexing terms; Copyright 2024 Elsevier Inc;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
Computational linguistics
引用
收藏
页码：14702 / 14729
相关论文
共 50 条
  • [21] Training Hybrid Language Models by Marginalizing over Segmentations
    Grave, Edouard
    Sukhbaatar, Sainbayar
    Bojanowski, Piotr
    Joulin, Armand
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 1477 - 1482
  • [22] InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning
    Dai, Wenliang
    Li, Junnan
    Li, Dongxu
    Tiong, Anthony Meng Huat
    Zhao, Junqi
    Wang, Weisheng
    Li, Boyang
    Fung, Pascale
    Hoi, Steven
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [23] Exploring benefits and models of blended learning technology in modern professional training
    Hrechanyk, Nataliia
    Koval, Daria
    Kovalchuk, Inna
    Slovik, Oksana
    Zinchenko, Lina
    AMAZONIA INVESTIGA, 2023, 12 (67): : 54 - 65
  • [24] Exploring the benefits of expert systems use in organizations
    Shim, SJ
    JOURNAL OF COMPUTER INFORMATION SYSTEMS, 1999, 39 (03) : 77 - 80
  • [25] Transfer of Training and Foreign Language Instruction
    Altenhein, Margarete Reckling
    MODERN LANGUAGE JOURNAL, 1955, 39 (05): : 246 - 248
  • [26] A Comparative Analysis of Instruction Fine-Tuning Large Language Models for Financial Text Classification
    Fatemi, Sorouralsadat
    Hu, Yuheng
    Mousavi, Maryam
    ACM TRANSACTIONS ON MANAGEMENT INFORMATION SYSTEMS, 2025, 16 (01)
  • [27] CommonIT: Commonality-Aware Instruction Tuning for Large Language Models via Data Partitions
    Rao, Jun
    Liu, Xuebo
    Lian, Lian
    Cheng, Shengjun
    Liao, Yunjie
    Zhang, Min
    EMNLP 2024 - 2024 Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference, 2024, : 10064 - 10083
  • [28] JMedLoRA:Medical Domain Adaptation on Japanese Large Language Models using Instruction-tuning
    Sukeda, Issey
    Suzuki, Masahiro
    Kodera, Satoshi
    Sakaji, Hiroki
    arXiv, 2023,
  • [29] Discovering Photoswitchable Molecules for Drug Delivery with Large Language Models and Chemist Instruction Training
    Hu, Junjie
    Wu, Peng
    Li, Yulin
    Li, Qi
    Wang, Shiyi
    Liu, Yang
    Qian, Kun
    Yang, Guang
    PHARMACEUTICALS, 2024, 17 (10)
  • [30] Exploring the role of language in English medium instruction
    Macaro, Ernesto
    INTERNATIONAL JOURNAL OF BILINGUAL EDUCATION AND BILINGUALISM, 2020, 23 (03) : 263 - 276
12345