CommonIT: Commonality-Aware Instruction Tuning for Large Language Models via Data Partitions

被引：0
|
作者：
Rao, Jun [1 ]
Liu, Xuebo [1 ]
Lian, Lian [2 ]
Cheng, Shengjun [2 ]
Liao, Yunjie [1 ]
Zhang, Min [1 ]
机构：
[1] Institute of Computing and Intelligence, Harbin Institute of Technology, Shenzhen, China
[2] Huawei Cloud Computing Technologies Co., Ltd., China
来源：
EMNLP 2024 - 2024 Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference | 2024年
关键词：
Compendex;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
Computational linguistics
引用
收藏
页码：10064 / 10083
相关论文
共 50 条
  • [21] A Comparative Analysis of Instruction Fine-Tuning Large Language Models for Financial Text Classification
    Fatemi, Sorouralsadat
    Hu, Yuheng
    Mousavi, Maryam
    ACM TRANSACTIONS ON MANAGEMENT INFORMATION SYSTEMS, 2025, 16 (01)
  • [22] JMedLoRA:Medical Domain Adaptation on Japanese Large Language Models using Instruction-tuning
    Sukeda, Issey
    Suzuki, Masahiro
    Kodera, Satoshi
    Sakaji, Hiroki
    arXiv, 2023,
  • [23] Fine Tuning of large language Models for Arabic Language
    Tamer, Ahmed
    Hassan, Al-Amir
    Ali, Asmaa
    Salah, Nada
    Medhat, Walaa
    2023 20TH ACS/IEEE INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS AND APPLICATIONS, AICCSA, 2023,
  • [24] Fine-Tuning Large Enterprise Language Models via Ontological Reasoning
    Baldazzi, Teodoro
    Bellomarini, Luigi
    Ceri, Stefano
    Colombo, Andrea
    Gentili, Andrea
    Sallinger, Emanuel
    RULES AND REASONING, RULEML+RR 2023, 2023, 14244 : 86 - 94
  • [25] Efficient Fine-Tuning Large Language Models for Knowledge-Aware Response Planning
    Minh Nguyen
    Kishan, K. C.
    Toan Nguyen
    Chadha, Ankit
    Thuy Vu
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, ECML PKDD 2023, PT II, 2023, 14170 : 593 - 611
  • [26] CoGenesis: A Framework Collaborating Large and Small Language Models for Secure Context-Aware Instruction Following
    Zhang, Kaiyan
    Wang, Jianyu
    Hua, Ermo
    Qi, Biqing
    Ding, Ning
    Zhou, Bowen
    PROCEEDINGS OF THE 62ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1: LONG PAPERS, 2024, : 4295 - 4312
  • [27] Exploring the Benefits of Training Expert Language Models over Instruction Tuning
    Jang, Joel
    Kim, Seungone
    Ye, Seonghyeon
    Kim, Doyoung
    Logeswaran, Lajanugen
    Lee, Moontae
    Lee, Kyungjae
    Seo, Minjoon
    Proceedings of Machine Learning Research, 2023, 202 : 14702 - 14729
  • [28] Exploring the Benefits of Training Expert Language Models over Instruction Tuning
    Jang, Joel
    Kim, Seungone
    Ye, Seonghyeon
    Kim, Doyoung
    Logeswaran, Lajanugen
    Lee, Moontae
    Lee, Kyungjae
    Seo, Minjoon
    arXiv, 2023,
  • [29] EcomGPT: Instruction-Tuning Large Language Models with Chain-of-Task Tasks for E-commerce
    Li, Yangning
    Ma, Shirong
    Wang, Xiaobin
    Huang, Shen
    Jiang, Chengyue
    Zheng, Hai-Tao
    Xie, Pengjun
    Huang, Fei
    Jiang, Yong
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 17, 2024, : 18582 - 18590
  • [30] DolphCoder: Echo-Locating Code Large Language Models with Diverse and Multi-Objective Instruction Tuning
    Wang, Yejie
    He, Keqing
    Dong, Guanting
    Wang, Pei
    Zeng, Weihao
    Diao, Muxi
    Zhang, Mengdi
    Wang, Jingang
    Cai, Xunliang
    Xu, Weiran
    PROCEEDINGS OF THE 62ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1: LONG PAPERS, 2024, : 4706 - 4721
12345