On the Evaluation of Large Language Models in Unit Test Generation

被引：0
|
作者：
Yang, Lin [1 ]
Yang, Chen [1 ]
Gao, Shutao [2 ]
Wang, Weijing [1 ]
Wang, Bo [3 ]
Zhu, Qihao [4 ]
Chu, Xiao [5 ]
Zhou, Jianyi [5 ]
Liang, Guangtai [5 ]
Wang, Qianxiang [5 ]
Chen, Junjie [1 ]
机构：
[1] College of Intelligence and Computing, Tianjin University, China
[2] School of Future Technology, Tianjin University, China
[3] School of Computer and Information Technology, Beijing Jiaotong University, China
[4] Key Laboratory of HCST, MoE DCST, Peking University, China
[5] Huawei Cloud Computing Co. Ltd., China
来源：
Proceedings - 2024 39th ACM/IEEE International Conference on Automated Software Engineering, ASE 2024 |
关键词：
Compendex;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
Software design
引用
收藏
页码：1607 / 1619
相关论文
共 50 条
  • [21] Retrieval augmentation of large language models for lay language generation
    Guo, Yue
    Qiu, Wei
    Leroy, Gondy
    Wang, Sheng
    Cohen, Trevor
    Journal of Biomedical Informatics, 2024, 149
  • [22] Effective test generation using pre-trained Large Language Models and mutation testing
    Dakhel, Arghavan Moradi
    Nikanjam, Amin
    Majdinasab, Vahid
    Khomh, Foutse
    Desmarais, Michel C.
    INFORMATION AND SOFTWARE TECHNOLOGY, 2024, 171
  • [23] Can ChatGPT Support Developers? An Empirical Evaluation of Large Language Models for Code Generation
    Jin, Kailun
    Wang, Chung-Yu
    Hung Viet Pham
    Hemmati, Hadi
    2024 IEEE/ACM 21ST INTERNATIONAL CONFERENCE ON MINING SOFTWARE REPOSITORIES, MSR, 2024, : 167 - 171
  • [24] CODAMOSA: Escaping Coverage Plateaus in Test Generation with Pre-trained Large Language Models
    Lemieux, Caroline
    Inala, Jeevana Priya
    Lahiri, Shuvendu K.
    Sen, Siddhartha
    2023 IEEE/ACM 45TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, ICSE, 2023, : 919 - 931
  • [25] Evaluating Large Language Models on Controlled Generation Tasks
    Sun, Jiao
    Tian, Yufei
    Zhou, Wangchunshu
    Xu, Nan
    Hu, Qian
    Gupta, Rahul
    Wieting, John
    Peng, Nanyun
    Ma, Xuezhe
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING, EMNLP 2023, 2023, : 3155 - 3168
  • [26] Question Generation Capabilities of "Small" Large Language Models
    Berger, Joshua
    Koss, Jonathan
    Stamatakis, Markos
    Hoppe, Anett
    Ewerth, Ralph
    Wartenal, Christian
    NATURAL LANGUAGE PROCESSING AND INFORMATION SYSTEMS, PT II, NLDB 2024, 2024, 14763 : 183 - 194
  • [27] Bootstrapping Large Language Models for Radiology Report Generation
    Liu, Chang
    Tian, Yuanhe
    Chen, Weidong
    Song, Yan
    Zhang, Yongdong
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 17, 2024, : 18635 - 18643
  • [28] StableYolo: Optimizing Image Generation for Large Language Models
    Berger, Harel
    Dakhama, Aidan
    Ding, Zishuo
    Even-Mendoza, Karine
    Kelly, David
    Menendez, Hector
    Moussa, Rebecca
    Sarro, Federica
    SEARCH-BASED SOFTWARE ENGINEERING, SSBSE 2023, 2024, 14415 : 133 - 139
  • [29] CONCEPTUAL DESIGN GENERATION USING LARGE LANGUAGE MODELS
    Ma, Kevin
    Grandi, Daniele
    McComb, Christopher
    Goucher-Lambert, Kosa
    PROCEEDINGS OF ASME 2023 INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, IDETC-CIE2023, VOL 6, 2023,
  • [30] Large language models for causal hypothesis generation in science
    Cohrs, Kai-Hendrik
    Diaz, Emiliano
    Sitokonstantinou, Vasileios
    Varando, Gherardo
    Camps-Valls, Gustau
    MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2025, 6 (01):
12345