On the Evaluation of Large Language Models in Unit Test Generation

被引：0
|
作者：
Yang, Lin [1 ]
Yang, Chen [1 ]
Gao, Shutao [2 ]
Wang, Weijing [1 ]
Wang, Bo [3 ]
Zhu, Qihao [4 ]
Chu, Xiao [5 ]
Zhou, Jianyi [5 ]
Liang, Guangtai [5 ]
Wang, Qianxiang [5 ]
Chen, Junjie [1 ]
机构：
[1] College of Intelligence and Computing, Tianjin University, China
[2] School of Future Technology, Tianjin University, China
[3] School of Computer and Information Technology, Beijing Jiaotong University, China
[4] Key Laboratory of HCST, MoE DCST, Peking University, China
[5] Huawei Cloud Computing Co. Ltd., China
来源：
Proceedings - 2024 39th ACM/IEEE International Conference on Automated Software Engineering, ASE 2024 |
关键词：
Compendex;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
Software design
引用
收藏
页码：1607 / 1619
相关论文
共 50 条
  • [31] Toward Keyword Generation through Large Language Models
    Lee, Wanhae
    Chun, Minki
    Jeong, Hyeonhak
    Jung, Hyunggu
    COMPANION PROCEEDINGS OF 2023 28TH ANNUAL CONFERENCE ON INTELLIGENT USER INTERFACES, IUI 2023 COMPANION, 2023, : 37 - 40
  • [32] Large language models and rheumatology: a comparative evaluation
    Venerito, Vincenzo
    Puttaswamy, Darshan
    Iannone, Florenzo
    Gupta, Latika
    LANCET RHEUMATOLOGY, 2023, 5 (10): : E574 - E578
  • [33] Automatic Evaluation of Attribution by Large Language Models
    Yue, Xiang
    Wang, Boshi
    Chen, Ziru
    Zhang, Kai
    Su, Yu
    Sun, Huan
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS - EMNLP 2023, 2023, : 4615 - 4635
  • [34] Autoregressive Self-Evaluation: A Case Study of Music Generation Using Large Language Models
    Banat, Rerker
    Colton, Simon
    2023 IEEE CONFERENCE ON ARTIFICIAL INTELLIGENCE, CAI, 2023, : 264 - 265
  • [35] Natural Language Dataset Generation Framework for Visualizations Powered by Large Language Models
    Ko, Hyung-Kwon
    Jeon, Hyeon
    Park, Gwanmo
    Kim, Dae Hyun
    Kim, Nam Wook
    Kim, Juho
    Seo, Jinwook
    PROCEEDINGS OF THE 2024 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYTEMS (CHI 2024), 2024,
  • [36] Grammar Prompting for Domain-Specific Language Generation with Large Language Models
    Wang, Bailin
    Wang, Zi
    Wang, Xuezhi
    Cao, Yuan
    Saurous, Rif A.
    Kim, Yoon
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [37] Exploring Large Language Models for Verilog hardware design generation
    D'Hollander, Erik H.
    Danneels, Ewout
    Decorte, Karel-Brecht
    Loobuyck, Senne
    Vanheule, Ame
    Van Kets, Ian
    Stroobandt, Dirk
    2024 IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS, IPDPSW 2024, 2024, : 111 - 115
  • [38] PassGPT: Password Modeling and (Guided) Generation with Large Language Models
    Rando, Javier
    Perez-Cruz, Fernando
    Hitaj, Briland
    COMPUTER SECURITY - ESORICS 2023, PT IV, 2024, 14347 : 164 - 183
  • [39] A Comparative Analysis of Large Language Models for Code Documentation Generation
    Dvivedi, Shubhang Shekhar
    Vijay, Vyshnav
    Pujari, Sai Leela Rahul
    Lodh, Shoumik
    Kumar, Dhruv
    PROCEEDINGS OF THE 1ST ACM INTERNATIONAL CONFERENCE ON AI-POWERED SOFTWARE, AIWARE 2024, 2024, : 65 - 73
  • [40] BioCoder: a benchmark for bioinformatics code generation with large language models
    Tang, Xiangru
    Qian, Bill
    Gao, Rick
    Chen, Jiakang
    Chen, Xinyun
    Gerstein, Mark B.
    BIOINFORMATICS, 2024, 40 : i266 - i276
12345