On the Evaluation of Large Language Models in Unit Test Generation

被引:0
|
作者
Yang, Lin [1 ]
Yang, Chen [1 ]
Gao, Shutao [2 ]
Wang, Weijing [1 ]
Wang, Bo [3 ]
Zhu, Qihao [4 ]
Chu, Xiao [5 ]
Zhou, Jianyi [5 ]
Liang, Guangtai [5 ]
Wang, Qianxiang [5 ]
Chen, Junjie [1 ]
机构
[1] College of Intelligence and Computing, Tianjin University, China
[2] School of Future Technology, Tianjin University, China
[3] School of Computer and Information Technology, Beijing Jiaotong University, China
[4] Key Laboratory of HCST, MoE DCST, Peking University, China
[5] Huawei Cloud Computing Co. Ltd., China
关键词
Compendex;
D O I
暂无
中图分类号
学科分类号
摘要
Software design
引用
收藏
页码:1607 / 1619
相关论文
共 50 条
  • [11] Test Generation for Large Automotive Models
    Venkatesh, R.
    Shrotri, Ulka
    Darke, Priyanka
    Bokil, Prasad
    2012 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY (ICIT), 2012, : 662 - 667
  • [12] FormalEval: A Method for Automatic Evaluation of Code Generation via Large Language Models
    Yang, Sichao
    Yang, Ye
    2024 INTERNATIONAL SYMPOSIUM OF ELECTRONICS DESIGN AUTOMATION, ISEDA 2024, 2024, : 660 - 665
  • [13] Generation and Evaluation of Synthetic Critical Care Progress Notes With Large Language Models
    Leding, B.
    Gao, Y.
    Dligach, D.
    Croxford, E.
    Mayampurath, A.
    Churpek, M. M.
    Afshar, M.
    AMERICAN JOURNAL OF RESPIRATORY AND CRITICAL CARE MEDICINE, 2024, 209
  • [14] Assessing the proficiency of large language models in automatic feedback generation: An evaluation study
    Dai, Wei
    Tsai, Yi-Shan
    Lin, Jionghao
    Aldino, Ahmad
    Jin, Hua
    Li, Tongguang
    Gašević, Dragan
    Chen, Guanliang
    Computers and Education: Artificial Intelligence, 2024, 7
  • [15] A Survey on Evaluation of Large Language Models
    Chang, Yupeng
    Wang, Xu
    Wang, Jindong
    Wu, Yuan
    Yang, Linyi
    Zhu, Kaijie
    Chen, Hao
    Yi, Xiaoyuan
    Wang, Cunxiang
    Wang, Yidong
    Ye, Wei
    Zhang, Yue
    Chang, Yi
    Yu, Philip S.
    Yang, Qiang
    Xie, Xing
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2024, 15 (03)
  • [16] Game Generation via Large Language Models
    Hu, Chengpeng
    Zhao, Yunlong
    Liu, Jialin
    2024 IEEE CONFERENCE ON GAMES, COG 2024, 2024,
  • [17] Level Generation Through Large Language Models
    Todd, Graham
    Earle, Sam
    Nasir, Muhammad Umair
    Green, Michael Cerny
    Togelius, Julian
    PROCEEDINGS OF THE 18TH INTERNATIONAL CONFERENCE ON THE FOUNDATIONS OF DIGITAL GAMES, FDG 2023, 2023,
  • [18] On the Capacity of Citation Generation by Large Language Models
    Qian, Haosheng
    Fan, Yixing
    Zhang, Ruqing
    Guo, Jiafeng
    INFORMATION RETRIEVAL, CCIR 2024, 2025, 15418 : 109 - 123
  • [19] Large Language Models and the Reverse Turing Test
    Sejnowski, Terrence J.
    NEURAL COMPUTATION, 2023, 35 (03) : 309 - 342
  • [20] Retrieval augmentation of large language models for lay language generation
    Guo, Yue
    Qiu, Wei
    Leroy, Gondy
    Wang, Sheng
    Cohen, Trevor
    JOURNAL OF BIOMEDICAL INFORMATICS, 2024, 149