JavaBench: A Benchmark of Object-Oriented Code Generation for Evaluating Large Language Models

被引：0
|
作者：
Cao, Jialun [1 ,3 ]
Chen, Zhiyong [2 ]
Wu, Jiarong [1 ,3 ]
Cheung, Shing-Chi [1 ,3 ]
Xu, Chang [2 ]
机构：
[1] The Hong Kong University of Science and Technology, Hong Kong, Hong Kong
[2] Nanjing University, Nanjing, China
[3] Guangzhou HKUST Fok Ying Tung, Research Institute, China
来源：
Proceedings - 2024 39th ACM/IEEE International Conference on Automated Software Engineering, ASE 2024 |
基金：
美国国家科学基金会;
关键词：
Class projects - Codegeneration - [!text type='Java']Java[!/text] codes - Language model - Large language model - Object-oriented code - Objectoriented programming (OOP) - Program synthesis - Project levels - Undergraduate students;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
65
引用
收藏
页码：870 / 882
相关论文
共 50 条
  • [41] Semiautomatic generation of Web courses by means of an object-oriented simulation language
    Alfonseca, M
    de Lara, J
    Pulido, E
    SIMULATION, 1999, 73 (01) : 5 - 12
  • [42] A specialization of object-oriented design for the fourth generation language, business environment
    Lee, R
    Leigh, W
    JOURNAL OF COMPUTER INFORMATION SYSTEMS, 1998, 38 (03) : 93 - 98
  • [43] A specialization of object-oriented design for the fourth generation language, business environment
    Central Michigan University, Mount Pleasant, MI 48859, United States
    不详
    Journal of Computer Information Systems, 38 (03): : 93 - 97
  • [44] Establishing vocabulary tests as a benchmark for evaluating large language models
    Martinez, Gonzalo
    Conde, Javier
    Merino-Gomez, Elena
    Bermudez-Margaretto, Beatriz
    Hernandez, Jose Alberto
    Reviriego, Pedro
    Brysbaert, Marc
    PLOS ONE, 2024, 19 (12):
  • [45] L2CEval: Evaluating Language-to-Code Generation Capabilities of Large Language Models
    Ni, Ansong
    Yin, Pengcheng
    Zhao, Yilun
    Riddell, Martin
    Feng, Troy
    Shen, Rui
    Yin, Stephen
    Liu, Ye
    Yavuz, Semih
    Xiong, Caiming
    Joty, Shafiq
    Zhou, Yingbo
    Radev, Dragomir
    Cohan, Arman
    TRANSACTIONS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, 2024, 12 : 1311 - 1329
  • [46] Object-oriented design abstractions and code generation front ends to CAD systems
    Needham, DM
    Peters, TJ
    Demurjian, SA
    PRODUCT MODELING FOR COMPUTER INTEGRATED DESIGN AND MANUFACTURE, 1997, : 43 - 53
  • [47] A design unit based code generation technique for object-oriented software development
    Kim, J
    Kim, Y
    Carlson, CR
    COMPUTERS AND THEIR APPLICATIONS, 2000, : 237 - 240
  • [48] Simulation code generation on WWW using object-oriented manufacturing resource model
    Lee, S
    NETWORK INTELLIGENCE: INTERNET-BASED MANUFACTURING, 2000, 4208 : 84 - 95
  • [49] OBJECT-ORIENTED LANGUAGE FEELS NATURAL
    JOHNSON, RC
    ELECTRONICS, 1981, 54 (15): : 104 - &
  • [50] OOCSMP: An object-oriented simulation language
    Alfonseca, M
    Pulido, E
    Orosco, R
    de Lara, J
    SIMULATION IN INDUSTRY: 9TH EUROPEAN SIMULATION SYMPOSIUM 1997, 1997, : 44 - 48
12345