JavaBench: A Benchmark of Object-Oriented Code Generation for Evaluating Large Language Models

被引：0
|
作者：
Cao, Jialun [1 ,3 ]
Chen, Zhiyong [2 ]
Wu, Jiarong [1 ,3 ]
Cheung, Shing-Chi [1 ,3 ]
Xu, Chang [2 ]
机构：
[1] The Hong Kong University of Science and Technology, Hong Kong, Hong Kong
[2] Nanjing University, Nanjing, China
[3] Guangzhou HKUST Fok Ying Tung, Research Institute, China
来源：
Proceedings - 2024 39th ACM/IEEE International Conference on Automated Software Engineering, ASE 2024 |
基金：
美国国家科学基金会;
关键词：
Class projects - Codegeneration - [!text type='Java']Java[!/text] codes - Language model - Large language model - Object-oriented code - Objectoriented programming (OOP) - Program synthesis - Project levels - Undergraduate students;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
65
引用
收藏
页码：870 / 882
相关论文
共 50 条
  • [31] Generation of adaptive models with the use of object-oriented programming facilities
    Rogoza, V. S.
    Lupko, L. A.
    Radioelectronics and Communications Systems, 1994, 37 (06):
  • [32] An AQUA-based intermediate language for evaluating an active deductive object-oriented language
    Siddabathuni, B
    Dietrich, SW
    Urban, SD
    PRACTICAL ASPECTS OF DECLARATIVE LANGUAGES, 1999, 1551 : 164 - 178
  • [33] Utilization of object-oriented models
    Philippow, Ilka
    Advances in Automation, Multimedia and Video Systems, and Modern Computer Science, 2001, : 211 - 216
  • [34] A criteria for evaluating object-oriented methodologies
    Samouti, A
    Alshawi, S
    SYSTEMS RESEARCH AND INFORMATION SCIENCE, 1996, 7 (02): : 83 - 90
  • [35] EVALUATING OBJECT-ORIENTED QUERY LANGUAGES
    CHAN, DKC
    TRINDER, PW
    WELLAND, RC
    COMPUTER JOURNAL, 1994, 37 (10): : 858 - 872
  • [36] Evaluating object-oriented query languages
    Chan, Daniel K.C., 1600, Oxford Univ Press, Oxford (37):
  • [37] A Criteria for Evaluating Object-Oriented Methodologies
    Systems Research and Information Science, 7 (02):
  • [38] Evaluating the effect of inheritance on the modifiability of object-oriented business domain models
    Poels, G
    Dedene, G
    FIFTH EUROPEAN CONFERENCE ON SOFTWARE MAINTENANCE AND REENGINEERING, PROCEEDINGS, 2001, : 20 - 29
  • [39] A framework for evaluating the effectiveness of real-time object-oriented models
    Kumarakulasingam, P
    Saiedian, H
    INFORMATION AND SOFTWARE TECHNOLOGY, 2002, 44 (07) : 395 - 404
  • [40] VHDL-Eval: A Framework for Evaluating Large Language Models in VHDL Code Generation
    Vijayaraghavan, Prashanth
    Shi, Luyao
    Ambrogio, Stefano
    Mackin, Charles
    Nitsure, Apoorva
    Beymer, David
    Degan, Ehsan
    2024 IEEE LLM AIDED DESIGN WORKSHOP, LAD 2024, 2024,
12345