JavaBench: A Benchmark of Object-Oriented Code Generation for Evaluating Large Language Models

被引:0
|
作者
Cao, Jialun [1 ,3 ]
Chen, Zhiyong [2 ]
Wu, Jiarong [1 ,3 ]
Cheung, Shing-Chi [1 ,3 ]
Xu, Chang [2 ]
机构
[1] The Hong Kong University of Science and Technology, Hong Kong, Hong Kong
[2] Nanjing University, Nanjing, China
[3] Guangzhou HKUST Fok Ying Tung, Research Institute, China
基金
美国国家科学基金会;
关键词
Class projects - Codegeneration - [!text type='Java']Java[!/text] codes - Language model - Large language model - Object-oriented code - Objectoriented programming (OOP) - Program synthesis - Project levels - Undergraduate students;
D O I
暂无
中图分类号
学科分类号
摘要
65
引用
收藏
页码:870 / 882
相关论文
共 50 条
  • [21] Code automatic generation based on object-oriented central information repository
    Liu, Manyun
    Chengdu Kejidaxue Xuebao/Journal of Chengdu University of Science and Technology, 2000, 32 (02): : 95 - 96
  • [22] AUTOMATIC GENERATION OF OBJECT-ORIENTED CODE FROM DEVS GRAPHICAL SPECIFICATIONS
    Hamri, M.
    Zacharewicz, G.
    2012 WINTER SIMULATION CONFERENCE (WSC), 2012,
  • [23] A benchmark for parallel object-oriented database systems
    Taniar, D
    INTERNATIONAL SOCIETY FOR COMPUTERS AND THEIR APPLICATIONS 13TH INTERNATIONAL CONFERENCE ON COMPUTERS AND THEIR APPLICATIONS, 1998, : 190 - 193
  • [24] Coordinating mobile object-oriented code
    Bettini, L
    Bono, V
    Venneri, B
    COORDINATION MODELS AND LANGUAGES, PROCEEDINGS, 2002, 2315 : 56 - 71
  • [25] AN OBJECT-ORIENTED ELECTROMAGNETIC PIC CODE
    VERBONCOEUR, JP
    LANGDON, AB
    GLADD, NT
    COMPUTER PHYSICS COMMUNICATIONS, 1995, 87 (1-2) : 199 - 211
  • [26] OBJECT-ORIENTED EDITOR GENERATION
    DEWAN, P
    JOURNAL OF OBJECT-ORIENTED PROGRAMMING, 1990, 3 (02): : 35 - &
  • [27] GENERATING PARALLEL CODE FROM OBJECT-ORIENTED MATHEMATICAL-MODELS
    ANDERSSON, N
    FRITZSON, P
    SIGPLAN NOTICES, 1995, 30 (08): : 48 - 57
  • [28] Object-UOBM: An Ontological Benchmark for Object-Oriented Access
    Ledvinka, Martin
    Kremen, Petr
    KNOWLEDGE ENGINEERING AND SEMANTIC WEB, KESW 2015, 2015, 518 : 132 - 146
  • [29] Code synthesis based on object-oriented design models and formal specifications
    Jia, XP
    Skevoulis, S
    TWENTY-SECOND ANNUAL INTERNATIONAL COMPUTER SOFTWARE & APPLICATIONS CONFERENCE - PROCEEDINGS, 1998, : 393 - 398
  • [30] Binding object models to source code: An approach to object-oriented re-architecting
    Weidl, J
    Gall, H
    TWENTY-SECOND ANNUAL INTERNATIONAL COMPUTER SOFTWARE & APPLICATIONS CONFERENCE - PROCEEDINGS, 1998, : 26 - 31