Intelligent Program Correction and Evaluation System

被引:0
|
作者
Ganguli, Isha [1 ]
Bhowmick, Rajat Subhra [2 ]
Biswas, Shivam [2 ]
Sil, Jaya [2 ]
机构
[1] Bennett Univ, Sch Comp Sci Engn & Technol, Greater Noida 201310, India
[2] Indian Inst Engn Sci & Technol, Dept Comp Sci & Technol, Sibpur 711103, India
关键词
!text type='Python']Python[!/text] coding; automatic correction of code; automatic code evaluation; T5 transformer network; eLearning; deep learning; NEURAL-NETWORKS;
D O I
10.1142/S0218213023500719
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The growing popularity of computing applications has sparked the interest of students in computer programming languages. Minor mistakes are prevalent while writing small code blocks due to the coder's lack of knowledge and carelessness. Instead of merely providing syntax warnings, it would be better to offer developers with an Integrated Development Environment (IDE) that can automatically correct short code blocks containing mistakes. This makes code composition easier and more time-efficient, thus improving the efficacy of large-scale development environments. Because Python is becoming more popular, the goal of our study is to enhance the efficiency of writing Python code by offering an automatic code-correcting approach. Furthermore, automatic program evaluation has been performed to assist in the debugging of small code blocks, which will ultimately be employed in the creation of real-time computer applications. The proposed technique would be useful for new learners who wish to create small Python code blocks for ease of writing and debugging on online platforms (like edX, Coursera, and Udacity). One of the major contributions of the project is to create an erroneous dataset of Python coding that contains all potential forms of probable syntax errors. The dataset induces variety through the use of multiple coding templates and is used to train deep learning models. We used the state-of-the-art text-to-text T5 transformer network model to automatically repair and evaluate the incorrect code. The outcomes of auto-correction are examined using the ROUGE and BLEU scores, as well as accuracy. The model corrects Python code with single, double, and the multiple number of errors with greater than 80% accuracy. Similarly, the performance of the basic T5 transformer network for program auto-evaluation with and without mistakes has been examined, and the model achieves greater than 65% accuracy in both cases. The proposed T5 base transformer outperforms the SOTA auto-correction models in terms of accuracy, according to a comparison study of the proposed method with the earlier techniques for auto-correcting codes.
引用
收藏
页数:28
相关论文
共 50 条
  • [1] System for Posture Evaluation and Correction Development of a Second Prototype for an Intelligent Chair
    Pereira, Hugo
    Martins, Leonardo
    Almeida, Rui
    Ribeiro, Bruno
    Quaresma, Claudia
    Ferreira, Adelaide
    Vieira, Pedro
    BIODEVICES: PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON BIOMEDICAL ELECTRONICS AND DEVICES, 2015, : 204 - 209
  • [2] PROGRAM-EVALUATION IN CORRECTION
    GIBBONS, DC
    LEBOWITZ, BD
    BLAKE, GF
    CRIME & DELINQUENCY, 1976, 22 (03) : 309 - 321
  • [3] SPELLING CORRECTION FOR AN INTELLIGENT TUTORING SYSTEM
    LEE, YH
    EVENS, M
    MICHAEL, JA
    ROVICK, AA
    LECTURE NOTES IN COMPUTER SCIENCE, 1991, 507 : 77 - 83
  • [4] An intelligent tutoring system for program semantics
    Barker, S
    Douglas, P
    ITCC 2005: International Conference on Information Technology: Coding and Computing, Vol 1, 2005, : 482 - 487
  • [5] Intelligent Access Program: System Architecture
    Ma, Jian Christina
    Karl, Charles A.
    Dyukov, Andriy
    2009 IEEE INTELLIGENT VEHICLES SYMPOSIUM, VOLS 1 AND 2, 2009, : 1227 - 1231
  • [6] DESIGN AND TEST FOR INTELLIGENT EVALUATION OF INTELLIGENT SYSTEM
    Liu, Dong
    You, Ke
    INTERNATIONAL SYMPOSIUM ON COMPUTER SCIENCE & TECHNOLOGY, PROCEEDINGS, 2009, : 20 - 23
  • [7] Evaluation of Intelligent Information System
    Liu, Wenhong
    Li, Yong
    Huang, Bo
    2022 IEEE 22ND INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY, AND SECURITY COMPANION, QRS-C, 2022, : 183 - 188
  • [8] EVALUATION OF AN INTELLIGENT SEAT SYSTEM
    NG, D
    CASSAR, T
    GROSS, CM
    APPLIED ERGONOMICS, 1995, 26 (02) : 109 - 116
  • [9] INTELLIGENT SYSTEM PREPARING STUDY PROGRAM FOR STUDENT
    Bayraktar, Duygu Mutlu
    INTED2012: INTERNATIONAL TECHNOLOGY, EDUCATION AND DEVELOPMENT CONFERENCE, 2012, : 2160 - 2166