Intelligent Program Correction and Evaluation System

被引:0
|
作者
Ganguli, Isha [1 ]
Bhowmick, Rajat Subhra [2 ]
Biswas, Shivam [2 ]
Sil, Jaya [2 ]
机构
[1] Bennett Univ, Sch Comp Sci Engn & Technol, Greater Noida 201310, India
[2] Indian Inst Engn Sci & Technol, Dept Comp Sci & Technol, Sibpur 711103, India
关键词
!text type='Python']Python[!/text] coding; automatic correction of code; automatic code evaluation; T5 transformer network; eLearning; deep learning; NEURAL-NETWORKS;
D O I
10.1142/S0218213023500719
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The growing popularity of computing applications has sparked the interest of students in computer programming languages. Minor mistakes are prevalent while writing small code blocks due to the coder's lack of knowledge and carelessness. Instead of merely providing syntax warnings, it would be better to offer developers with an Integrated Development Environment (IDE) that can automatically correct short code blocks containing mistakes. This makes code composition easier and more time-efficient, thus improving the efficacy of large-scale development environments. Because Python is becoming more popular, the goal of our study is to enhance the efficiency of writing Python code by offering an automatic code-correcting approach. Furthermore, automatic program evaluation has been performed to assist in the debugging of small code blocks, which will ultimately be employed in the creation of real-time computer applications. The proposed technique would be useful for new learners who wish to create small Python code blocks for ease of writing and debugging on online platforms (like edX, Coursera, and Udacity). One of the major contributions of the project is to create an erroneous dataset of Python coding that contains all potential forms of probable syntax errors. The dataset induces variety through the use of multiple coding templates and is used to train deep learning models. We used the state-of-the-art text-to-text T5 transformer network model to automatically repair and evaluate the incorrect code. The outcomes of auto-correction are examined using the ROUGE and BLEU scores, as well as accuracy. The model corrects Python code with single, double, and the multiple number of errors with greater than 80% accuracy. Similarly, the performance of the basic T5 transformer network for program auto-evaluation with and without mistakes has been examined, and the model achieves greater than 65% accuracy in both cases. The proposed T5 base transformer outperforms the SOTA auto-correction models in terms of accuracy, according to a comparison study of the proposed method with the earlier techniques for auto-correcting codes.
引用
收藏
页数:28
相关论文
共 50 条
  • [21] Fuzzy Evaluation System: Intelligent Speech Assessment System
    Zourmand, Alireza
    Nong, Ting Hua
    2018 IEEE CONFERENCE ON SYSTEMS, PROCESS AND CONTROL (ICSPC), 2018, : 66 - 71
  • [22] A program plagiarism evaluation system
    Kim, YC
    Choi, J
    COMPUTATIONAL SCIENCE AND ITS APPLICATIONS - ICCSA 2005, VOL 4, PROCEEDINGS, 2005, 3483 : 10 - 19
  • [23] Panoramic Image Correction Study of Intelligent Video Surveillance System
    Gu, Lingkang
    Zhou, Mingzheng
    PROCEEDINGS OF 2010 INTERNATIONAL SYMPOSIUM ON IMAGE ANALYSIS AND SIGNAL PROCESSING, 2010, : 343 - 346
  • [24] AN INTELLIGENT SUPPORT SYSTEM FOR EVALUATION ITEMS DEVELOPMENT
    Capatana, Gh.
    Bragaru, T.
    Beldiga, M.
    Beldiga, A.
    2015 20TH INTERNATIONAL CONFERENCE ON CONTROL SYSTEMS AND COMPUTER SCIENCE, 2015, : 424 - 427
  • [25] Evaluation of Intelligent Transportation System in Security Consideration
    Basargan, Hakan
    Zsolt, Szalay
    Torok, Arpad
    TRANSBALTICA XI: TRANSPORTATION SCIENCE AND TECHNOLOGY, 2020, : 273 - 282
  • [26] A study on performance evaluation of intelligent collaboration system
    Kim, Jeongyeon
    Kim, Yanghoon
    Chang, Hangbae
    MULTIMEDIA TOOLS AND APPLICATIONS, 2015, 74 (10) : 3305 - 3316
  • [27] Student Evaluation Design of Intelligent Teaching System
    Ge, Jia
    Zhou, Guoliang
    ICFCSE 2011: 2011 INTERNATIONAL CONFERENCE ON FUTURE COMPUTER SUPPORTED EDUCATION, VOL 1, 2011, : 282 - 285
  • [28] An intelligent system based usability evaluation metric
    Chang, EJ
    Dillon, TS
    Cook, D
    INTELLIGENT INFORMATION SYSTEMS, (IIS'97) PROCEEDINGS, 1997, : 218 - 226
  • [29] Intelligent Transportation System Protocol Interoperability Evaluation
    Vogt, Jonas
    Schotten, Hans D.
    Wieker, Horst
    IEEE OPEN JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS, 2025, 6 : 67 - 94
  • [30] Evaluation and Testing of an Intelligent Methane Detecting System
    Zhang Xuhui
    CEIS 2011, 2011, 15