An Automatic Tool For Language Evaluation

被引:0
|
作者
Fassetti, Fabio [1 ]
Fassetti, Ilaria [1 ]
机构
[1] Univ Calabria, Therapeia Rehabil Ctr, DIMES, Calabria, Italy
关键词
NLP; Language Evaluation; Machine Learning;
D O I
暂无
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The aim of evaluating children speech and language is to measure their communication skills. In particular, the speech language pathologist is interested in determining the child's impairments in the areas of language, articulation, voice, fluency and swallowing. In literature some standardized tests have been proposed to assess and screen developmental language impairments but they require manual laborious transcription, annotation and calculation. This work is very time demanding and, also, may introduce several kinds of errors in the evaluation phase and non-uniform evaluations. In order to help therapists, a system performing automated evaluation is proposed. Providing as input the correct sentence and the sentence produced by patients, the technique evaluates the level of the verbal production and returns a score. The main phases of the method concern an ad-hoc transformation of the produced sentence in the reference sentence and in the evaluation of the cost of this transformation. Since the cost function is related to many weights, a learning phase is defined to automatically set such weights.
引用
收藏
页码:1721 / 1726
页数:6
相关论文
共 50 条
  • [41] A Closer Look into Automatic Evaluation Using Large Language Models
    Chiang, Cheng-Han
    Lee, Hung-yi
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EMNLP 2023), 2023, : 8928 - 8942
  • [42] Improving Automatic VQA Evaluation Using Large Language Models
    Manas, Oscar
    Krojer, Benno
    Agrawal, Aishwarya
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 5, 2024, : 4171 - 4179
  • [43] Automatic Large Language Model Evaluation via Peer Review
    Chu, Zhumin
    Ai, Qingyao
    Tu, Yiteng
    Li, Haitao
    Liu, Yiqun
    PROCEEDINGS OF THE 33RD ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2024, 2024, : 384 - 393
  • [44] Language identification, a tool at the service of Corsican and the evaluation of linguistic resources
    Kevers, Laurent
    TRAITEMENT AUTOMATIQUE DES LANGUES, 2021, 62 (03): : 13 - 37
  • [45] eELP:: European Electronic Language Portfolio -: a didactic and evaluation tool
    Mighetto, D
    Söhrman, I
    MODERNA SPRAK, 2006, 100 (01): : 142 - 156
  • [46] Evaluation of a Generative Language Model Tool for Writing Examination Questions
    Edwards, Christopher J.
    Erstad, Brian L.
    AMERICAN JOURNAL OF PHARMACEUTICAL EDUCATION, 2024, 88 (04)
  • [47] Empirical evaluation of a threat modeling language as a cybersecurity assessment tool
    Katsikeas, Sotirios
    Ling, Engla Rencelj
    Johnsson, Pontus
    Ekstedt, Mathias
    COMPUTERS & SECURITY, 2024, 140
  • [48] Automatic articulation error detection tool for Punjabi language with aid for hearing impaired people
    Singh, Shailendra
    Thakur, Anshul
    Vir, Dharam
    INTERNATIONAL JOURNAL OF SPEECH TECHNOLOGY, 2015, 18 (02) : 143 - 156
  • [49] Multislice CT coronary angiography: Evaluation of an automatic vessel detection tool
    Dewey, M
    Schnapauff, D
    Laule, M
    Lembcke, A
    Borges, AC
    Rutsch, W
    Hamm, B
    Rogalla, P
    ROFO-FORTSCHRITTE AUF DEM GEBIET DER RONTGENSTRAHLEN UND DER BILDGEBENDEN VERFAHREN, 2004, 176 (04): : 478 - 483
  • [50] ABOP, the automatic patient information leaflet optimizer: Evaluation of a tool in development
    Franck, Maarten Charles J.
    Foulon, Veerle
    Van Vaerenbergh, Leona
    PATIENT EDUCATION AND COUNSELING, 2011, 83 (03) : 411 - 416