An Automatic Tool For Language Evaluation

被引:0
|
作者
Fassetti, Fabio [1 ]
Fassetti, Ilaria [1 ]
机构
[1] Univ Calabria, Therapeia Rehabil Ctr, DIMES, Calabria, Italy
关键词
NLP; Language Evaluation; Machine Learning;
D O I
暂无
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The aim of evaluating children speech and language is to measure their communication skills. In particular, the speech language pathologist is interested in determining the child's impairments in the areas of language, articulation, voice, fluency and swallowing. In literature some standardized tests have been proposed to assess and screen developmental language impairments but they require manual laborious transcription, annotation and calculation. This work is very time demanding and, also, may introduce several kinds of errors in the evaluation phase and non-uniform evaluations. In order to help therapists, a system performing automated evaluation is proposed. Providing as input the correct sentence and the sentence produced by patients, the technique evaluates the level of the verbal production and returns a score. The main phases of the method concern an ad-hoc transformation of the produced sentence in the reference sentence and in the evaluation of the cost of this transformation. Since the cost function is related to many weights, a learning phase is defined to automatically set such weights.
引用
收藏
页码:1721 / 1726
页数:6
相关论文
共 50 条
  • [1] LISA - A TOOL FOR AUTOMATIC LANGUAGE IMPLEMENTATION
    MERNIK, M
    KORBAR, N
    ZUMER, V
    SIGPLAN NOTICES, 1995, 30 (04): : 71 - 79
  • [2] Automatic pedagogical evaluation tool
    André, G
    Costa, M
    Metrôlho, JC
    Silva, C
    Tavares, A
    Methods and Technologies for Learning, 2005, : 167 - 171
  • [3] An automatic tool for the analysis of natural language requirements
    Gnesi, S
    Lami, G
    Trentanni, G
    Fabbrini, F
    Fusani, M
    COMPUTER SYSTEMS SCIENCE AND ENGINEERING, 2005, 20 (01): : 53 - 62
  • [4] Evaluation of a German-language tool for measuring positive and negative automatic thoughts in children and adolescents
    Huffziger, Silke
    Meyer, Thomas D.
    Seemann, Simone
    Horn, Andrea B.
    Groen, Gunter
    Poessel, Patrick
    ZEITSCHRIFT FUR KLINISCHE PSYCHOLOGIE UND PSYCHOTHERAPIE, 2008, 37 (04): : 255 - 262
  • [5] Language Agnostic Automatic Summarization Evaluation
    Tauchmann, Christopher
    Mieskes, Margot
    PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2020), 2020, : 6656 - 6662
  • [6] Automatic Evaluation of Fluency in Spoken Language
    Audhkhasi, Kartik
    IETE TECHNICAL REVIEW, 2009, 26 (02) : 108 - 114
  • [7] Automatic evaluation tool for multimodal dialogue systems
    Wesseling, Hugo
    Bezold, Matthias
    Beringer, Nicole
    PERCEPTION IN MULTIMODAL DIALOGUE SYSTEMS, PROCEEDINGS, 2008, 5078 : 297 - 305
  • [8] Evaluation and its resources in automatic language processing
    Paroubek, Patrick
    Mariani, Joseph
    REVUE FRANCAISE DE LINGUISTIQUE APPLIQUEE, 2019, 24 (01): : 95 - 109
  • [9] Automatic Evaluation of Attribution by Large Language Models
    Yue, Xiang
    Wang, Boshi
    Chen, Ziru
    Zhang, Kai
    Su, Yu
    Sun, Huan
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS - EMNLP 2023, 2023, : 4615 - 4635
  • [10] Automatic recognition and evaluation of natural language commands
    Majewski, Maciej
    Kacalak, Wojciech
    ADVANCES IN NEURAL NETWORKS - ISNN 2006, PT 3, PROCEEDINGS, 2006, 3973 : 1155 - 1160