Usability Testing of a Digital Competence Assessment and Certification System

This research study is based on conducted usability evaluation of the CRISS system, which is a cloud-based system for acquisition, evaluation and certification of digital competence in primary and secondary schools, scalable to other educational levels. The usability evaluation included a combination of tasks completion and questionnaires to collect mostly quantitative, but also qualitative data in order to improve the existing system and give some guidelines for future development of systems with similar scope. In total, 14 teachers and 19 students from primary and secondary schools participated in the evaluation. The results revealed that the effectiveness score of the CRISS system was 97% and 94% on behalf of students and teachers, respectively. One of the efficiency measures showed that in average teachers spent 1.7 min, while students spent 1.5 min per task, but it should be bear in mind that they also had differently assigned tasks. Findings showed no significant differences in score ratings of overall task ease, task time and satisfaction with the system performance.