Evaluation of e-Learning in Vocational Training: Factorial Structure and Reliability

This is an analysis of the effect of e-learning on vocational training, mainly for unemployed people. A questionnaire was administered to 5,265 people who participated in a virtual training programme run in 2009 by the Catalonia Occupation Service and the Open University of Catalonia to improve job skills among the unemployed. Two main contributions resulted. First, an 18-item scale was designed, called COM-AP-SAT-18. Second, the factorial structure and psychometric properties of the scale were analyzed. Three factors emerged from the exploratory factor analysis: skills developped, applicability of training and satisfaction with the programme's pedagogical design. These factors explain 75.1% of the cumulative variance. The reliability coefficients for the three factors are high (alpha(1)=.93; alpha(2) = .92; and alpha(3) = .90). The total scale reliability is .94. The statistics obtained for the confirmatory factor analysis (CFI = 0.94; NNFI = 0.94; RMSEA = 0.08) indicate an acceptable fit of the proposed three-factor model (Chi(2) = 2.416; p = 0.000). The coefficients of the estimates, all of whose values lie between .85 and 1.66, are significant at p < .001. In summary, the structure and psychometric properties of the COM-AP-SAT-18 scale factors have adequate validity and reliability for identifying and evaluating the effect of e-learning on vocational training. The three dimensions found are in line with the classic evidence evaluating the effect of training and are furthermore in line with research in the field of vocational training. Additionally, fresh evidence is provided concerning the particular field of virtual vocational training, mainly for the unemployed, and concerning new dimensions, such as programme structure and pedagogical design.