CONCURRENT VALIDITY OF THE INFORMATION REFERENCED TESTING FORMAT USING MCW-APM SCORING METHODS

The literature has reported many problems associated with the conventional forced-choice (R-W) test scoring system. The impact of guessing on assessment is among the most serious problems cited in the literature. A Modified Confidence Weighted-Admissible Probability Measurement (MCW-APM) scoring systems attempts to eliminate the impact of guessing on assessment by allowing the measurement of partial information. Since this procedure is amenable to optical scoring it is especially suitable for use in computer-based instruction measurement and mass testing by school organizations. The research literature, however, strongly suggests that two dimensional, confidence weighted scoring systems sacrifice test validity for test reliability. This study empirically examines a reproducible, two dimensional, test scoring procedure (MCW-APM) and finds that concurrent validity is enhanced - especially for difficult items or when tests are used with low and medium attaining students. The findings of this study strongly suggest that the reproducible nature of a scoring system used on a test might impact in a positive manner on both the validity and reliability of a test.