Multiple Evaluation: A New Testing Paradigm That Exorcizes Guessing

Dirkzwager, Arie (2003) Multiple Evaluation: A New Testing Paradigm That Exorcizes Guessing. International Journal of Testing, 3 (4). pp. 333-352. ISSN 1530-5058

PDF
Restricted to UT campus only: Request a copy
1734Kb

Abstract:	The crux in psychometrics is how to estimate the probability that a respondent answers an item correctly on one occasion out of many. Under the current testing paradigm this probability is estimated using all kinds of statistical techniques and mathematical modeling. Multiple evaluation is a new testing paradigm using the person's own personal estimates of these probabilities as data. It is compared to multiple choice, which appears to be a degenerated form of multiple evaluation. Multiple evaluation has much less measurement error than multiple choice, and this measurement error is not in favor of the examinee. When the test is used for selection purposes as it is with multiple choice, the probability of a Type II error (unjustified passes) is almost negligible. Procedures for statistical item-and-test analyses under the multiple evaluation paradigm are presented. These procedures provide more accurate information in comparison to what is possible under the multiple choice paradigm. A computer program that implements multiple evaluation is also discussed.
Item Type:	Article
Copyright:	© 2003 Lawrence Erlbaum Associates
Link to this item:	http://purl.utwente.nl/publications/58640
Official URL:	http://dx.doi.org/10.1207/S15327574IJT0304_3
Export this item as:	BibTeX EndNote HTML Citation Reference Manager

Show download statistics for this publication

Repository Staff Only: item control page