Multiple Evaluation: A New Testing Paradigm That Exorcizes Guessing


Dirkzwager, Arie (2003) Multiple Evaluation: A New Testing Paradigm That Exorcizes Guessing. International Journal of Testing, 3 (4). pp. 333-352. ISSN 1530-5058

[img] PDF
Restricted to UT campus only
: Request a copy
Abstract:The crux in psychometrics is how to estimate the probability that a respondent answers an item correctly on one occasion out of many. Under the current testing paradigm this probability is estimated using all kinds of statistical techniques and mathematical modeling. Multiple evaluation is a new testing paradigm using the person's own personal estimates of these probabilities as data. It is compared to multiple choice, which appears to be a degenerated form of multiple evaluation. Multiple evaluation has much less measurement error than multiple choice, and this measurement error is not in favor of the examinee. When the test is used for selection purposes as it is with multiple choice, the probability of a Type II error (unjustified passes) is almost negligible. Procedures for statistical item-and-test analyses under the multiple evaluation paradigm are presented. These procedures provide more accurate information in comparison to what is possible under the multiple choice paradigm. A computer program that implements multiple evaluation is also discussed.

Item Type:Article
Copyright:© 2003 Lawrence Erlbaum Associates
Link to this item:
Official URL:
Export this item as:BibTeX
HTML Citation
Reference Manager


Repository Staff Only: item control page