Detecting Differential Speededness in Multistage Testing

Linden van der, Wim J. and Breithaupt, Krista and Chuah, Siang Chee and Zhang, Yanwei (2007) Detecting Differential Speededness in Multistage Testing. Journal of Educational Measurement, 44 (2). pp. 117-130. ISSN 0022-0655

PDF
Restricted to UT campus only: Request a copy
137Kb

Abstract:	A potential undesirable effect of multistage testing is differential speededness, which happens if some of the test takers run out of time because they receive subtests with items that are more time intensive than others. This article shows how a probabilistic response-time model can be used for estimating differences in time intensities and speed between subtests and test takers and detecting differential speededness. An empirical data set for a multistage test in the computerized CPA Exam was used to demonstrate the procedures. Although the more difficult subtests appeared to have items that were more time intensive than the easier subtests, an analysis of the residual response times did not reveal any significant differential speededness because the time limit appeared to be appropriate. In a separate analysis, within each of the subtests, we found minor but consistent patterns of residual times that are believed to be due to a warm-up effect, that is, use of more time on the initial items than they actually need.
Item Type:	Article
Copyright:	© 2007 Wiley InterScience
Faculty:	Behavioural Sciences (BS)
Research Group:	Research Methodology, Measurement and Data Analysis (OMD)
Link to this item:	http://purl.utwente.nl/publications/58415
Official URL:	http://dx.doi.org/10.1111/j.1745-3984.2007.00030.x
Export this item as:	BibTeX EndNote HTML Citation Reference Manager

Show download statistics for this publication

Repository Staff Only: item control page

Metis ID: 244355