Infeasibility in automated test assembly models: A comparison study of different method


Huitzing, Hiddo A. and Veldkamp, Bernard P. and Verschoor, Angela J. (2005) Infeasibility in automated test assembly models: A comparison study of different method. Journal of educational measurement, 42 (3). pp. 223-243. ISSN 0022-0655

[img] PDF
Restricted to UT campus only
: Request a copy
Abstract:Several techniques exist to automatically put together a test meeting a number of specifications. In an item bank, the items are stored with their characteristics. A test is constructed by selecting a set of items that fulfills the specifications set by the test assembler. Test assembly problems are often formulated in terms of a model consisting of restrictions and an objective to be maximized or minimized. A problem arises when it is impossible to construct a test from the item pool that meets all specifications, that is, when the model is not feasible. Several methods exist to handle these infeasibility problems. In this article, test assembly models resulting from two practical testing programs were reconstructed to be infeasible. These models were analyzed using methods that forced a solution (Goal Programming, Multiple-Goal Programming, Greedy Heuristic), that analyzed the causes (Relaxed and Ordered Deletion Algorithm (RODA), Integer Randomized Deletion Algorithm (IRDA), Set Covering (SC), and Item Sampling), or that analyzed the causes and used this information to force a solution (Irreducible Infeasible Set-Solver). Specialized methods such as the IRDA and the Irreducible Infeasible Set-Solver performed best. Recommendations about the use of different methods are given.
Item Type:Article
Copyright:© 2005 Wiley InterScience
Faculty of Behavioural, Management and Social sciences (BMS)
Research Group:
Link to this item:
Official URL:
Export this item as:BibTeX
HTML Citation
Reference Manager


Repository Staff Only: item control page

Metis ID: 225572