Fast and Furious Item Development: From Pretest to Scored in under 60 days
Track: Test Development and Administration
A diverse and robust item bank is one of the most important aspects of a high-performing test organization whether the focus is Adaptive testing, a security risk mitigation strategy, or other business objectives. However, a major challenge is the length of time it takes from writing a new item to using that new item as a good-performing scored item on an exam form. A cycle time upwards of 24 months is not inconceivable when balancing the timing of item writing events, test publishing cycles, test delivery windows and examinee volume to ensure the appropriate number of exposures. And by that point, organizations run the risk of that new item’s concept becoming obsolete.
The preferred goal is to maximize new item throughput given the aforementioned program constraints.
This session will introduce new concepts and proven effective strategies for creating a fast item development process using a hybrid auto-item generation approach. The psychometric theory used to validate a fast-track item development process will be presented by a PhD psychometrician and results from a real test development implementation will provide attendees with strategies for applying new concepts to their program practices.