Is your pretest process on the cutting edge or the chopping block?
Track: Test Development and Administration
A challenge that many credentialing professionals face in the development process of high-stakes certifications is the desire to maximize new item throughput while being constrained by a host of external factors. These hindering factors include candidate volume, exam delivery schedules, and fast-paced industry changes, among others.
In this session, the presenters will describe their own analysis of one organization’s pretesting strategy to identify constraints in the process and to develop strategies for pretesting items more quickly, thus allowing their item bank to grow more quickly and to ensure that their exams are at the cutting edge of industry trends. After discussion of the challenges that were identified, new strategies and opportunities for process improvement will be introduced with real, applicable suggestions for implementation across different organizations. These will include:
- virtual item writing
- “hybrid” automated item generation
- remote SME item review and approval
- developing test publishing schedule based on candidate forecast
- considerations for minimum exposures to meet psychometric standards
- “rolling” pretest tails to allow a more agile process
This session will aim to challenge participants to look at their own processes and help them identify areas where they can improve and expedite the process. Real examples will be provided with suggestions for easy implementation.