How Good is Good Enough? Standard Setting for Performance Exams
Track: Test Development and Administration
How performance tests are scored impacts the options available for setting passing standards. Decisions about whether compensation across cases is allowed or whether individual cases are passed/failed and whether some actions are fatal (i.e., trap-door or gated items) will have game-changing implications for standard setting. Those setting passing standards for performance exams must recognize the difference between minimally-competent handling of a given case and the classic Angoff-style question of "How would the minimally-competent person perform on this case?"
This presentation will address both the psychometric and practical aspects of these complex decisions using data from the National Registry of EMTs' psychomotor examinations. Their experience with setting passing standards for performance tests will inform the discussion of the practical implications of different approaches.