Name
Not Your Standard Standard Setting: Item Rating During Item Review
Description

Standard-setting studies are typically conducted late in the exam development lifecycle and require significant planning, coordination, and SME engagement. While the Angoff method remains one of the most widely accepted approaches for establishing defensible cut scores, organizations continue to investigate approaches that streamline the standard-setting process while preserving validity evidence. This presentation examines an alternative methodology that integrates item rating into routine item review and compares the resulting outcomes with those derived from a traditional no-data Angoff. Attendees will gain insight into the potential benefits and limitations of integrating standard-setting activities earlier in the exam development cycle, as test sponsors share their lessons learned. What do you think the data showed? Join this session to learn where an integrated item-review methodology may be appropriate versus those in which a traditional standard-setting remains preferable.

Primary Topic
Design, Development, and Psychometrics
Session Area
Certification & Licensure (C&L) Division