Name
Is It Over Now? Why Your Standard Setting Panel Needs Rethinking
Description

Your SME panel is probably the wrong size, and increasing the headcount was never the real fix. This session presents research showing that SME Angoff judgments are only moderately accurate and systematically biased toward the mean. We share practical changes programs can make to their panels today, and demonstrate the research, technology, and process behind a fully automated, AI-driven standard setting workflow, live, on a real item set, not described in a slide.

Primary Topic
Design, Development, and Psychometrics
Session Area
Certification & Licensure (C&L) Division, Education Division, Workforce Skills Credentialing Division, Industrial/Organizational Division, Technology-Based Assessment Committee