Name
Let AI be the Judge? Rating the Success of Automated Item Review
Nathan Thompson
Description
Item review is essential but expensive, possibly doubling the SME effort per item. This session explores how AI and automation can reduce costs without compromising quality. One speaker presents research comparing GPT-4.1 to human reviewers. Another speaker shares real-world examples of how AI tools are already streamlining item review in high-stakes programs. You’ll hear about practical challenges and solutions and learn how AI-powered feedback is speeding up review cycles and improving reliability. Whether you're evaluating AI tools or looking to boost your exam development efficiency, this session offers evidence, insights, and take-home ideas you can apply right away.
Session Type
Presentation
Session Area
Certification/Licensure, Education, Industrial/Organizational, Workforce Skills Credentialing
Primary Topic
Test Development and Psychometrics