As tests become more complex with the inclusion of clinical or situational judgement items, polytomous scored items, case studies, and other innovative response formats, so does material preparation, SME judgements, cut score feedback, and validation techniques. What can exam programs do to work smarter, not harder when conducting standard setting? Given how easily standard settings go awry, we have some tips, tricks and strategies to make your next standard setting run smoothly. This advice will include examples python tools to optimize and automate meeting preparation materials, an enhanced visual display mode to help your SMEs better perceive an item’s difficulty at different score points, data visualization techniques for SME feedback, and machine learning cut score validation techniques. Don’t believe us? We have tried it and have real examples and SME feedback. Our SMEs went from worry and strife to true love.