Questionmark consulting partner, Jim Parry, Owner and Chief Executive Manager of Compass Consultants, LLC discusses the importance of setting a fair, defensible cut or passing score for tests and assessments. Some of the dangers of setting an arbitrary cut/pass score will be presented. He will describe an extension of the Modified Angoff Method used successfully to establish item difficulty and develop tests and assessments using stratified randomization when selecting items from a large test-item database. The importance of maintaining analogous difficulty and content across multiple exams will be emphasized. Jim will also explain how to establish a fair, defensible cut/passing score at different levels of expertise (e.g. apprentice, journeyman, and expert) using test items from the same database.
- Describes the importance of setting a fair, defensible cut/passing score
- Appreciates the dangers of setting an arbitrary cut/pass score
- Compares various methods of setting a fair, defensible cut/passing score
- Explains the importance of maintaining analogous difficulty and content across multiple exams
- Describes a method to establish a fair, defensible cut/passing score at different levels of expertise when using test-items from the same database
Submit the form to watch the recording and get a copy of the slides.
ABOUT THE PRESENTER:
Jim Parry is the Owner and Chief Executive Manager of Compass Consultants, LLC with over 38 years’ experience in course design, development, presentation and assessment design and analysis. Jim has been a presenter of pre-conference workshops as well educational sessions at the Questionmark User Conferences for many years. Some of Jim’s major accomplishments include the development of a major standard operating procedure (SOP) manual on testing for the U.S. Coast Guard, a spreadsheet tool to assist in recording and analyzing the results of test-centered cut score setting assemblies and using the spreadsheet tool to recommend the design of assessments using directed randomization in order to maintain fairness.