Best Practice General Interoperability Podcasts Psychometrics Standards

Podcast: Dr. Will Thalheimer on the Use of Feedback

Posted by Joan Phaup Dr.  Will Thalheimer of Work-Learning Research spoke with me recently about the role feedback plays in assessments and how it can be used to help learners. Our conversation touches on the basics of using feedback effectively; if you want to learn more about this subject I recommend... Read More

Best Practice General Psychometrics Standards Writing Assessments

Psychometrics 101: How do I know if an assessment is reliable? (Part 3)

Posted by Greg Pope Following up from my posts last week on reliability I thought I would finish up on this theme by explaining the internal consistency reliability measure: Cronbach's Alpha. Cronbach’s Alpha produces the same results as the Kuder-Richardson Formula 20 (KR-20) internal consistency reliability for dichotomously scored questions... Read More

Best Practice General Psychometrics Standards Writing Assessments

Psychometrics 101: How do I know if an assessment is reliable? (Part 2)

Posted by Greg Pope In my last post I offered some general information about assessment reliability. Below are some additional specific things to consider. What factors / test characteristics generally influence internal consistency reliability coefficient values? A.    Item difficulty: Items that are extremely hard or extremely easy affect discrimination and... Read More

Best Practice General Psychometrics Security Standards Writing Assessments

Psychometrics 101: How do I know if my assessment is reliable? (Part 1)

Posted by Greg Pope At last week’s Questionmark Users Conference I presented a session on item and test analysis, and part of that session dealt with test score reliability. “Reliability” is used in everyday language: “My car runs reliably” means it starts every time. In the assessment realm we talk... Read More

Best Practice General Interoperability Psychometrics Security Writing Assessments

Psychometrics 101: Sample size and question difficulty (p-values)

Posted by Greg Pope With just a week to go before the Questionmark Users Conference, here's a little taste of the presentation I will be doing on psychometrics. I will also be running a session on Item Analysis and Test Analysis. So, let's talk about sample size and question difficulty!... Read More