Best Practice General Standards

Soft Scaffolding and Other Patterns for Formative Assessment

Posted by Steve Lay As someone involved in software development, I'm used to thinking about 'patterns' in software design.  Design patterns started life as a way of looking at the physical design of buildings.  More recently, they've been used to identify solutions to common design problems in software.  One of... Read More

Best Practice General Psychometrics Standards Writing Assessments

Psychometrics 101: How do I know if an assessment is reliable? (Part 3)

Posted by Greg Pope Following up from my posts last week on reliability I thought I would finish up on this theme by explaining the internal consistency reliability measure: Cronbach's Alpha. Cronbach’s Alpha produces the same results as the Kuder-Richardson Formula 20 (KR-20) internal consistency reliability for dichotomously scored questions... Read More

Best Practice General Psychometrics Standards Writing Assessments

Psychometrics 101: How do I know if an assessment is reliable? (Part 2)

Posted by Greg Pope In my last post I offered some general information about assessment reliability. Below are some additional specific things to consider. What factors / test characteristics generally influence internal consistency reliability coefficient values? A.    Item difficulty: Items that are extremely hard or extremely easy affect discrimination and... Read More

Best Practice General Psychometrics Security Standards Writing Assessments

Psychometrics 101: How do I know if my assessment is reliable? (Part 1)

Posted by Greg Pope At last week’s Questionmark Users Conference I presented a session on item and test analysis, and part of that session dealt with test score reliability. “Reliability” is used in everyday language: “My car runs reliably” means it starts every time. In the assessment realm we talk... Read More

Events General Standards

Welcoming Steve Lay to Lead Our Open Platform Initiative

Posted by Joan Phaup During our recent users conference I had the pleasure of meeting Steve Lay, who is now leading Questionmark's Open Platform initiative. [caption id="attachment_481" align="alignleft" width="135"] Steve Lay[/caption] Steve has extensive experience of open source systems and an in-depth understanding of how awarding bodies, academic institutions and other organizations use and deploy assessments.  At the... Read More