Best Practice General Psychometrics Security Standards Writing Assessments

Psychometrics 101: How do I know if my assessment is reliable? (Part 1)

Posted by Greg Pope At last week’s Questionmark Users Conference I presented a session on item and test analysis, and part of that session dealt with test score reliability. “Reliability” is used in everyday language: “My car runs reliably” means it starts every time. In the assessment realm we talk... Read More


Delivering Assessments Securely: What are the stakes?

Posted by Joan Phaup Indeed, that is the question! Your decisions about assessment security need to start with the stakes! This "assessment pyramid" in our white paper, Delivering Assessments Safely and Securely, helps put  various types of assessments  in perspective to help you make solid decisions about delivery and security requirements. The paper describes... Read More

Events General Standards

Welcoming Steve Lay to Lead Our Open Platform Initiative

Posted by Joan Phaup During our recent users conference I had the pleasure of meeting Steve Lay, who is now leading Questionmark's Open Platform initiative. [caption id="attachment_481" align="alignleft" width="135"] Steve Lay[/caption] Steve has extensive experience of open source systems and an in-depth understanding of how awarding bodies, academic institutions and other organizations use and deploy assessments.  At the... Read More

Events General

Questionmark Conference: Progress in Criterion Referenced Measurement

[caption id="attachment_475" align="alignright" width="88"] Sharon Shrock[/caption] Posted by Joan Phaup A highlight of the Questionmark Users Conference in Memphis  was Sharon Shrock and Bill Coscarelli's keynote, "Results You Can Rely On: What We’ve Learned from 25 Years of Criterion-Referenced Measurement." Sharon and Bill took us from the early history of testing to the... Read More

Best Practice Events General

Checking in from the Questionmark Users Conference

Posted by Joan Phaup We are having a great time at the Questionmark 2009 Users Conference in Memphis--and as always a highlight is meeting our customers and learning from them. Yesterday I heard a case study about an innovative certification program for a global tech service workforce, in which the expertise of the workers... Read More

Best Practice General Guest Authors Interoperability Security

Defense in Depth: Security for SCORM and Beyond

Posted by Tom King My earlier post, The Importance of Security and Integrity of Performance Data addressed a specific emerging SCORM security issue. It also raised the issue of “Defense in Depth” as an approach for improving security. Here are some defense in depth approaches you can use right now... Read More

Best Practice General Guest Authors Interoperability Security

The Importance of Security and Integrity of Performance Data

Posted by Tom King There’s been much discussion among developers and insiders about recent posts and vendor notices regarding automated cheating tools for SCORM 1.2/SCORM 2004 content. I’d like to share some thoughts on the underlying issues and measures that can be taken to reduce vulnerability. This is no joke…... Read More