Posted by April Barnum
I recently met with customers and the topic of authoring trustworthy assessments and getting back trustable results was a top concern. No matter what they were assessing on, everyone wants results that are trustable, meaning that they are both valid and reliable. The reasons were similar, with the top three being: Safety concerns, being able to assert job competency, and regulatory compliance. I often share this white paper: 5 steps to better tests, as a strong resource to help you plan a strong assessment, and I encourage you to check it out. But here are six authoring steps to that can help you achieve trustworthy assessment results:
- Planning the assessment or blueprinting it. You basically are working out what it is that the test covers.
- Authoring or creating the items.
- Assembling the assessment or harvesting the items and assemble them for use in a test.
- Piloting and reviewing the assessment prior to using it for production use.
- Delivering the assessment or making the assessment available to participants; following security, proctoring and other requirements set out in the planning stage.
- Analyzing the results of the assessment or looking at the results and sharing them with stakeholders. This step also involves using the data to weed out any problem items or other issues that might be uncovered.
Each step contributes to the next, and useful analysis of the results is only possible if every previous stage has been done effectively. In future posts, I will go into each step in detail and highlight aspects you should be considering at each stage of the process.