The University of Maryland requires all its medical students to purchase laptop computers before they begin their first year. Having this capability enabled the school to convert its manual testing and scoring system to one that would provide current data and enable instructors to fine tune their exams. The school chose Questionmark Perception so that students could not only take their tests right on their laptop computers but also complete the mandatory course evaluations electronically.
All of the second year students take their exams using Perception while nearly 85 percent of first year exams employ computerized testing. According to Kevin Brown, Maryland’s director of instructional technology, the medical school’s instructors love the fact that they can obtain real time statistics as the students are completing the exam.
“They can start looking for trends almost immediately to identify any bad questions,” Brown said. “As we develop our question bank, some of the questions are brand new and we need to see how they perform. Are they ambiguous? Do they need to be reworded? The stats show this.”
In addition, instructors and the office of medical education staff are able to review these stats while half of the class is still taking the exam. If the instructional team identifies a question that most or all the learners get wrong they can notify the remainder of those scheduled to take the exam to disregard that question. Even better, Perception enables the students to use the testing process as part of the learning environment. Perception’s feedback feature provides instructors with the opportunity to provide feedback on questions that the students get wrong.
While these high stakes exams are the most important aspect of the medical school’s use of Perception, the school also regards the course evaluations as a vital element of its effort to maintain high standards. This feedback helps Maryland’s medical school improve the curriculum. The evaluations also help locate potential problem areas and keep teaching standards high.
“If we have a feeling that an area needs improvement or board scores are low in a certain area and we see feedback from students that reflect those concerns, that might be an indication that perhaps the teaching was not up to par,” Brown said.
After students complete their exam a link takes them directly into the evaluation section of Perception. In addition, the school can conduct periodic evaluations that students can complete at home or through the school’s wireless network. |