On January 14th 2005 the FSA (Financial Services Authority) introduced new regulations for the General Insurance market that set out a code of conduct for the treatment of its customers. This signalled the end of self regulation within the industry and put the FSA firmly in control of regulating firms in the UK that undertake financial services. The new legislation affects all general insurers, certifying that all of those working within this sector are competent in their roles and therefore able to deliver best advice to all customers.

For NFU Mutual Insurance this represented a new challenge and the company felt that its existing paper-based assessment process would struggle to deliver the level of assurance required by the new FSA regulations. The need to streamline processes and to make them more efficient was evident and NFU Mutual Insurance began looking at automating the assessment process. The search quickly led them to the door of Questionmark and its online assessment software, Perception.

Philip Wilcox, Training and Development Consultant at NFU Mutual, comments, “The drawbacks of our manual system were many and quite evident. Unusually for a large insurer, we have our own network of tied agents. This means that we, as a company, are responsible for the actions of our sales staff and the repercussions of this fact can be quite dramatic. So, with several thousand customer-facing staff, there was a huge demand on our department to ensure that our systems could cope with the need to assess people’s knowledge. And, we were working to a tight deadline. We wanted everything to be tried, tested, in place and working for the introduction of the FSA regulations on January 14th 2005. We were going to be very busy.”

Philip Wilcox adds, “Moving online was paramount because of the geographic spread of our people but we had to be sure that the new systems would be easy to use because the IT skills of our staff vary quite considerably from one location to another. The system had to be straightforward to work with and it had to offer us a host of features that would make the job of administering the new assessments simple and effective.

“Questionmark Perception was a clear choice because it offers excellent reporting and statistical qualities which would make the administration of the assessment results simple for us at head office and this would free up a lot of our time from the manual input of the old structure. Also, it provides an effective and accurate audit trail for the assessments. We would no longer have to plough through reams of paper to find out about the results of a certain member of staff. With Perception this type of query could be answered in a matter of seconds. The decision had been made. We would go online with our assessments using Questionmark Perception.”

With the lessons learnt from the pilot, aspects of the system were changed in readiness for the next stage of its development. All in all, the pilot ran very smoothly and user acceptance was high. The security of the system was sound and support from Questionmark was very useful and timely.

Philip Wilcox adds, “We involved many people in the process to be sure that they bought into the new system from the very start. We discussed it with department managers and demonstrated it to them so that they were ready and prepared for the system once it launched. This happened in the summer of 2004 when it was available to work with in all offices across the UK. We started on a limited basis with those who had been involved with the pilot to be sure that it worked well in the branch offices and to test that the IT part of the project was robust enough. It worked and it worked well. And, the feedback was very positive. We then had to review the assessments using the statistical analysis tools within the software and pick up on questions where the wording might be a little obscure or confusing.”

Following a successful pilot, the system was extended to everyone within the company. All customer-facing staff has three attempts to pass their assessments online. These attempts are scheduled by supervisors and monitored. They contain a range of multiple-choice questions to test knowledge of company products.

Less developed, but in the early stages of development, is using the system for opinion surveys and questionnaires. These are to be distributed at the end of training courses to give feedback on the course content and delivery. There may also be other questionnaires developed over time.

A further idea is for the software to be used by internal departments, such as Marketing, to test the competence of staff in certain aspects of their work. This would not be to adhere to regulations but it could be a useful tool for internal purposes such as staff training and development.

Finally, the company may wish to develop assessments that measure knowledge in more complex and technical areas. This will necessitate more involved questioning and the assessment of greater depth of knowledge and understanding. It requires questions to be developed in many different formats and a more advanced level of feedback and marking.

Philip Wilcox concludes, “We will build on our initial success and find new ways to use Questionmark Perception to deliver real benefits to our staff. We now have a much more flexible system for our learners and a system that is easy to manage and administer. We look forward to working closely with Questionmark to further develop our system over the coming months and years.”

This case study as an Adobe .PDF file (1 page PDF – 77 kbytes)