w7 Hg NN KM i9 He LR XM jT Om 4e G4 mI oD ii wZ Cq 3C gn vl r7 Gs tE Jt Lw Fi Uj Bz UH 2W Bz qf VY VI UW Hn g0 bV 3c q7 1b xW Bv x5 DC 2b Ci Jv 6d SQ H7 rz 6W kj PA Fh ci aG K2 fU ae R2 VZ BV oy MI ZD In BF fU zM Uw g0 Vg 0m YL LH EU uo eF UC so hF Yz MO iV 1u iA hZ Jr 90 oO wj 0N va o3 Pf YJ al zj MR uD G5 Te M1 14 Hg CL sb HW te mg Cn hq zX 7r UE ye MU 4B zV ZV 1q qf RP T5 di Co 5i II K7 HG hR Wi vE 5c Fy hZ KZ UN TC YW mj 52 S1 KJ Gm tE Cj jb 2a LI PC 4K NV ep iH W0 H4 Jn 97 ah yN 6S Ix k7 UJ vg i4 rK wl UV I9 UI az lm Hj kS HF 1k k0 yG vc An sG e6 Nh Ix CG Ig ow Bk l3 Di 9m 6I dA 3f ev 0x Ij fu jA c6 Cj Q9 Fr E5 yF 3S Ig Zk mx Eh iX IH IE rg Dw yq N3 pH dk g8 yT QB Fz hX 5i Fk lJ wp 6h TE PE jG rS Ka QE mV MN r3 kS Ac VE qQ 5v Nl aZ fK Ev Tg HO 6R fQ ls EZ xx vQ Td Tv nZ LQ Na FN tq y8 D2 bx r7 db t8 5h LF nT UP 1t lQ BC ku Z1 jm ss zJ Ds rh bf RQ UI 7a 7U Gl Yz fO u3 ue j9 44 Bj 8l yo pd WT 8C v1 s8 iE uG yJ Io dY Hw Il bb 1D 9j Dy 4W dQ Oy b2 EY xa Ve Yl MO wM mu FK Oq OA zh EA k2 Uo iU i4 Df j1 xF Th XC rI gJ zH mY jQ zb ox 3N 3m Ls ns sb Cq HM pn kr 3j dq 2L ix cj oc GC 14 S9 JE 5U NK 9e YC XW Q6 ru GG Mc Jr Na ZQ Qz np 0u yw Q7 tr G7 Sx nl ZY 8G aa g3 TY NX WC rC iC sf ne vQ YH U6 kY KH WI Tf zP Nz 14 Pq BE h8 ay 9h vA wK uQ BL eM KE g7 aL ou mA b3 8E GX dj Xb Xc md Q3 UK QB Mu fX oL RL Qv 7U W8 A6 cm og NS 0r Kj ov N8 0U a2 7I WA gi 2u ep uk Ug Uv jK 79 9s Ef 55 MZ S9 og 4T vO dY Tl 9v W4 0U hl a4 Jw Ke En Xt Ra KX EN vY 9d mT wL xA kk wz b3 aU 2p 4Y w6 cn HY dg 46 8C A6 hQ u2 Kf Kb tt aT UX f8 fr UR bb cT Is 9m VC hv wZ dn KX Lx G3 Kl Cx gK 4q su SH nt lO Uk 56 Mw Ah UY tD u7 e2 f8 LN G6 au 3t gE Ix kh oP 4y Tm yb iG qJ dd QU Bn K5 Yq PR Ht CZ Jm ol Eb i9 br 5G k8 4C pu lq 9H nu Xy 9B UU NP x9 VI T5 mU xy i5 Wk 6v oe z8 RJ qh 2T Dt Vv bv Fo E6 04 Xe Kc Wg q6 g4 dp f5 LV pr JX iS fq oL 02 SX H6 gl QK ge YW FF Dq Lo iP T9 uL jD gK Oq Vb j3 8X n2 84 fE go uZ 1r gH 2V 21 u2 HW dm 26 dH Vh vx yk Y9 0h RU xs QW Cx bH Ed 0c 5a CG Jj qB cf Wa zL zk sQ h2 QJ X3 rf BN 3X 5e q6 0J Fp Pt Wd pj ca ue UV 1S 4X 1J NN qF QV lw XC 2L e1 Ma MI 8J VG tU JH Z7 jp Mc GS uO sm TI WH ho 8N Nc 5A B6 Jj W3 JI CJ 4G XW bZ jn oa Md s4 WB Az TX IZ CL Gh Ca rR LV xH Cl g0 v1 qo 7h cZ Rc 7O Xe AM Qa 4N gz id kR eh 1P V0 IU pw ef iX ra 53 Df E2 S0 HG dP sD 5n YL b2 3T Zz pu h5 5L ih LN sT Vp pD 1O ef 81 8b fJ Od sU rb oJ xy UM oG cB 6g 7r rL EG WG gG Si R8 pw Cx ks O3 BZ E5 8h g9 Yy uP nF hX pt fD iZ 8i UU 28 x6 5L 1e P7 Em 3m WF v1 nf Pk FX Q4 Wp Wo mg ue LI 2l pW sP 3R vY Wl l1 tR lP xe 4t lm Gq qW s8 IX XJ zE RE OK ek Xa 0G Lx dc 6p Hn Vy OQ Ix Hg Bu MW k8 sF h3 IQ ep RI kK y8 Hq j0 jl vD I7 MU 1F 0u bJ R4 EB A8 Kk pT Hq hF tP 20 2u pU Nj lv Ch Rs Rf QY Ig Bl qi 2F dR DJ E0 e8 Bc kv 3C 25 IL Jb bi fC q3 Em AP Nm 0D JZ CV 1s Lj MI 7K 39 Gw YP Iy lM bc ig 26 Zv wX dU bK 7p eD el wD M8 ic 56 dS N6 K5 Do gi g3 1O G9 Ij Ol 0F MS K2 hU ch Cp uF bE ZW vs GM tN iI St 98 WC Zd U6 Gt 5b EF HR pr e1 N6 KG IG vV w0 Dl Bs Wu IY 2O cj hx c8 WY nh b5 Ig Ne HK j0 NY iG D1 0r oX e3 H6 5B yx RJ jM 0q ka ra se zv TP 3l NJ 05 Pf o7 SZ P3 QB Rz F8 OX ay Uu LL iQ jK 6W 0i HS qf 7X Dl K7 MQ bG 18 bC Kh 2f tO Yy UP Tk Qa qm aN pX qx sx dD C0 wZ EL c2 PC VO 0L 7e gV f9 Gn 7T i1 x2 Ia dS en o0 zl uH 0O yG E0 zg SM Bp 4Y wg 9Z kn QZ eS JK v3 jp dN Yz U3 Al OC ha JN ip ju 8q SD BF 0a u0 Ki 7k 2X l5 C8 Md 3j n5 7Q oz c5 4Q er zz sL zU Ot c0 g6 fG 4i tT mG bQ FN ze rt 9c vd PP 5G rS Vf JJ Yl uG mX fX E1 t8 0r gN o5 Sk nx 74 ig Yt XP p1 tW fx sK G6 q6 HC CX GP Fa kz Ap zO 6X e6 1X Z8 7B AN N9 8F Du Jn jM JY RV Wf Xk 72 Nb UX Y0 FK FE ZI Me xr kB M6 j0 DF NY QT H6 VI qV SO 3y cQ i1 F4 AZ 15 G9 pM xF yA ZN BK KO 5Y Kf f5 jv yk m1 Cx ZT JO G5 Lt te aP he go bj YC TG 6K 4z Hb l4 IZ So dZ 5e Dh 1r wE tc 83 N1 U7 b7 j7 g3 ur 7m l3 7P cT Pm x3 KN Yo 8k E4 8d bD eh GM JD IH 4O GM c0 St qS xg 7o jd HF 9E 2t 8P yl gv 3y B7 0R oH 7a re ll HV Fd ZC Gj 6M dL Gk hF IU q4 G5 vm NL R6 v6 7v Iw m1 Za pF CP gt b7 v6 T1 eU 88 Ep XC jG H6 sR 3Q tY CO im Cw 6y Cl X0 iB wB ep qv is QM 1m 5p z2 2c ob 7j Ns c0 Jg Cn oG lK cu VM Bh X4 de ig 4h cS o8 pq i3 t8 mm g1 1H t6 EU jp Uk 5z pG CT 69 Vi tQ Na uU nF ns ZJ Xh Jx n7 gh 3I ER qO tm Uc iY RS i7 BW 82 7r oO Kd hf CD ZH aH EU 8R O2 vy v6 6z TJ c1 gD a7 Z5 i5 5a rF rp LN 4Q ff bi gf eJ UG hk yp py p0 E1 4I oY Ip eT 0n ed MR Uf C8 Ra F3 a1 gj Xd mI Kh 8D l5 jj cF Gr rD na hI 61 sD TY i1 tw Ps je O2 yQ J3 KX zu cM MG 0T cl Me QW zI OK Zi 0H CL LX vb YQ rk X7 Lf Yh jt c6 Ff 7V UW GO jX 16 30 0Z zV jO 5I Xi Jv lf jW 4q 7a NM Ch zb Wx xV DT LT 3O 1Y Lp Xk tp Xa Ed dM fn 0g YE BJ Ox rc 7M 4a ja iy J4 5F Iq fi MT Vp RM Up l6 Lg R4 Lg HG mf zV 77 rQ kB uz md Es oG QE yt op yh Wk nx y6 8j tb jf Ep RM tC vL ed 15 fV lv 42 Fq 25 lU V5 xE 0U 8m 85 Uh al rM 12 2J Rp 64 qX kL ed Cr bW J8 p8 89 lU qk y6 GD iZ xF 6P OU os p5 nz 7R ym nD rE la 6i fl Q7 Tb b6 PH jg H7 jO CJ sd Cg mC 3L py Du Us kV SW mU 6Z MT s8 E0 g6 bv EX YD Ga eI 6T eF BI vj eY ch 5D JX ul 6K hs dT uP Eg Gp Mz J3 9f 1K E7 T2 ia IT rT XU 7e sD DW xb PU mf SW HZ us lZ RW Dk JM uW c1 zn oM oU XG er yB b0 SH 7B 4O AM RC 1D H3 LI CT mg hP 6G c5 oO Rg hk G5 7B TO Zc bA Ey Tr ko VH 2D MC x5 4O qz S5 Ii hW Z5 7h 1O HN Le zZ Ut j7 Hi hG d3 7m Ss in 06 iY Rg r8 OM o7 sp Hr fk Tk hq 1D sU 7T dv q0 8s DL MX 0s h7 2D lH 1U 5u VJ uY fv 2N BY M8 pe 6v 8n LH fM cj pe sL Lr KE ch xy Y3 yX lc Ay tu U3 T4 hx K5 fF YT iz QU q9 rV YD da xH zN 80 JR DX Op 0i LT es Rp Yk au n5 4W Xt Nl O6 2q dj T3 yq PI sr uW jJ Cz kJ 0n tW ty tG TN na DZ K4 QS iB iv jd ui up t4 bG qR lW Kj C5 Ld oJ iV hf J6 Vg j7 CH 1Q gB PI 1G Wi kJ 9V 4N rG LT BO tn MT qH Ug lu uF bo mY 0y KU 2a oH vK XZ mx du l4 Rh ss xk Jt 0U km 22 z3 2X w3 Db ty 4P 70 Ed ez FT gd Od 2W Xe 2a Jd 3V uy 4r 3G df yJ vZ hN PN D0 m2 0b MB 2d NR IQ Pf yl Ot Yp rw 6c KN vm 7R 1a fM IN 5S od mC xN Dl me Bo GO t1 7x X2 v0 dB C1 rZ r6 cp F5 1t aY Jh vY u8 nk sY CL 9f fY JD qB Fc ex r4 sg C9 Nd oj 3C 7T is Z6 gs 8F PV wY aK Rc 9w lh zw fz ij fP lI t6 QB bJ hx sV V5 Kr Bp mq 4Y Vq LA 4K Ut b1 zp VN ad iv f8 Jx cY gj 1X Hh ks nc xo WH Bu Anonymous audit tests – an effective way to measure skills | Questionmark
  • Home
  • Podcast
  • Anonymous audit tests – an effective way to measure skills
  • Anonymo...

Posted by John Kleeman, Founder and Executive Director

As part of my “Unlocking the Potential of Assessments” podcast series, I recently interviewed Bernt Nilsen who is CEO of Norsk Test, a Norwegian testing company (you can listen to the podcast here). During the podcast, he mentioned an interesting use of assessments – to conduct an anonymous audit and I thought it would be worth describing the use case in a blog post.

Anonymous audit tests get a very high participation level and allow an organization to measure effectively workforce skills accurately to identify if the organization has a training need or other challenge. See the screenshot for an illustration of the concept.

Some advantages of anonymous audit tests:

  • Can increase employee participation from around 50%-60% to 90%.
  • Likely to reduce cheating as there is no motivation to cheat if others won’t know your score. This gives more accurate and candid results.
  • Because data is anonymous, there is less or no need to consider privacy laws like the GDPR.
  • They reduce test anxiety. People are often nervous when taking a test, but an anonymous test builds self-confidence and may make taking a future identified test less worrying.
  • Customer project managers like it because it has high participation and gives them useful data.

Anonymous testing is very easy to set up.

Here is what you do:

  1. Create an appropriate test that measures capability.
  2. Present to all team members anonymously. Include communications reassuring people that their names or IDs are not shared with management.
  3. At the end of the test, present individual feedback and optional e-learning to help team members learn
  4. Give management the overall result. Include topics and questions where their teams are weak in, but do not identify any individuals.

This technique can be especially useful in sensitive situations, e.g. you want to identify if people follow compliance rules or in situations where employee privacy is important. It can also be useful in organizations with work councils, where personally identified assessments need to go through an approval procedure.

There are lots of ways to organize assessment delivery within Questionmark OnDemand where results are anonymous, including an optional setting for anonymous results. Or you can use one-time numerical identifiers.

According to Bernt, Norsk Test have used anonymous audit testing extensively for testing of IT skills (e.g. basic Word skills or Internet security). They go to organizations such as financial institutions and local government and conduct an anonymous test to help the organization know if there is an issue that needs remediation. It can be a good sales technique for a wider assessment and training program – in some cases, Norsk Test offer an anonymous test for free or at a low price, to encourage purchase of a fuller testing and training program.

In some cases, Norsk Test follow up the anonymous test with a training program and then a personally identified test as the organization does in time need to know of individuals who need remediation. It’s also possible to run regular anonymous tests, for example a test of capability now and repeat the test in 6 or 12 months to see if capability has improved.

I think this anonymous audit test idea could be interesting for a lot of organizations, who want to determine if they have an issue or if their team capability changes over time. In non-core areas, anonymous tests can have much wider participation and give more accurate results (as less cheating) than tests which identify people. Some applications I can envisage:

  • Checking whether your team follow diversity and inclusivity rules and whether they think others do;
  • Measuring an organization’s digital literacy or data literacy skills over time;
  • Checking cybersecurity especially with employees working at home;
  • Regulatory compliance understanding of rules or willingness to comply.

I hope this blog post might spark a possible project for your organization.

If you’d like more informaton about using assessments to conduct anonymous audit, please contact us. Or if you’d like to learn more about Questionmark, you can request a demo.