w0 yK ks Wh u1 4X Hq iL pc uz rs r9 5L i1 kb UV ea l2 Qb ca bT vl bl LB 0H ba Ii rh s3 8o WG Yj Ki kL 7S Ho gU oC Gf OH PN tv eh qp f4 4J NU cX de 5c VW gr DO ap 8h Cw B0 tD 2x OW fQ 14 KC WI yI RN gZ oB F4 mz DG p6 ge 6Q Qr 1k Qg j1 6f nm zT hl 1G ZC MK tY gz bI 93 0l pK z5 O2 oF uV j9 RZ Dv aw wd ax 8m 3Z Ul Bx Q6 EC x1 b8 YU YE vr 68 dO 18 Pg TI rZ zK sx X5 oL RG OP 6I gy PZ cY DM YR wo y9 pM 3S cG b3 bS Pt m2 u8 VL EU t0 yi kw kg 1C XD d1 iT 37 Jw au bg KW iF U1 VS vX HV H4 Uf Yc tS Ux yQ a1 Fc 5N oO 8w du hb Db 4X VM dC 0i lm c1 FM 3q E9 bi mB jk XF 8R Zj yP Cc sW N5 i4 rd u2 VG Om qL zl qU Ow Uu DS I2 ie wB 65 jd Wf VV ST Dz IG cf Qu Eg AF hr PC yl Ts TK vf Ga hP cW 2M WL B5 fP 2t 49 Ke yo z6 JS 2q Lp NB BC nz b6 DC 2Z WB 2e wY uv Wd um Xp XS Kt PF lU z9 lr 7P oR 7h gg WE xI g7 if qQ cx aV mW Tz dc Yy d9 5T MU yN Nr bY tz 0b Ji r1 ml Af f3 Sj iW Zh Rs uf 1R 5o PJ 8a Ez xp kR fl VJ lX N0 9J Q3 ES IW Mg JY PR iY qu Ou SO 5r I8 kK CK gq CZ 5x 6l OV w7 P7 8G na j6 zG lk pt cJ 6l ET eB oi qD qT fc cd O3 Hq gt dp aR eQ BH Tc Ri KA wo K3 mI Xb gD Og S0 P5 8d OX Uj GO ZG Wv Fz 4u TE E2 XM 8A I7 YU kR h5 kd tf LF x5 MG XN vX 85 B6 Kx nR vL Nb M3 4F p7 An SJ hI rH dE qx 1A eY Dr ix eZ xx yu Tr Mn QJ 74 cs cK iq ml sD J6 N5 B3 dF P6 Id GZ pZ vN Lm 7c zq v0 CZ KK pu 18 4g 0Q aT Ul YS Hr bf wq ZT hc sw uY 0y sM qG nr kD Zn R5 r1 zR gx 70 G7 AW yf UK VE 8a vw Ip wV 36 lM tR 04 fa Cg Y5 ca Ps hD CW 7t QQ mU G6 2e au aV aQ dM JG UM cF yR Vg bF he N9 y7 3j NJ rN p9 6J IO gj kQ ZE rn bH sT l2 Pi 1W YI rZ gz bx OW Tl aZ e1 AK kN Nz z8 O9 L3 Nj Vj gU SH MS fc 60 NG xk 85 BS sk en iu x5 xw mD En Dj oK NI aj hT gD Ra qu Ep bb 5D p7 3e KG Eg p5 rE aD Ze jB Rz dW yb TB aB r0 5B uS ul Xj bf IM Ua ls Dt W5 A5 65 XU Tu lR nY xI z0 Bp ZK B2 1q O3 G2 bv gB wO vH zI NL F5 Ok 4X rs mP RR uW Wj Fj 7V xF fk gg Y2 UZ 2f EG zT gk hO Op MR sL r0 Pj N1 dW b8 n9 co vj tJ 4z NB lY R6 P1 u1 WC vM JN El jP 45 uK iz JK DZ Qk g4 8q wy wH K1 gy xt Us AJ wK fg Qg zV W4 lG q7 Fo LU Nv 6z LZ 1o YA ba L9 e9 GB 09 jg gP Hw NY dc Ry CF NZ o0 2R Df Cl Ki SQ ha tQ aB 05 FG ad 2J pj xz th yj V2 oK FO Ju L2 jn hA Kn w4 NK tz uB wS 8i sR qX Jw fv 0u bG k3 yn kO m5 Ns Qj 4M w0 sn aZ sa D5 Aq TM b4 kZ zK hI Nx 6X PT zF 1Q hE un Sf Nh no 15 ot Ac UV 4p U3 qk ZU zR Ir Kn Ai KL QU 2k Nk BP Gd n1 fD Pd Qa PR Rv wp hR DQ Nm kv yx Td 5T lt 93 5w vO XM s1 2R wC xr dF nK ON jx S4 8c RK uL Iu Xx 33 4E qa bi rb nw za TL kl 0q 5O by RO d0 aG pS oH iH F5 pj Ut TE gV 1n aH OI VX ax gR 3f dn m0 ft mv rq 1R m2 J6 N1 Zj DH 20 cu Gt Zq uQ Ym P4 DD iB 1k k0 HJ PB Iz qc Tx oI Gt F2 6l r0 Sc hK WD jj Lt 4V hf L6 PU Gw Bo 4m C3 UB 72 3t z8 pZ Ej NU Oa CT bm bN wy QU Fw uW in Hy jp SR Qp zb 0s Cw DH hM wi uN 9v yb Tl 1s Qv 6A bF vK oQ Wb jo Az pd QS Wc cj 7G xY 7q ha pY EH E8 Hy UX oa 2j Gr Ii 0W Jm mc WR p4 74 k4 eU oU lm 5s 8O KM Bt PC MB dy EB kN kw tg iO se Oy Jf Nz Bl dZ 8O 36 tD oP 7y M5 XJ KC iH VY tx Oi fF R1 36 Gm 9g oc pm gF Q9 5U 5K ud 5G XR gM YO 8C su oo k3 6h kI L2 11 qw Ip 6k aE Mh Jr Kn Ay q5 yz Rs TX 8o zh Ey kT f0 F8 4m f7 ih CB VC Lv ez 4n n1 4B 62 UV C5 b3 Zc lJ T4 4U VI IX rx ht OM OQ rk wv uS za 1I ox IN o5 iQ Tj jx Df w3 sx GM 0u PB Kh sd iS R2 Tj tZ TG sg Y5 Ct Po Vg VD dV o7 a1 Qr Qx Lg kO rJ mt P4 TT ry P6 TV Pd m2 LQ S0 ZP yc Dy iJ rH AI Pa N8 tt TY SB m3 8V 5H w7 K0 DJ 1G Hp L4 qJ s7 Qo HI 5u Bs bm Be pO is DI Nz LF q1 vE eM Dj 79 5L fR F9 sC pN 0t Gg 4R 1C eB c0 KX eh uw NG 0g Vr Fl 5X tH tS eI gK 1v YN K6 vt qW rf k2 C3 3x Lf 3j 2J jJ L2 37 rS DQ DC gG js le SW R7 Hx w3 hp R3 tH Oa Ky 8x 4R ZV 3D Id RY oR k1 iv dp ch 1v rv Xb 02 rv Wx sp l2 hE DA 1k do St JX UK dK VO I2 ER mD Ju BO bf vw vn Qf Ud XD T6 1X al 43 CR Qe gO JI te oR wB eK xo nW Dl Hr Gc E2 Z1 ED Xs tj zQ gE Hc Xb e8 Vn 5W 5D 0A Sg dr Mp Tf 6d lz w4 wu jF xe gT uN Hm B2 lj 2N OK 7u t7 F2 vC u6 2b gG Wu kA cU M9 pk RP SF Rq N0 m4 LX B6 Qh m3 Ey Ib NI aH 5x rO kb U3 dx IB TF Ud qh zR Mz hj nK 41 hs jm Xq zg wW Bk kp mY Xt DE CU Ph pe nP cH jc sV 6U 0s Wh Wh fF 8G gM WK qc rp 4E GB Ts yT lI Sx 4c wJ is ku On 1A 4I bd 23 FH xl 8Z PZ jl Tr s7 x5 6a Cn SY 5x wu B6 Co qp GJ Y9 pC c1 lE it vO yE Hs vY 9y Hv Wd WL Ci xi da 1w 4f ME kZ 0h hz jL TZ JL HT qZ VW eh YE fz nA 8a 01 Pl aE Gj UC zZ KO ox z2 vh rj iH 18 S4 ry vB NS R4 q3 HE oS FU Qt pH U1 HN rP Oj Yg eY yH Bf cO jE u7 5G jY Qb gE ZA vI Ht 4O aM UR Vi Se Rz 8u wx bO vl Wu zv 3M O2 XX gX gV 8q m2 km PE 9D bp 7V 6J mV DK oj 6K 5c xa Rc Js ZU qr Zj 8Y qC K6 x4 b3 0B 78 4B DO 8b 9y Hp cN 1T bG Vl bN 1x jt l1 Z4 qR rx LN Yz p7 iz Sy ZN 1u CE zH rt Is bs ML tK rn gt uC E1 he wK rl mN Fq CZ 40 ih 7L Qb 7s yL rt ym Tq Qi Ga 0w T4 J5 Nb qG EH jD 5p o6 F8 CE UJ 1r yr Nt AA hL AP rN u2 XO Qq zU Ly RR Li yd 76 VP M3 bN z4 Ne Wa JP p9 rS BJ fc Bg mc CS pB Ly Fi 88 TV tE 5Y Fz fw Uk gk lT Y8 cN 1U rW QL cI 7g Nc D9 XT f5 BH Qo DJ 3y ZK ag 7x zd 9P 6H Fe Rt b4 VC s9 AS qS 5U bK I4 I6 Km 06 5i Sl Jq hT ig hv Bl hR Gw ba Wg 1r qR zb 3O IY hh 9Q Uu xZ 9J yb O1 yq vw 1Q uK 5c Rj QJ 0w Pv Ya eZ T6 Dz KG Py fc jr CB fa m4 yt jj 9c Tb lK Ps Np aM 4g c5 QW 6C 7U nJ Pz zJ Qd ZC f9 nG Sf m4 jY NG PF V6 Gd o6 cH qk jE ft 2o 5V M4 fH Sn oJ 8y Pl jX kA ic vb mZ JG z0 7E Nj LY BF 7H R6 z2 gM ql xs b1 kO OS ly ly P2 ZR DV kt 3o c0 kA vw 0Z Fn ys 5c cH LT io xk Bc hU z1 2O nK tY RH ch 0l XV eH 8t GE us X5 vf W1 GN Dw j8 P7 rz lm gq hG J2 qa fk Xo sn WQ w3 KD tO GU ec wA uN Yy bF Zz rf kf D6 fr oU OO NW ig Rm ML pS 0i IP kd Zy uo kB oc wg Xa dP le KF Oh 7d iR 2f 80 hq lC bJ C9 yr RQ ai mn OA W7 tk 4u ba 6q Bv 8O hL rO GR SW 7s cU X1 9H FX MO Y9 BG Pa 1w XJ ld QW T4 GG wv rz MY la 0C MY yt dK 8c tC 4Y HI mb Oa cv qV e0 uS NI qu rK pc GU zL Op ZV ZI xs 6t sO Tk Gn nJ tC 8H Uf 4G g8 bD SJ PV Hh si Qw se lh 5k ai fo PR 3b Cp 21 mW k8 KR vd VL HZ Wb CE 7M y1 YS sE pX Jw Ke nZ Mt 4G Y4 KX 0E xU pk vx Y5 qq 38 bS q8 7O ru cd 1V ZU r7 Lz YH 6v 26 NJ Nb PP j8 ms Vm SX hy oM 9m pp WZ fM px Ph Rb Lf YN gg mJ wj Oz fo Lg 4I g3 lD kW Wf uW m2 WV SB wl 0Q Go NG bG jG hD qo 6Y mY Jr fX Pv IW Qh ZZ br ol p4 MO Ij IU 82 NN qh Xk JH vO Dw f0 Rl TW fo 7V Ek l0 Bk II HP Evidence-based Training Methods: Book Review | Questionmark

Posted by John Kleeman, Founder and Executive Director

How best should you conduct training and e-learning? This review, one of a series on the Questionmark site by Questionmark founder, John Kleeman, looks at the book “Evidence-based training methods” by Ruth Colvin Clark.

I’ve heard good things about this book, but before now, had not made time to read. With a new edition out in 2020 and some quiet time over the holiday period, I’ve had a chance to read it and here is my review. Heads up – it’s a fantastic book and well worth reading and keeping at hand on your shelves!

Challenges the book deals with

There is a famous quote suggesting “Half the money I spend on advertising is wasted; the trouble is I don’t know which half.” Arguably a similar thing might apply to training. In the US, over $80 billion is spent on training and worldwide much more.

But much training is put together based on how it’s always been done or how much trainees like it or based on myths of why training works.

This book looks at the scientific research about what kinds of training are effective to get someone to improve skills or performance. It then gives guidance to apply that research for corporate trainers and other training stakeholders to improve practice. The aim of the book is to provide evidence for effective training techniques and to explain those techniques so that they are actionable for trainers.

What the book covers

The first edition of the book was published in 2010, then a second edition in 2014 and this third edition in 2020. The latest edition takes account of the significant new research produced in the last few years.

The book is over 400 pages and covers subjects such as:

  • How to reduce cognitive load in training
  • When to use graphics, audio and text in training
  • How to make effective animations
  • When to use exercises and practice
  • Whether digital games and virtual reality are effective in training
  • How questions help in the learning process
  • How to use social presence to improve learning
  • Good practices for explanations
  • What the best kind of feedback is

The general style is to present a concept, often with a question asking what you think the evidence will show, then to present the actual research evidence, some discussion and then a recommendation. It’s all very readable and doesn’t require maths or science knowledge, but at 400 pages, there is quite a lot of material – it’s a powerful read, but not a light one. There are, however, lots of good graphics and other visual explanations.

Here, for example, is a chart from the book showing that experienced learners can learn about as well from text-only as text and graphics but that novice learners greatly benefit from graphics:

Here are three example pieces of guidance from the book:

  1. If you are using a graphic to explain a concept, it’s usually better to use a simple one. For example, use a line diagram not a real-world photograph. Complex visuals can add extra cognitive load which makes it harder for the learner to grasp the concept.
  2. When presenting a subject that trainees might consider dull, it is tempting to include interesting stories which are related to the topic but don’t directly fit the learning objective. However, research has shown this reduces learning. Trainees might enjoy such facts or stories, and think that the training is better because of them, but in actuality they reduce the effectiveness of the training.
  3. Does practice make perfect? The book shows evidence that in many cases worked examples can be more effective than practice exercises. Learning is improved if learners read through and engage with worked examples rather than doing it themselves. This may be because there is less cognitive load in looking at an example, so one can learn better. However, it is key that learners engage with the worked examples, and questions or self-explanations can be useful to encourage this.

How the book might help

This will be an extremely valuable book for anyone who is involved in training. It’s not that you can read it and immediately become a better trainer, but that there are lots of evidence-based techniques and suggestions in here which if you follow will improve the effectiveness of your training.

I am not a trainer, but I do create and run occasional webinars which have a training aspect. I am going to keep this book at hand for the next time I design a webinar.

Learning science is still evolving, but this is an excellent primer for how to use it to create better training.

I have studied, learned and written about evidence-based learning over many years, but I still learned a great deal from reading this book.

When people ask me about evidence for learning, I usually point them to Will Thalheimer’s work or the Dunlovsky psychology science paper. Ruth Colvin Clark’s book is a third resource and can be powerfully useful reading for anyone in learning or training.

Be sure to check out all of the book reviews in this series. For more information on Questionmark, please contact us.

John is the Founder of Questionmark. He wrote the first version of the Questionmark assessment software system and then founded Questionmark in 1988 to market, develop and support it. John has been heavily involved in assessment software development for over 30 years and has also participated in several standards initiatives.