You were introduced in Bitesize 3 to a crucial piece of theory. Now we have another crucial piece of theory - the theory of evaluation.
Evaluation is a fundamental step in the training cycle (TNA, Design, Deliver, Evaluate) and yet every trainer finds the evaluation step very difficult. Whether it is difficult or not true business partners cannot ignore it.
The vast majority of trainers fail to do evaluation for one simple reason - they are trying to use a model that doesn’t work. This model is called the Kirkpatrick model - otherwise known as the 4 level model of: - 1. Reaction 2. Learning 3. Transfer 4. Organisational results.
Whatever models you currently use the common problem with all of them is that trainers try to measure the benefits of training after a programme. This is impossible to do if no pre-training measures have been collected before the training is designed.
The model for business partners looks very similar but has some very important differences.
It is called Kearns’ Baseline, Added Value, Evaluation and Learning Model or, more simply, the Baseline Evaluation Model.
Baseline Evaluation Model
Step 1 - Pre-Training.
i. Establish how the proposed training is going to add value to the organization. ii. Obtain performance measures for each trainee before the training starts.
Steps 2 to 5 - Post-Training.
2. Check reactions 3. Check learning 4. Check transfer/application 5. Re-measure the performance of each trainee and calculate ROI
The key differences are that the Baseline Evaluation Model: * Emphasises the need for pre-training measures * These measures should be added value, £ sign measures for Box 2 training (see Bitesize 3) * The current performance of each individual trainee should be measured before the training * The evaluation measures collected before the training should be used to design the training
The Baseline Evaluation Model is a very powerful model and the best business partners will become experts in how to use it. Look at any piece of training you are currently planning and ask the baseline questions now.
Marc Humphries , 02 August 2004 @ 14:00 PM Fag Paper!
I agree with Steve Jones. Kirkpatrick is trashed and then used as a basis for the model described by Paul. I understand where Paul is coming from - but it is hard to see how it's a new methodology. Agree that pre- training measures are essential though.
mike chitty , 12 July 2004 @ 12:13 PM False Assumption?
It strikes me that there is an assumption behind the Baseline Evaluation Model that often does not hold up in modern organisations who are looking to increase performance through learning. Namely that there is an expert (trainer) who already knows the skills, knowledge and understanding that are necessary for individuals to improve their performance, and has an effective learning process already designed. There is no process of enquiry or exploration needed. There is no risk involved. The basic assumption is that the learner is an 'empty vessel' into which we (as expert trainers) can pour our well designed learning - in order to achieve pre-determined outcomes. Anything that does not fit these assumptions for learning design and delivery will not sit readily with either the baseline evaluation model or the three box model. This would include most coaching and mentoring arrangements, communities of practice and other forms of enquiry based learning where the leanring is created through the process. Both Baseline and 3-box are helpful but limited and, perhaps more importantly, limiting if not used with care? As we increasingly shift from content-led to learner-led development processes it strikes me that these models of evaluation will need significant extension/revision. mike chitty
Paul Kearns , 27 February 2004 @ 08:17 AM A totally different model
Well Steve,the PC I'm using today looks exactly like my first PC from 1991 - a '286' - but the difference in functionality is truly amazing.
Steven Jones , 25 February 2004 @ 23:18 PM Kirkpatrick plus
I found the assertion that Kirkpatrick's model does not work slightly at odds with the fact that it is then included as the model for checking against the baseline. It strikes me that all the base line adds is a half decent TNA which is always the starting point for a good evaluation! Steven Jones
