Bitesize No. 14 – Business Partners and Control Groups
One subject that often comes up under the heading of ‘evaluation’ is the use of control groups.
What is a control group?
Well, if you were training 10 teams of salespeople you could choose not to train (or provide less training for) one of the teams.
This team would be the control group.
You would then compare their subsequent performance with the performance of the other nine teams.
The basic idea is to see whether the training had made any difference or whether the control group performed just as well without the training.
On very rare occasions you might choose to run a control group in training but as a general rule business partners should not entertain the idea.
Why? Well there are several very good reasons: -
• Control groups might help to prove that your training is effective - but you also have to admit that you have disadvantaged a group of employees for no good reason.
• Also, while you are failing to train people your organisation is missing an opportunity for improvement.
• Anyone who understands the Baseline evaluation model (see Bitesize 4) does not have to resort to control groups because the training will be designed to be self-evaluating (i.e. baseline performance figures for all salespeople are collected before the training starts and measured again afterwards)
• If the aim of the control group is to isolate all other variables and factors that might influence the training this same end can be achieved through clever training design. So, you might plan to run the training when no new products are being launched and no new marketing campaigns are planned.
If you are seriously considering using a control group ask yourself why?
What advantages does it bring and does this outweigh the disadvantages?
Training departments trying to justify their existence often resort to using control groups.
It's not a positive position to start from.
Business partners should not need to prove their training all the time.
Martin Schmalenbach , 12 July 2004 @ 22:13 PM Control groups to have government health warning...!!!???
Well, they should do!
Paul is right about control groups disadvantaging a group of people, and representing a missed opportunity. They are also a consumer of resources (data gathering etc) that adds no value? Why? Because not having a contol group will not result in a reduced value being added as a result of what you are doing, especially if your up-front analysis of the root causes to be tackled is correct. Getting at the root cause in a systematic manner *CAN* help accurately identify the contribution any training can make ahead of actually running it - in which case you don't need the control group! And as Paul says, if you have Box 1 training, it's a 'must have' anyway, so why measure its isolated effects when you can't live without it - meaningless!!
Focus on the outcome you are trying to achive, and try to make sure the training you do falls in to Box 1, then there's no argument. If the training is Box 2, then why go through the hassle of doing it? But that's another question!
The clear worth of the training function comes not from the control groups saying the training is effective or not, it comes from contributions to the bottom line that (a) are more than any costs incurred and (b) as a result of 'must have' training. Beyond this we get in to more muddy waters. Martin Schmalenbach