Do we always need learning analytics – or is gut instinct a valid approach?

Learning analytics or gut instinct?
Deagreez/iStock
Hub
Part of the Learning analytics hub
Brought to you by TrainingZone
Share this content

Learning analytics is essential to assessing the impact of L&D solutions on the performance of both learners and the business. But is there a time and a place for going with gut instinct too?

In my opinion, before any major learning programmes take place, data should be collected to inform any decisions about the actions that are required to plug a performance gap. Equally, it should also be collected after the learning has taken place to measure the impact and any subsequent performance improvements.

However, not every problem encountered with an organisation necessarily has a training or learning solution. In any business, which is never a closed system, there are many factors as to why something may not be working:

  • Lack of resources

  • Poor communication

  • Poor management

  • Faulty systems or processes

  • People lacking motivation (not skills or knowledge)

  • Lack of clear goals and targets

  • People not empowered to make the changes required

  • Silo-working where mistakes are repeated and not shared

  • Lack of a shared vision

  • Trust issues

This is to name just a few. Each organisation will have its own barriers to growth, unique to itself and its culture. Having said that, there are many common barriers that can be seen across the board in many sectors.

Delivering learning innovations that increase performance

With the right information, L&D can help create a more agile organisation, rich in relevant learning experiences in a variety of different formats. All of these, when working together, consistently create a trusted company brand where people thrive.

When people thrive and innovation in learning is the norm, then the ‘top deck’ (as defined by Towards Maturity) is three times more likely to report that “learning innovation has resulted in an impact on business innovation and on staff motivation”.

Staff motivation and learning innovation are rarely the sole goals of any organisation. Most organisations want to improve their performance in some way, such as improved sales, reduction in complaints, less waste, bigger profit margins, larger market share and growth.

It is knowing how to affect these performance improvements through improved learning that is sometimes the sticking point. In my last article about measuring the success of soft skills I shared my HIRE model as a way to dig deeper into an organisation’s needs. Not just perceived needs or desires but the performance gaps that need to be filled, sometimes with learning and at other times with changes in resources, relationships or attitudes.

If you begin every major L&D project with an analysis and then keep using the data to inform how well you are making the improvements then this is a sensible approach to applying sensible learning analytics, in my thinking.

Anyone who has worked in an industry long enough will begin to develop a ‘gut feeling’ for what is (or is not) going on.

But do you need data for every project, or can a useful gut instinct be developed?

Here is an excerpt from my book ‘How not To Waste Your Money on Training’ which discusses this very subject:

Our ability to make good decisions comes from what we might call ‘intuition’ and some information to back up that choice. Intuition itself has been researched (CIPD 2014) and those found to have great insights and make good decisions quickly are practiced in doing so.

They have gone through the process of questioning, data gathering, sense making, interpreting that information and applying it to their situation many times. They have honed these skills so much that, on occasions, they can skip the data gathering and get a ‘gut feel’ as to the solution to a problem.

Anyone who has worked in an industry long enough will begin to develop a ‘gut feeling’ for what is (or is not) going on. Their ability to sense what is happening will improve with time. Some people develop this skill faster than others and some need to go through that process of data gathering, sense making, checking and validating to gain enough confidence to listen to their instincts.

That said, should we only go by what our instincts are telling us?

What I might suggest is:

  • If you lack confidence and experience, use information to inform your decision making, while trying to sense what might be happening. Reflect on what you thought were the underlying problems and compare to what you found them to be through analysis

  • If you have experience and confidence in your gut instinct, periodically check in to that instinct by using solid information to back it up

  • When your gut instinct is saying ‘no’, but the information says ‘go’, do not ignore your gut. Double check the data sources you used. If you have used three, for example, try a fourth to get confirmation

  • When the information says ‘no’, but your gut says ‘go’, ask yourself what may be behind your gut feeling. Could it be some bias or desire driving that feeling? Could it be a time pressure from elsewhere driving you to make a hasty decision?

My background in engineering has shaped my approach to learning and development. Skills I learned as a young engineer have stood me in good stead as a professional in a field that does not always rely on a scientific approach in decision making.

Let me share a few short anecdotes that may surprise you about your fundamental beliefs surrounding engineering. You may think that every decision an engineer makes must be backed by maths, physics or some scientific formula. Yet I have seen the importance of instinct on many occasions in my engineering career.

Going with my gut in engineering

As a fuel technologist, I was often asked if a specific coal would be suitable for converting a particular oil-fired boiler to coal-firing. I would look at the technical drawings of the boiler, determine if there were any tight bends that the combustion gases had to navigate and if the ash content of the coal proposed would cause slag to form on those bends.

Slag build-up could have catastrophic consequences on the running of a boiler; hence needing a sense of whether the combination of that coal with that boiler would work. If the answer was yes, then I could go on to run short trials to confirm my suspicions. If the answer was no (based on past experience), I could propose a different coal, just to be on the safe side.

If you’re reading this article, thinking you have to abandon any sense of intuition in favour of collecting data, I hope you have been reassured.

Going with my gut in meteorology

As a meteorologist, working in a company that manufactured wind turbines, my role was twofold:

  • To collect and analyse data from prospective and existing sites

  • To find the best place on a site to position the wind turbines

Data collected on prospective sites could be extrapolated to determine if it was windy enough to justify the expense of a turbine. The hourly variation of the wind speed and the topography (from a map and site visit) would allow me to judge if the prevailing wind was too inconsistent or likely to cause unbearable stresses on the turbine blades.

Data collected from existing sites and the subsequent power output from the wind turbines would confirm initial estimates. The more often I went through this process of data collection, siting and then further data collection, the better I became at judging the suitability of a site.

After a while, just looking at a map or visiting a site, my gut feeling would be enough to make the determination about where to situate a wind turbine. Though I can’t say I was ever confident (or foolish!) enough to do so.

If you’re reading this article, thinking you have to abandon any sense of intuition in favour of collecting data, I hope you have been reassured. And if you firmly believe that all decisions should be driven through analysis, I hope there is a little room for you to explore the development of your own intuition.

As always I would love to hear your views!

 

About Krystyna Gadd

Krystyna Gadd, Founder of How to Accelerate Learning

With 30 years experience in L&D, Krystyna has been training trainers, facilitators and subject matter experts as well as line managers since 2008. Noticing a lack of experience and skill in the area of needs analysis drove her to write her book 'How to Not Waste Your Money on Training'. In it she applies all of her knowledge and skills from the last 30 years to gently guide people to a more data driven, focused approach to L&D.

Krystyna is a consummate professional with a passion for helping people perform better through learning. She is a member of the CIPD and has delivered professional CIPD L&D qualifications. She is also a fellow of the Learning and Performance Institute.

With her background as an engineer, Krystyna applies the same process thinking to L&D as she did in her former career. Having moved from engineering to IT training, she spent years learning her craft firstly for IBM and later as a freelance IT trainer. This gave her great insight into how to make dry and technical training more dynamic and impactful.

A move into soft skills training in 2003 led Krystyna to research accelerated learning. She was particularly drawn to how learning could become more engaging as well as impactful. A frustration with the many models and theories within accelerated learning prompted her to create a signature system ‘Five Secrets of Accelerated Learning’, which simplifies all relevant theories and models for those curious about accelerating learning through their organisations.

Krystyna’s focus is always on achieving business results in a creative and inspiring way. Through Five Secrets, she helps people make this structured and simple. A curious mind drives her to seek new innovations and consider how the latest research can be applied. She is a pragmatist with a thirst for learning and sharing with others, with the ultimate aim to elevate the L&D profession. Finding the right data to inform good decision-making is a must in her eyes.

Since 2008, Krystyna has been training trainers. Noticing a lack of experience and skill in the area of needs analysis drove her to write her book 'How to Not Waste Your Money on Training'. In it she applies all of her knowledge and skills from the last 30 years to gently guide people to a more data driven, focused approach to L&D.

 

 

Replies

Please login or register to join the discussion.

There are currently no replies, be the first to post a reply.