How do you measure the transformation provided by your training or learning intervention? How many of us still only measure satisfaction and enjoyment rather than transformation and business impact? Is LnD a cost centre subject to circumstantial cuts or are you able to demonstrate the value added of your projects (or your clients’ projects)? In the episode “How to Measure Learning Impact”, Andrew Jacobs shares with us how to develop a process to ensure every learning project is evaluated based on measurable business.
Andrew shares his models and processes to systematically ensure that all learning initiatives are firmly grounded in impact and provides practical strategies to demonstrate this. Particularly in times of economic uncertainty, he emphasises the importance of laying a solid foundation with data and metrics—starting with identifying the current state of workplace practices and progressing to the creation of benchmarking tools that support and guide future efforts.
This is a critical area of focus for all learning professionals both internal and external as well as anyone in the ed tech sector.
Key learnings of How to Measure Learning Impact
- Understand why traditional metrics like attendance and satisfaction are insufficient.
- Learn how to align learning initiatives with business outcomes and performance goals.
- Measuring impact approach: the Power of 10 approach to track impact
- Gain insights on setting baselines and using metrics to demonstrate progress and results.
- Understand how to build credibility and influence to drive meaningful change.
- Recognise the potential of modern tools, including AI, to streamline evaluation processes.
Express review
If you have little time or are after a specific piece of information, you can review the summary below and find the time when it is addressed in the video:
1. Andrew Jacobs Background and Approach (00:00)
Andrew Jacobs explains his shift from performance art to understanding true learning and its impact on performance.
2. Challenges in Performance Measurement (03:08)
- Focusing on business outcomes rather than just learning activities.
- Role of clear benchmarks and the right data elements.
- Easy data vs Performance Data
3. Identifying the different type of Data in Learning (06:52)
- Different types of data in learning: input, output, exit, performance, and reflection.
- Identifying entry and exit points for learning activities
- Sharing content as a data
4. Evaluating performance (10:59)
- Proving impact: including baselines, repetition, control groups, and business performance metrics.
- Context and qualitative feedback
- Applying the model to smaller Organisations (16:06)
- Baselines and Long-Term Measurement (17:57)
- Time framing “power of 10” approach
5. Developing credibility and Influence in the business (22:48)
- Accessing data and communicating with various stakeholders
6. The Role of Technology in Learning Evaluation (24:13)
Tools and resources
Andrew mentioned the Barcelona Principles used in Marketing, Communication and PR and how they can be adapted to Learning. If you are curious about them, here is an article detailing what they are: The updated Barcelona Principles explain how to measure PR in context
If you would like to dive a little deeper in some of the models and processes we discussed in the video, there is a lot to be found in Andrew Jacobs book : “Proving Impact: Measuring Effectiveness andDrive Results”
Lost and Desperate: Andrew’s daily blog is a short and snappy thoughts mostly around learning and performance with usually a slightly different perspective. Less than 60 secondes of well used time a day!
Women Talking About Learning Podcast: A series of podcast where women guests speakers discuss a learning topic. By creating a space in the industry for women to have their voices heard, Andrew supports the rise in a new and different leadership thoughts.
About Andrew Jacobs, guest speaker of How to Measure Learning Impact
Andrew Jacobs is Founder and Chief Executive Officer for Llarn Learning. Known for innovative thinking about learning, training and technology, Andrew has significant experience in a range of roles across learning, training, talent and people development. This experience has been learnt in a range of industries in both the public and private sector, most recently in central government with HMRC and DHSC.
He has a specific understanding of developing online and digital solutions for learning, social profile and engagement. He is a Chartered Fellow of the CIPD.
He received the Internet Time Alliance award for his work on informal learning in July 2020 and was highly commended as part of the DHSC team at the CIPD People Management Awards in 2021. He was part of the team that won the Gold award at the 2022 Learning Awards for the work with Capita and the DHSC, and individually won the Bronze award for Learning Professional of the year at the same event.
