As providers of lifelong learning, what is the single most important issue you need to be concerned with?
The answer is one word: impact.
Now, more than ever, it has become critical for organizations to be able to demonstrate that their offerings are actually having an impact on learners. Learning experiences need to create a measurable change that is tracked and shown over time for the benefit of both learners and employers. Wherever there is time and money being spent, people will always want to know if what they are doing is actually making an impact.
In this episode of the Leading Learning podcast, Celisa and Jeff discuss why impact is so important right now, various ways to measure it, and how to use it as a way to market the effectiveness of your educational offerings.
Listen to the Show
Read the Show Notes
[00:20] – A preview of what will be covered in this podcast where we discuss the critical importance that demonstrating impact plays for organizations in the business of lifelong learning.
[00:40] – A reminder to check out the Leading Learning Symposium, an event designed specifically for senior leaders at organizations in the business of lifelong learning, continuing education, and professional development. The symposium takes place this year on October 24-25 in Baltimore, Maryland.
Why Impact Is So Important Right Now
- We held a recent Webinar on the topic of performance improvement.
- The last episode of the Leading Learning podcast featured an interview with Dr. Will Thalheimer about improving smile sheets to make them more performance-focused.
- It is a theme for the upcoming Leading Learning Symposium where the goal is to help individuals drive the reach, revenue, and impact of their learning business.
But the reasons why impact is so important right now are:
- Increased competition for learners’ attention – and money.
- People want to know that whatever time and money is being spent on is actually moving the dial. Note that we define impact as “a learning experience that actually creates a measurable change in knowledge, skill, or behavior” and this something you should be able to track and show over time—this is important for both learners and employers.
- Many associations/membership organizations have a mission to deliver learning so it is beneficial to be able to demonstrate the impact that you are having on a particular field or industry.
- It’s more possible than ever to measure impact because we now have the necessary tools.
Ways to Measure Impact
[06:12] – There are different ways organizations can measure the impact of the learning they are offering, from less formal to more formal:
- On the less formal side, social media offers a lot of opportunities for tracking because you can see what’s being talked about and shared. This is especially easy if you use a social media dashboard such as Hootsuite. But you need to analyze the tweets for quality (not just quantity).
- A somewhat more formal way to look at impact is through a return on investment (ROI) question that can be asked in an interview or survey. You can initially ask people to define ROI and then have them rate how high a learning experience(s) performed on a scale of 1 to 10. This gives you a benchmark and then you repeat the process over time to find ways to focus on how to improve.
- An even more formal way to measure impact is by making sure the learning is being designed for impact from the beginning with specific outcomes in mind and benchmarks to support them.
Designing Evaluations to Measure Impact
[13:22] – Note that in our interview with Dr. Will Thalheimer we talked about research from his book, Performance-Focused Smile Sheets: A Radical Rethinking of a Dangerous Art Form and ways evaluations can be designed to support impact more effectively.
It is important to note that asking learners whether they like something doesn’t give you data on whether something was impactful. And there’s a need for both a culture and leadership shift around this because as mission-driven organizations, we often need to give learners what they need, which is not always what they want.
Try to be more careful in how you structure evaluations.
For example, rather than being self-reporting, you can ask an assessment-based question with a scenario to give learners a chance to test their knowledge. There seems to be reluctance to give assessments but most adults likely appreciate knowing them, especially if it they are designed well.
The number of evaluations can help also measure and impact change. You can give pre and post learning evaluations, to include different points post learning (i.e. days, weeks, and months following).
And you don’t need to do this for every learning experience but that it should be a priority for at least a subset of learning experiences to take a targeted effort at measuring impact.
Learners like to know whether there has been a proven record of impact in the past for an offering so it also helps from a marketing perspective.
Impact data is embedded in everything and feeds into many different avenues, all essential for your organization.
[22:20] – Wrap-Up
A reminder to check out the Leading Learning Symposium, an event that includes impact as one of the major themes. It is designed specifically for senior leaders at organizations in the business of lifelong learning, continuing education, and professional development. The event will help you maximize the reach, revenue, and impact of your education business and takes place this year on October 24-25 in Baltimore, Maryland.
Thanks again to CommPartners for sponsoring this podcast episode.
If you are getting value from the Leading Learning podcast, be sure to subscribe by RSS or on iTunes. We’d also appreciate if you give us a rating on iTunes by going to https://www.leadinglearning.com/itunes.
Also, please tell others about the podcast. Go to https://www.leadinglearning.com/share to share information about the podcast via Twitter, or send out a message on another channel of your choosing with a link to https://www.leadinglearning.com/podcast.
[24:36] – Sign off