In a recent member-led event, Dr Iain Smith shared with 70 attendees the findings of his latest paper on using the Kirkpatrick model to evaluate the success of QI capacity building:
‘The Kirkpatrick framework, as designed, has four levels: reaction, learning, behaviour, and results.
Reaction is what did people think about the training or the learning or the development program. Did they like it? Did they enjoy it? Did they react to it in a positive way?
Learning is what it says on the tin. Did participants acquire new knowledge? Did they learn things?
Behaviour is largely about what people did with what they learned. Did they have the confidence to translate that and use it to do something?
Results are what happened as a consequence of putting it into practice. Did it achieve some impact? Did it help to achieve organisational goals?
One thing that we find with this framework, and particularly where it’s being applied in a limited way to massive online courses that I could find, is usually the evaluations go at the first couple of levels. How did people react to it and what did they learn? Various papers suggest that we’re not getting into the higher levels. (…) Why is this kind of relevant more generally?
I’m guessing in this community, pretty much everyone’s come across NHS Impact; NHS England’s new approach to improvement. On their resource site on NHS Futures, (…) they have tools and resources around the Kirkpatrick framework.
There’s a proposal on there that it’s a useful thing to evaluate your improvement work and your improvement training. (…) There are wider resources about how you can use it in evaluation of improvement and there are links to some papers that have used it. It brings it up to date and it’s quite contemporary looking at Kirkpatrick through an NHS Impact lens, given that they are recommending that.’
Not only that, but he also touched on other highly sought topics like waiting list reduction – one of the post-course reports he received claims an 80% waiting list reduction and a 75% waiting time reduction.
If you’re interested, please read Dr Smith’s paper, whose publication was proudly funded by Q. If you’re interested in funding your own publication, visit the Journals page to learn more.
He also shared extra resources in the Lean Healthcare group.
You can also watch the full presentation:
More inspiration from our groups
- Noemi Palacios shared not only the latest instalment of QPS Talktime, this one all about sepsis in infants and children, but also a podcast on the beginnings of patient partnership
- Linda Robertson, who’s a new Q member (welcome!) is interested in how to engage patients in QI projects, more specifically in regards to nutrition. If you have pointers, please let her know in the Making Use of Patient Experience group.
- During April, Hilda Campbell shared daily tips on how to manage stress, and best practices on how to avoid overextending yourself. Browse the timeline in the Quality Improvement and the wellbeing of the workforce group for a full month of great recommendations.
Upcoming events
6 June: Come explore the Liberating Structure Agreement-Certainty Matrix, all about understanding working with complexity, led by Afra Kelsall and Petra Bee.
Register your place.
10 June: Come expand your professional network and meet other Q members in our 25mins, highly focused Q Connect call.
13 June: In this story-sharing session, Laura Finucane and Adam Lent tell us how a physio service cut waiting list times by a third by using a community-orientated approach.
Register your place.
20 June: Join Julia Wood and John Rouse for monthly, virtual 45-minute discussions aimed at navigating the challenges of implementing and sustaining Joy in Work.
Register your place.
27 June: Join our Q Wales regional event: share learnings and explore shared challenges at the International Conference Centre (ICC) Wales in Newport.
Register your place.
24 July: Learn how to use Appreciative Inquiry to build a caring culture in your organisation. This call is chaired by Gemma Crossingham with guest Suzanne Quinney.
Register your place.
On the horizon
Interested in the topic of Community Hospitals? Then mark 10 – 11 October on your calendar.
The Community Hospitals group is organising a big national event to connect all QI professionals to shape tomorrow’s Community Hospitals’ practices.
Here’s a quote from the group leads:
‘We are delighted to announce our CHA national conference which will be held at the Chase Hotel in Brockworth, Gloucester on 10/11 October. We have a fascinating programme to offer. This is a chance to meet SIG & CHA members in person, and further develop our networking. Please save the date. Details to follow.’
