Skip to content
Updated: 6 min read

Measuring the Effectiveness of Microlearning: A Sample Implementation Scenario

How to tell whether microlearning works: the Kirkpatrick Model, the forgetting curve, spaced practice and named metrics. The practical part is a clearly labelled illustrative scenario for a mid-size company, with no invented results.

Łukasz Szymański Author: Łukasz Szymański

Microlearning is measured the same way as any other training: do people use it, do they still remember the content weeks later, do they work differently, and does the organisation see the difference in its results? Short modules don’t exempt you from evaluation, but they make spaced practice easier to schedule and data easier to collect from day one.

Quick Overview

What you will learn:

  • How to apply the Kirkpatrick Model to short learning modules
  • What the forgetting curve and spacing research mean for your measurement plan
  • Which metrics to collect: completion, knowledge retention, transfer to the job
  • What a measurement plan could look like in a mid-size company, shown as an illustrative scenario

Who this article is for:

  • L&D and HR specialists rolling out bite-sized learning modules or an e-learning platform
  • Managers asked to judge whether a development programme is working
  • LMS administrators responsible for reporting

Reading time: 7 minutes

The Kirkpatrick Model as a Measurement Frame

One widely used framework for evaluating training is the Kirkpatrick Model, whose levels are set out by the model’s owner, Kirkpatrick Partners, at www.kirkpatrickpartners.com (bear in mind that the organisation sells training and certification in the model). Level 1 is reaction; Level 2 is learning, meaning knowledge, skills, attitude, confidence and commitment; Level 3 is behaviour on the job; and Level 4 is organisational results. The same description advises designing from Level 4 down, so that everyone agrees why the programme exists before the content is chosen.

In microlearning, this has a practical consequence. The platform records reaction and part of learning by itself, through completions and quiz scores. Behaviour and results have to be measured outside it, by observing people at work, looking at operational data and talking to line managers.

The Forgetting Curve and Spaced Practice

A test taken straight after a module tells you very little, because people start forgetting at once. In chapter 7 of his work on memory, available at psychclassics.yorku.ca, Hermann Ebbinghaus measured how much effort relearning saved after intervals ranging from about a third of an hour to 31 days, and that is where the forgetting curve comes from. Murre and Dros reran the experiment using the same savings method; their paper on pubmed.ncbi.nlm.nih.gov reports that the curve replicated but was not perfectly smooth, with an upward jump around the 24-hour mark. For evaluation, the lesson is to re-test knowledge after a delay rather than only at the end of the module.

The second strand of research is about how learning is spread over time. The meta-analysis by Cepeda and colleagues on pubmed.ncbi.nlm.nih.gov pooled 839 assessments from 317 experiments on distributed practice and found that the gap between study sessions interacts with how long the knowledge has to be retained: the longer the retention interval, the longer the gap that produced the best recall. Microlearning fits this neatly, since a short module is easy to send out again after a planned pause.

What the Evidence on Microlearning Itself Says

The systematic review by Wang and colleagues on pubmed.ncbi.nlm.nih.gov examined microlearning for health self-care and included 26 papers. Microlearning improved knowledge and cognitive capabilities more often than it changed actual behaviour, and 25 of the 26 papers were rated at moderate-to-high risk of bias. Behaviour was more likely to change when the short modules were paired with monitoring, such as daily tracking of medicine intake.

The warning is clear: don’t measure only what is easy to measure. A good quiz score in an app proves nothing about whether anything has changed at work.

Illustrative Scenario: A Measurement Plan for a Mid-Size Company

The following is an illustrative scenario: a model, not an account of how a real company rolled anything out. It deliberately includes no results, since every organisation has to generate those from its own data; it sets out only the steps and the metrics.

Imagine a mid-size trading and services company that wants staff to make fewer mistakes when logging customer complaints. Its L&D team builds a series of short modules on the complaints procedure.

  • Step 1: the organisational goal. The complaints process owner chooses a business measure, for example the share of tickets returned because information is missing, and takes a baseline from the ticketing system.
  • Step 2: critical behaviours. The team leader writes down what agents should be doing differently: which questions to ask and which documents to check.
  • Step 3: platform metrics. The LMS administrator sets up reports on completion rates and quiz results. If the platform supports xAPI, it also records activity outside the course itself.
  • Step 4: knowledge retention. The same type of question comes back in spaced reviews and in a delayed test, not just at the end of the module.
  • Step 5: transfer to the job. The team leader checks the critical behaviours on a sample of tickets from before and after the rollout.
  • Step 6: comparison. Where possible, some teams start later and serve as a comparison group.

Read Also

Build Your Skills

To go deeper, Tracking Educational Experiences with xAPI shows how to capture learning data beyond the course itself, and LMS for Instructors and Course Creators covers building courses on a platform and reporting on them. Get in touch and we will tailor the scope to your programme.

Frequently Asked Questions (FAQ)

How is microlearning different from traditional e-learning?

Microlearning is e-learning built from short, self-contained modules that each make a single point, whereas a traditional e-learning course works through a whole subject in a longer sequence. Short modules slot more easily into the working day and lend themselves to scheduled reviews.

What effectiveness data does a learning management system collect?

A typical LMS reports completions, time spent in each module and test scores, and platforms that support xAPI can also record activity outside the course. That covers reaction and learning. On-the-job behaviour and business results are beyond what the system can measure by itself.

How do you apply the Kirkpatrick Model to microlearning?

Work backwards from results. Decide which business measure should move, identify the critical behaviours that drive it, and only then plan the platform metrics. Back up the reaction and knowledge data with observation and operational data.

What is spaced repetition?

Spaced repetition means coming back to the same material at intervals rather than cramming it into a single session. Research on distributed practice suggests that the gap between reviews should depend on how long the knowledge needs to last.

Request a quote

Develop Your Competencies

Check out our training and workshop offerings.

Request Training
Call us +48 22 487 84 90