Free, always, for people For teachers and helpers Accessibility Privacy Legal llms.txt site.md
howtobedigital

Spaced Learning Practice

Completion is not success

Post-course satisfaction cannot objectively establish learning or transfer. Delayed follow-up is the stronger transfer measure. Measurement is the moat: report delayed retention, behaviour, time-to-proficiency, error reduction, and business outcomes rather than completion alone.

Minimum evaluation stack
  • Baseline knowledge and performance
  • Immediate post-test
  • Delayed test at a business-relevant interval
  • Work sample or system behaviour
  • Comparison group or staggered rollout where feasible
  • Exposure and time-on-task data
  • Manager and learner barriers
  • An explicit decision rule for scale, revise, or stop

A measurement agreement is signed before build. CDC training-effectiveness guidance and related transfer literature inform the stack; client operational data defines the business outcome.

Go / no-go scorecard

DimensionPilot scale criterionStop or redesign signal
LearningMaterial delayed-retention improvement versus baseline or comparisonOnly immediate scores improve
TransferBetter work sample, manager observation, or valid system behaviourQuiz gains with no plausible transfer signal
EconomicsClear buyer value and reusable delivery assetsContent production consumes the entire fee
EngagementSustainable participation without excessive nudgingNotification fatigue, opt-outs, or role conflict
Evidence qualityTraceable data, balanced comparison, documented limitationsMissing baseline, changing measures, or selective reporting
PartnershipSponsor, data owner, SME, IT, and operations alignedL&D owns the pilot but the business rejects the outcome measure
Risks to mitigate
  • Exaggerated claims — claims policy
  • Notification fatigue — burden caps
  • Poor source content — provenance and SME gates
  • AI-generated errors — human approval for consequential answers
  • Inaccessible delivery — WCAG 2.2 AA testing
  • Privacy concerns — data minimisation; no use for employment decisions without explicit agreement
  • Inability to access work outcomes — measurement agreement before build

Evidence · Build plan