One of the most common mistakes in legal training pilots is launching without a measurement framework. The programme runs, lawyers complete simulations, feedback is positive — and then someone in leadership asks "but what did it actually achieve?" and no one has a clean answer.
BeSavvy generates a significant amount of performance data automatically. This article explains the four core metrics we recommend every firm tracks from day one, and how to build on them with KPIs specific to your programme.
The starting point for any training programme is whether people are actually doing it — and finishing it. BeSavvy tracks how many target users start each simulation, how many complete it, and how long they take.
Completion rate is a more meaningful signal than it might appear. A simulation that most lawyers abandon halfway through is telling you something important — either about the content, the difficulty calibration, or the relevance of the scenario to the people doing it. Time-to-completion adds another dimension: a simulation that takes most lawyers three times longer than expected may be too complex, or may be surfacing a deeper skill gap worth investigating.
A well-designed simulation should motivate lawyers to complete it. Tracking this metric holds the content to account, not just the learner.
BeSavvy monitors task success rates across every simulation:
This data has two uses. At the individual level, it shows each lawyer where their gaps are and tracks improvement over time. At the cohort level, it gives L&D teams and Training Partners a clear picture of where the programme is working and where additional support or revised content is needed.
The goal is not to rank individuals — it is to identify the zones where lawyers need help, and focus training resources there rather than spreading them evenly across topics people already understand.
The most important metric — and the hardest to capture without the right system — is whether lawyers are actually getting better over time.
BeSavvy measures this through feedback-and-improvement loops. A lawyer completes a task, receives structured feedback on their output, and then re-attempts the task to achieve a higher score. The delta between first attempt and subsequent attempts, tracked across a cohort over weeks and months, is the clearest available evidence of genuine behaviour change rather than one-off performance.
This is the metric that answers the question leadership always asks: not "did they do the training?" but "are they better as a result of it?"
BeSavvy supports in-platform surveys that capture usefulness scores and NPS-style feedback after each simulation. These ratings — for example, an average usefulness score of 4.2 out of 5, or the percentage of lawyers who would recommend the simulation to a colleague — provide a real-time signal on whether the content is landing.
Satisfaction data matters for two reasons. It helps you improve content quickly, before poor simulations become embedded in the programme. And it provides a comparison point against traditional training: in our experience, lawyers consistently rate simulation-based training above lectures, e-learning modules, and workshops on measures of perceived usefulness and engagement.
| Metric | What it tells you | What to watch for |
|---|---|---|
| Participation, Completion, Time-to-Completion | Whether lawyers are doing the training and finishing it | Low completion rates signal content or relevance issues |
| Performance and Progress Insights | Where the cohort is strong and where gaps exist | Consistent errors on specific tasks point to training priorities |
| Behaviour Change | Whether lawyers are genuinely improving over time | Delta between first and repeat attempts is the key signal |
| User Feedback and Satisfaction | Whether lawyers find the training useful and engaging | Compare against baseline satisfaction with existing formats |
The four metrics above apply to every BeSavvy programme. But the most powerful measurement frameworks go further — and BeSavvy is built to support this.
These KPIs can reflect exactly what your firm is trying to develop and measure in a given context. Examples include:
Custom KPIs allow your programme to generate data that is meaningful to your firm specifically — not just generic engagement metrics. Over time, this data becomes a detailed picture of how each lawyer is developing across the skills that matter most to your practice.
If you are unsure which custom KPIs to define for your first simulations, the BeSavvy team can help you identify the right measures based on your training objectives and the simulation types you are building.