For MSPs
What security awareness metrics should MSPs show clients in QBRs?
Updated
Short answer
In a QBR, show a small set of security awareness metrics as trends over time: phishing click rate, report rate, training completion, repeat clickers and coverage (the share of staff enrolled). Pair each number with one sentence on what it means and one action for next quarter. Owners care about direction and evidence, not dashboards full of detail.
Which security awareness metrics matter most in a QBR?
Pick metrics the owner can understand in a few seconds and that tie to a decision. Five is usually enough.
- Click rate: the share of simulated phishing emails where someone clicked the link or opened the payload.
- Report rate: the share of simulated phishing emails that staff reported as suspicious.
- Training completion: the share of assigned lessons that were finished.
- Repeat clickers: the number of people who clicked in more than one simulation during the period.
- Coverage: the share of current staff who are enrolled and receiving simulations.
Why show trends instead of a single number?
A single click rate tells the owner very little. A rate that falls over three quarters tells a clear story: training is working and the money is well spent.
Show at least the last four quarters where you have them. If a quarter used much harder simulations, note it, because a harder lure can push the click rate up without anyone getting worse.
Microsoft makes a similar point in its own tooling, which estimates a predicted compromise rate per payload so actual results can be compared with how difficult the email was.
Is report rate more important than click rate?
Both matter, but report rate is often the better sign of a healthy culture. A low click rate can mean people ignore email; a rising report rate means they notice threats and tell someone.
Track how quickly reports arrive as well as how many. A report within minutes of the email landing is far more useful than one the next day.
Reporting also has a direct security benefit. When one person reports a real phishing email quickly, the MSP can remove it from other mailboxes before anyone else clicks.
How do you keep the numbers accurate?
Bad data ruins a QBR faster than bad results. Two problems cause most of it.
- Scanner clicks: email security tools often open links to check them, which can look like a person clicking. Filter these out or your click rate will be inflated.
- Stale user lists: people who left still receiving simulations, or new hires missing from them. Sync users from the client's directory so coverage reflects real staff.
How should the metrics be presented to a business owner?
Keep it to one slide or one page. For each metric give the current figure, the trend, a sentence on what it means and one action.
For example: "Click rate fell from last quarter. Three people clicked twice; we will give them a short follow up lesson this month."
Avoid naming and shaming individuals in a group meeting. Share names privately with the owner or manager if follow up is needed.
End with the plan for next quarter: what simulations are coming, who needs follow up training and any staff changes to sync. That turns the metrics into a reason for the client to keep the service running.
Which metrics also help with insurance and compliance?
The same numbers often answer questions on cyber insurance applications. Some forms ask whether training is at least annual, whether it includes phishing simulations, and whether people who fail get more training. AIG's CyberEdge ransomware supplemental, for example, asks whether fewer than 15% of employees were successfully phished on the last test.
NIST's guidance on building a learning program (SP 800-50 Rev. 1) also recommends using metrics and evaluation to improve training over time, which gives owners a recognised reference for why you track these figures.
Hand the client a dated report for the period so they can attach it to an application or keep it on file. NetMinder generates a branded cyber insurance report PDF for any date range with who was trained, simulations sent, click and report rates, and completion, which MSPs can reuse in QBRs.
Sources
- NIST SP 800-50 Rev. 1: Building a Cybersecurity and Privacy Learning Program
- Microsoft Learn: Get started using Attack simulation training (predicted compromise rate)
- AIG: CyberEdge ransomware supplemental questionnaire, March 2021 (PDF)
- Ridge Canada Cyber Solutions: Cyber application, large risk (PDF)