For MSPs

What security awareness metrics should MSPs show clients in QBRs?

Updated

Short answer

In a QBR, show a small set of security awareness metrics as trends over time: phishing click rate, report rate, training completion, repeat clickers and coverage (the share of staff enrolled). Pair each number with one sentence on what it means and one action for next quarter. Owners care about direction and evidence, not dashboards full of detail.

Which security awareness metrics matter most in a QBR?

Pick metrics the owner can understand in a few seconds and that tie to a decision. Five is usually enough.

  • Click rate: the share of simulated phishing emails where someone clicked the link or opened the payload.
  • Report rate: the share of simulated phishing emails that staff reported as suspicious.
  • Training completion: the share of assigned lessons that were finished.
  • Repeat clickers: the number of people who clicked in more than one simulation during the period.
  • Coverage: the share of current staff who are enrolled and receiving simulations.

Is report rate more important than click rate?

Both matter, but report rate is often the better sign of a healthy culture. A low click rate can mean people ignore email; a rising report rate means they notice threats and tell someone.

Track how quickly reports arrive as well as how many. A report within minutes of the email landing is far more useful than one the next day.

Reporting also has a direct security benefit. When one person reports a real phishing email quickly, the MSP can remove it from other mailboxes before anyone else clicks.

How do you keep the numbers accurate?

Bad data ruins a QBR faster than bad results. Two problems cause most of it.

  • Scanner clicks: email security tools often open links to check them, which can look like a person clicking. Filter these out or your click rate will be inflated.
  • Stale user lists: people who left still receiving simulations, or new hires missing from them. Sync users from the client's directory so coverage reflects real staff.

How should the metrics be presented to a business owner?

Keep it to one slide or one page. For each metric give the current figure, the trend, a sentence on what it means and one action.

For example: "Click rate fell from last quarter. Three people clicked twice; we will give them a short follow up lesson this month."

Avoid naming and shaming individuals in a group meeting. Share names privately with the owner or manager if follow up is needed.

End with the plan for next quarter: what simulations are coming, who needs follow up training and any staff changes to sync. That turns the metrics into a reason for the client to keep the service running.

Which metrics also help with insurance and compliance?

The same numbers often answer questions on cyber insurance applications. Some forms ask whether training is at least annual, whether it includes phishing simulations, and whether people who fail get more training. AIG's CyberEdge ransomware supplemental, for example, asks whether fewer than 15% of employees were successfully phished on the last test.

NIST's guidance on building a learning program (SP 800-50 Rev. 1) also recommends using metrics and evaluation to improve training over time, which gives owners a recognised reference for why you track these figures.

Hand the client a dated report for the period so they can attach it to an application or keep it on file. NetMinder generates a branded cyber insurance report PDF for any date range with who was trained, simulations sent, click and report rates, and completion, which MSPs can reuse in QBRs.

Sources

  1. NIST SP 800-50 Rev. 1: Building a Cybersecurity and Privacy Learning Program
  2. Microsoft Learn: Get started using Attack simulation training (predicted compromise rate)
  3. AIG: CyberEdge ransomware supplemental questionnaire, March 2021 (PDF)
  4. Ridge Canada Cyber Solutions: Cyber application, large risk (PDF)

Common questions

What is a good phishing click rate to show in a QBR?

There is no universal target, because results depend on how hard the simulations are. Focus on the trend for that client over time and explain any change in difficulty. Some insurers use their own thresholds, such as AIG's question about fewer than 15% of employees being phished.

How many security awareness metrics should an MSP include in a QBR?

About five is enough for most small business clients: click rate, report rate, training completion, repeat clickers and coverage. More than that tends to bury the message the owner needs to hear.

Should MSPs name employees who clicked in a QBR?

Not in a group setting. Share individual results privately with the owner or the person's manager if follow up is needed, and keep the QBR focused on overall trends and actions.

Why might a client's click rate suddenly jump?

Common causes are harder simulation emails, a new batch of untrained hires, or email security scanners opening links and being counted as clicks. Check scanner filtering and the user list before drawing conclusions.

Can QBR security awareness reports be used for cyber insurance?

Often, yes. Many insurance applications ask about training frequency, phishing simulations and follow up for people who fail. A dated report covering the policy period helps the client answer accurately and keep evidence on file.

Read next

Microsoft 365Why do phishing simulations show clicks nobody made?Email security tools open links automatically to check whether they are safe. Microsoft Defender Safe Links scans URLs before delivery and can detonate unknown links in the background, and many gateways and sandboxes do the same. A phishing simulation that counts every link visit as a click will record these automated checks as people clicking, which inflates click rates and blames staff who never opened the email.Insurance and complianceDo cyber insurers require security awareness training?Many cyber insurers ask about security awareness training, and some ask specifically about phishing simulations and how often staff fail them. Requirements vary by insurer, form and policy size: some applications ask several detailed training questions, others ask none. Answer every question accurately, because insurers rely on the application, and keep records that prove what you said.Phishing basicsHow often should you run phishing simulations?For most small businesses, once a month is a sensible default: one short practice email per person, with a quick lesson for anyone who clicks. Official guidance from the NCSC, the Canadian Centre for Cyber Security and NIST does not set a fixed frequency. Monthly is a practical choice because it builds a habit, gives a usable trend and stays light enough that staff do not resent it.For MSPsHow do MSPs sell security awareness training to small business clients?MSPs sell security awareness training most easily by tying it to something the client already has to deal with: a cyber insurance application, a compliance rule such as the FTC Safeguards Rule, or a recent phishing scare. Package it inside your managed plan or as a simple per user add-on, run it for the client with little effort on their side, and show results in every review.

Run this for every client.

NetMinder runs monthly practice emails, short lessons and insurer-ready reports under your brand.