Microsoft 365

Why do phishing simulations show clicks nobody made?

Updated

Short answer

Email security tools open links automatically to check whether they are safe. Microsoft Defender Safe Links scans URLs before delivery and can detonate unknown links in the background, and many gateways and sandboxes do the same. A phishing simulation that counts every link visit as a click will record these automated checks as people clicking, which inflates click rates and blames staff who never opened the email.

Why would a phishing simulation record a click nobody made?

A phishing simulation knows someone clicked because a request arrives at its tracking link. It cannot see who sent that request, only the request itself. If anything other than a person visits the link, it can look exactly like a click.

Email security products are built to visit links. Their job is to check where a URL leads before a person gets there. When they visit a simulation link, a basic platform records a click against the recipient, even if that person never saw the email.

The result is a false positive: a staff member is marked as having failed, may be sent remedial training, and the business sees a click rate that has little to do with real behaviour.

How do false clicks distort phishing simulation results?

Automated visits tend to arrive in bursts, often for many recipients at once and soon after delivery. On a small team, a single scanner sweep can make it look as though most of the office clicked.

This causes three practical problems. Click rates look worse than reality, so trends over time are unreliable. Individual staff are wrongly told they failed, which damages trust in the program. And the business may spend time on remedial training for people who did nothing wrong.

The UK NCSC warns that blaming users for clicks does not work and that simulations can erode trust. Telling someone they clicked when they did not is an easy way to lose that trust.

How can you tell a scanner from a real person?

No single signal is perfect, so reliable filtering combines several. Look at each link visit against what a person reading email would actually do.

  • Timing: visits within seconds of delivery, or before the message could plausibly have been opened, point to automation.
  • Patterns: every link in the message opened at once, or many recipients visited within the same moment.
  • Network: visits from cloud hosting or known security vendor address ranges rather than the business's own internet connection or a mobile carrier.
  • Browser: unusual or headless browser signatures, missing headers, or requests that never load the page's images and scripts.
  • Follow-through: a person usually lands on the page and interacts with it. A scanner often fetches the page and leaves.

What should you set up to reduce false clicks?

Start with configuration, then use filtering for what is left. In Microsoft 365, configure the advanced delivery policy for your simulation vendor. Microsoft documents that for matching messages, Safe Links does not block or detonate the URLs at time of click, and Safe Attachments does not detonate attachments. URLs are still wrapped.

Advanced delivery does not cover every tool in the mail path, so third-party gateways may need their own allow settings. Do not add simulation URLs to the Safe Links Do not rewrite list, because Microsoft warns this might cause unwanted click alerts.

Finally, keep the raw events. When someone disputes a click, a per-person timeline showing each visit with its time, network and browser lets you settle the question with evidence rather than argument.

NetMinder Security, a white-label phishing simulation platform for MSPs, was built around this problem. Every link visit is checked for timing, browser and network signals, and known scanner ranges are filtered, so email security tools opening links do not count as clicks. Thresholds can be tuned per client, and every event is kept in a per-person timeline.

Sources

  1. Microsoft Learn: Complete Safe Links overview for Microsoft Defender for Office 365
  2. Microsoft Learn: Configure the advanced delivery policy for non-Microsoft phishing simulations
  3. Microsoft Learn: Get started using Attack simulation training
  4. NCSC: Phishing attacks, defending your organisation

Common questions

Does Microsoft Safe Links click on links in emails?

Safe Links scans URLs before the message is delivered and can detonate links without a valid reputation in the background. It also checks rewritten links again when a user clicks. To a phishing simulation platform, these checks can look like a click unless they are filtered out.

Does the advanced delivery policy stop Safe Links from scanning simulation links?

Microsoft documents that for messages matching the advanced delivery policy, Safe Links does not block or detonate the URLs at time of click, though the URLs are still wrapped. It does not control third-party gateways or other tools, so a simulation platform still needs its own scanner filtering.

Why did my whole office click the phishing test within a minute?

A burst of clicks for many people within seconds of delivery is a strong sign of automated scanning, not human behaviour. Check the timing, source network and browser details of each visit. If they come from security vendor or cloud hosting addresses, they are very likely scanner visits.

Should I whitelist the simulation domain in my email gateway?

Follow your gateway vendor's documented method for phishing simulations or trusted senders, and scope it as narrowly as possible. In Microsoft 365, use the advanced delivery policy rather than general allow lists. Avoid broad exceptions that would also let real phishing through.

Can a phishing simulation ever be 100 percent sure a click was human?

No. Filtering reduces false clicks a lot but cannot be perfect, because some tools imitate real browsers. That is why keeping a timeline of every event matters: it lets an MSP review a disputed click and correct the record.

Run this for every client.

NetMinder runs monthly practice emails, short lessons and insurer-ready reports under your brand.