What is webpagetest?

Only if no one on your team relies on it. webpagetest may support uptime monitoring, performance tests, or audits. Blocking it without checking first can silently disrupt those workflows. Almost none of the top websites we track currently have robots.txt rules for webpagetest.

No. webpagetest is not expected to follow robots.txt directives, so a disallow rule only communicates your preference. Enforce the block with firewall or server rules, then use Agent Analytics to verify that its requests stop.

Only when configured with access. A team may grant webpagetest credentials to monitor staging sites or private health endpoints. Without those credentials, it sees only public pages.

Someone, most likely on your own team, configured webpagetest to check your site. Uptime monitors, performance testers, and audit tools visit only the sites or endpoints they are told to watch.

Agent Analytics tracks webpagetest visits in real time alongside every other known AI agent, crawler, and scraper. You can also check your server logs for requests whose user-agent string contains "webpagetest". Look for repeated checks of the same pages or endpoints at regular intervals. Because webpagetest does not publish a verification method, any client can claim its identity and a log match is only a clue.