What is HeadlessChrome?
Headless Chrome is a tool provided by Google's open source Chromium project that gives software the ability to render web pages in full detail. One of the most common use cases is enabling AI agents to browse the internet through libraries like Playwright and Puppeteer. Agent Analytics can track when it visits your website.
Overview
| Source | Official Website |
| Expected To Follow Robots.txt | No |
| Insights Last Updated | August 11, 2026 |
Do you operate this agent? Contact us to suggest an update.
Category
Expected Behavior
HeadlessChrome is generic automation, so its traffic pattern depends entirely on the script or AI behind it. Human-guided runs tend to resemble short, deliberate sessions, while autonomous runs can look like a browser that never tires. Request timing and paths reveal more about its behavior than its name.
HeadlessChrome's User Agent
| User Agent | Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) HeadlessChrome/151.0.0.0 Safari/537.36 |
How To Block HeadlessChrome With Robots.txt
Add this rule to your robots.txt file to request that HeadlessChrome not access your website, or use Automatic Robots.txt to request the same of all automated agents at once. You can customize which pages are blocked by swapping out / for a different path.
User-agent: HeadlessChrome # https://knownagents.com/agents/headlesschrome
Disallow: /Global Statistics for HeadlessChrome
As of August 11, 2026, this data reflects agent visits measured across thousands of websites using Agent Analytics, combined with daily scans of the top 1000 websites and their robots.txt files.
Robots.txt Blocked Percentage
Country of Origin
Robots.txt Blocking Trend
0% of top websites block HeadlessChrome in their robots.txt files.
Overall Automated Agent Traffic
0.1% of all web traffic came from automated agents.
Top Visited Website Categories
The types of websites most frequently visited by HeadlessChrome.
Frequently Asked Questions
Should I Block HeadlessChrome?
Judge it by its behavior. This category ranges from harmless testing tools to abusive automation, and HeadlessChrome's purpose depends on whoever runs it. Block it if it targets login pages, submits forms, or crawls faster than a person reasonably could. Almost none of the top websites we track currently have robots.txt rules for HeadlessChrome.
Does HeadlessChrome Follow Robots.txt Rules?
No. HeadlessChrome is not expected to follow robots.txt directives, so a disallow rule only communicates your preference. Enforce the block with firewall or server rules, then use Agent Analytics to verify that its requests stop.
Does HeadlessChrome Access Private Content?
It can access whatever its configuration allows. If someone gives HeadlessChrome credentials, it can reach anything available to that account. Without them, it is limited to public pages.
Why Is HeadlessChrome Visiting My Website?
Someone automated a task that involves your site. HeadlessChrome may be running tests, collecting data, or following an AI system's instructions. Its visit pattern reveals more about its purpose than its user-agent string does.
How Can I Tell if HeadlessChrome Is Visiting My Website?
Agent Analytics tracks HeadlessChrome visits in real time alongside every other known AI agent, crawler, and scraper. You can also check your server logs for requests whose user-agent string contains "HeadlessChrome". Look for consistent timing or repeated navigation patterns unlikely to come from a person. Because HeadlessChrome does not publish a verification method, any client can claim its identity and a log match is only a clue.