Agents
Submit an Agent
All Agent Types
A directory of every known AI agent, crawler, scraper, and other bot on the internet.
AI Search Crawlers
PerplexityBot
PerplexityBot is the web crawler for Perplexity AI that indexes web content to power the AI search engine's real-time information retrieval and answer generation capabili…
AI Search Crawler
AI Search Crawler
Indexes website content to possibly include as citations in AI-powered search results
See More →
PetalBot
PetalBot is Huawei's web crawler that indexes PC and mobile websites to build search databases for Petal Search engine and provide AI-powered content recommendations for …
AI Search Crawler
AI Search Crawler
Indexes website content to possibly include as citations in AI-powered search results
See More →
xAI-SearchBot
xAI-SearchBot is a web crawler operated by xAI, the company behind Grok, to collect information from across the web for use in their search and chatbot products. This bot…
AI Search Crawler
AI Search Crawler
Indexes website content to possibly include as citations in AI-powered search results
See More →
ZanistaBot
ZanistaBot is an AI search crawler operated by Zanista. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
AI Search Crawler
AI Search Crawler
Indexes website content to possibly include as citations in AI-powered search results
See More →
Archivers
Archive-It
Archive-It is a web archiving crawler operated by Internet Archive that preserves copies of web pages for long-term digital preservation and historical record-keeping. It…
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
archive.org_bot
archive.org_bot is the Internet Archive's web crawler for the Wayback Machine, systematically crawling and preserving publicly accessible web pages for historical record …
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
Arquivo-web-crawler
Arquivo-web-crawler is the Portuguese web archive's bot that systematically crawls and preserves Portuguese websites for historical research, creating a comprehensive dig…
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
Authory
Authory is an automated content archiving crawler that systematically searches for and backs up published articles, podcasts, and videos by journalists and content creato…
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
bl.uk_lddc_bot
bl.uk_lddc_bot is operated by the British Library as part of their legal deposit web archiving program, which collects and preserves UK web content for the national archi…
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
bne.es_bot
bne.es_bot is an archiver. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
bnf.fr_bot
bnf.fr_bot is the official web crawler of the Bibliothèque nationale de France (BNF), systematically collecting and archiving digital content from French websites to pres…
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
CUCH.org Archive Bot
CUCH.org Archive Bot is a web crawler that archives web content on behalf of C U Cyber History.
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
heritrix
heritrix is an archiver operated by Internet Archive. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
ia_archiver
ia_archiver is an archiver operated by Internet Archive. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
ia_archiver-web.archive.org
ia_archiver-web.archive.org is an archiver operated by Internet Archive. If you think this is incorrect or can provide additional detail about its purpose, please let us …
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
IABot
IABot (InternetArchiveBot) is a Wikipedia bot operated by the Internet Archive that combats link rot by finding dead links on Wikipedia articles and adding archived versi…
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
Internet Archive
Internet Archive is an archiver operated by Internet Archive. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
mirrorweb
mirrorweb is a web archiving crawler that captures websites in their entirety, including dynamic content and interactive elements, creating tamper-proof WARC archives for…
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
netarkivindsamling
netarkivindsamling is a web crawler operated by the Royal Danish Library that collects Danish internet content according to the Danish Legal Deposit Act for preservation …
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
Nicecrawler
Nicecrawler is an archiver operated by NiceCrawler. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
SmarshBot
SmarshBot is an archiving bot operated by Smarsh that crawls and captures web content for compliance management and regulatory recordkeeping purposes. Organizations use t…
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
special_archiver
special_archiver is a web crawler operated by Internet Archive as part of their Archive-It service, which creates and preserves collections of web content. This bot visit…
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
Turnitin
Turnitin crawler gathers web content to build a comprehensive database for plagiarism detection services, comparing student papers against internet content for academic i…
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
XY-Archive-Compliance
XY-Archive-Compliance creates website archives to help customers meet regulatory and legal compliance requirements for data retention and historical website preservation.
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
XY-Archive-Compliance-Archiver
XY-Archive-Compliance-Archiver is an archiving bot operated by XY Planning Network, a membership organization for fee-only financial advisors. This bot archives web conte…
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
Automated Agents
Amazon Bedrock AgentCore Browser
Amazon Bedrock AgentCore Browser is a cloud-based browser service that runs on AWS infrastructure. It enables AI agents and applications to interact with websites, naviga…
Automated Agent
Automated Agent
Automates browser interactions programmatically without direct human supervision
See More →
Anchor Browser
Anchor Browser is Anchor's cloud-hosted browser designed to enable AI agents to interact with websites in a human-like manner while maintaining verified, legitimate autom…
Automated Agent
Automated Agent
Automates browser interactions programmatically without direct human supervision
See More →
Browserbase
Browserbase is a cloud browser platform that enables AI agents and applications to autonomously read, write, and perform tasks on the web. It provides scalable, fast, and…
Automated Agent
Automated Agent
Automates browser interactions programmatically without direct human supervision
See More →
Cloudflare Browser Rendering
Cloudflare Browser Rendering is a serverless browser automation service that runs on Cloudflare Workers. It enables AI agents and applications to control a headless brows…
Automated Agent
Automated Agent
Automates browser interactions programmatically without direct human supervision
See More →
HeadlessChrome
Headless Chrome is a tool provided by Google's open source Chromium project that gives software the ability to render web pages in full detail. One of the most common use…
Automated Agent
Automated Agent
Automates browser interactions programmatically without direct human supervision
See More →
Known Agents Browser
Known Agents Browser is an automated agent operated by Known Agents. If you think this is incorrect or can provide additional detail about its purpose, please let us know…
Automated Agent
Automated Agent
Automates browser interactions programmatically without direct human supervision
See More →
Developer Helpers
2ip bot
2ip bot is a developer helper operated by 2IP. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
360monitoring
360monitoring is a developer helper operated by 360Monitoring. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
AccessStatus
AccessStatus is a monitoring bot that checks HTTP status codes of web pages to determine if URLs are active, redirected, or returning errors for website uptime monitoring…
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Acquia optimize (Monsido)
Acquia optimize (Monsido) is a developer helper. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
ActiveComply Bot
ActiveComply Bot is a developer helper operated by ActiveComply. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Adagio Bot
Adagio Bot is a developer helper operated by Adagio. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
AgentReadinessScanner
AgentReadinessScanner is a bot operated by Cloudflare that scans websites to assess their readiness for AI agents by checking for emerging standards such as llms.txt, MCP…
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
AlertSite
AlertSite is SmartBear's synthetic monitoring service that uses automated probes to monitor website availability, performance, and functionality from global monitoring lo…
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Alertsite by Smartbear
Alertsite by Smartbear is a developer helper operated by SmartBear. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Automaton
Automaton is a developer helper operated by Automaton. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
AutomatonHeadlessChrome
AutomatonHeadlessChrome is a headless browser automation tool that performs end-to-end testing of marketing campaigns and integration testing to verify that advertising a…
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Better Uptime
Better Uptime is a developer helper operated by Better Stack. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Better Uptime Bot
Better Uptime Bot is Better Stack's monitoring bot that checks website and infrastructure uptime, performing automated health checks and status monitoring to alert users …
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
binarycanary
binarycanary is a developer helper operated by Binary Canary. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Black Duck Fast Dynamic
Black Duck Fast Dynamic is a developer helper operated by Black Duck. If you think this is incorrect or can provide additional detail about its purpose, please let us kno…
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Blockaid
Blockaid is a developer helper operated by Blockaid. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
BlogVault
BlogVault is a WordPress backup and monitoring service bot that performs automated backups, security scans, and site monitoring to protect WordPress websites from data lo…
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
BugsNag
Bugsnag is an error tracking and performance monitoring service that automatically detects application crashes, exceptions, and performance issues, providing developers w…
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Bugsnag script fetcher
Bugsnag script fetcher is a bot operated by Bugsnag, an error monitoring and reporting platform for software applications. This bot fetches JavaScript source files and so…
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →