Agent Directory
The definitive guide to every known AI agent, crawler, scraper, and other bot on the internet, updated daily.
Archivers
bl.uk_lddc_bot
bl.uk_lddc_bot is operated by the British Library as part of their legal deposit web archiving program, which collects and preserves UK web content for the national archi…
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
bne.es_bot
bne.es_bot is an archiver.
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
bnf.fr_bot
bnf.fr_bot is the official web crawler of the Bibliothèque nationale de France (BNF), systematically collecting and archiving digital content from French websites to pres…
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
CUCH.org Archive Bot
CUCH.org Archive Bot is a web crawler that archives web content on behalf of C U Cyber History.
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
heritrix
heritrix is an archiver operated by Internet Archive.
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
ia_archiver
ia_archiver is an archiver operated by Internet Archive.
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
ia_archiver-web.archive.org
ia_archiver-web.archive.org is an archiver operated by Internet Archive.
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
IABot
IABot (InternetArchiveBot) is a Wikipedia bot operated by the Internet Archive that combats link rot by finding dead links on Wikipedia articles and adding archived versi…
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
Internet Archive
Internet Archive is an archiver operated by Internet Archive.
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
mirrorweb
mirrorweb is a web archiving crawler that captures websites in their entirety, including dynamic content and interactive elements, creating tamper-proof WARC archives for…
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
netarkivindsamling
netarkivindsamling is a web crawler operated by the Royal Danish Library that collects Danish internet content according to the Danish Legal Deposit Act for preservation …
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
Nicecrawler
Nicecrawler is an archiver operated by NiceCrawler.
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
SmarshBot
SmarshBot is an archiving bot operated by Smarsh that crawls and captures web content for compliance management and regulatory recordkeeping purposes. Organizations use t…
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
special_archiver
special_archiver is a web crawler operated by Internet Archive as part of their Archive-It service, which creates and preserves collections of web content. This bot visit…
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
Turnitin
Turnitin crawler gathers web content to build a comprehensive database for plagiarism detection services, comparing student papers against internet content for academic i…
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
XY-Archive-Compliance
XY-Archive-Compliance creates website archives to help customers meet regulatory and legal compliance requirements for data retention and historical website preservation.
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
XY-Archive-Compliance-Archiver
XY-Archive-Compliance-Archiver is an archiving bot operated by XY Planning Network, a membership organization for fee-only financial advisors. This bot archives web conte…
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →
Automated Agents
Amazon Bedrock AgentCore Browser
Amazon Bedrock AgentCore Browser is a cloud-based browser service that runs on AWS infrastructure. It enables AI agents and applications to interact with websites, naviga…
Automated Agent
Automated Agent
Automates browser interactions programmatically without direct human supervision
See More →
Anchor Browser
Anchor Browser is Anchor's cloud-hosted browser designed to enable AI agents to interact with websites in a human-like manner while maintaining verified, legitimate autom…
Automated Agent
Automated Agent
Automates browser interactions programmatically without direct human supervision
See More →
Browserbase
Browserbase is a cloud browser platform that enables AI agents and applications to autonomously read, write, and perform tasks on the web. It provides scalable, fast, and…
Automated Agent
Automated Agent
Automates browser interactions programmatically without direct human supervision
See More →
Cloudflare Browser Rendering
Cloudflare Browser Rendering is a serverless browser automation service that runs on Cloudflare Workers. It enables AI agents and applications to control a headless brows…
Automated Agent
Automated Agent
Automates browser interactions programmatically without direct human supervision
See More →
HeadlessChrome
Headless Chrome is a tool provided by Google's open source Chromium project that gives software the ability to render web pages in full detail. One of the most common use…
Automated Agent
Automated Agent
Automates browser interactions programmatically without direct human supervision
See More →
Known Agents Browser
Known Agents Browser is an automated agent operated by Known Agents.
Automated Agent
Automated Agent
Automates browser interactions programmatically without direct human supervision
See More →
Developer Helpers
2ip bot
2ip bot is a developer helper operated by 2IP.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
360monitoring
360monitoring is a developer helper operated by 360Monitoring.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
AccessStatus
AccessStatus is a monitoring bot that checks HTTP status codes of web pages to determine if URLs are active, redirected, or returning errors for website uptime monitoring…
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Acquia optimize (Monsido)
Acquia optimize (Monsido) is a developer helper.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
ActiveComply Bot
ActiveComply Bot is a developer helper operated by ActiveComply.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Adagio Bot
Adagio Bot is a developer helper operated by Adagio.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
AgentReadinessScanner
AgentReadinessScanner is a bot operated by Cloudflare that scans websites to assess their readiness for AI agents by checking for emerging standards such as llms.txt, MCP…
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
AlertSite
AlertSite is SmartBear's synthetic monitoring service that uses automated probes to monitor website availability, performance, and functionality from global monitoring lo…
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Alertsite by Smartbear
Alertsite by Smartbear is a developer helper operated by SmartBear.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Automaton
Automaton is a developer helper operated by Automaton.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
AutomatonHeadlessChrome
AutomatonHeadlessChrome is a headless browser automation tool that performs end-to-end testing of marketing campaigns and integration testing to verify that advertising a…
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Better Uptime
Better Uptime is a developer helper operated by Better Stack.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Better Uptime Bot
Better Uptime Bot is Better Stack's monitoring bot that checks website and infrastructure uptime, performing automated health checks and status monitoring to alert users …
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
binarycanary
binarycanary is a developer helper operated by Binary Canary.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Black Duck Fast Dynamic
Black Duck Fast Dynamic is a developer helper operated by Black Duck.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Blockaid
Blockaid is a developer helper operated by Blockaid.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
BlogVault
BlogVault is a WordPress backup and monitoring service bot that performs automated backups, security scans, and site monitoring to protect WordPress websites from data lo…
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
BugsNag
Bugsnag is an error tracking and performance monitoring service that automatically detects application crashes, exceptions, and performance issues, providing developers w…
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Bugsnag script fetcher
Bugsnag script fetcher is a bot operated by Bugsnag, an error monitoring and reporting platform for software applications. This bot fetches JavaScript source files and so…
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
bushbaby
bushbaby is a bot operated by Cloudflare, a company that provides web infrastructure and security services. This bot is likely used for monitoring, testing, or maintainin…
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Catchpoint
Catchpoint is a synthetic monitoring agent that tests website performance, availability, and functionality from global monitoring locations as part of Catchpoint's Intern…
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Checkly
Checkly is a synthetic monitoring platform that performs automated end-to-end testing and API monitoring using Playwright and Puppeteer to check website functionality, pe…
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Checkly Bot
Checkly Bot is a developer helper operated by Checkly.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Chirp
Chirp is a monitoring bot operated by Binary Canary, a website and server uptime monitoring service that has been operating since 2010. The bot checks websites to detect …
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Chrome-Lighthouse
Chrome-Lighthouse is an automated, open-source tool that audits web pages for performance, accessibility, progressive web apps, SEO, and best practices. It runs a series …
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Cloudflare Radar URL Scanner
Cloudflare Radar URL Scanner is a developer helper operated by Cloudflare.
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →
Cloudflare SpeedTest
Cloudflare SpeedTest is a bot operated by Cloudflare that performs speed tests to measure website performance and connectivity. It may visit websites to test network late…
Developer Helper
Developer Helper
Assists with testing, debugging, and ensuring website functionality
See More →