Agent Directory
The definitive guide to every known AI agent, crawler, scraper, and other bot on the internet, updated daily.
Intelligence Gatherers
Buck
Buck is a web crawler operated by Hypefactors, a unified PR software platform that provides media monitoring and analytics services. The bot collects media coverage data …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
CandidOrgWebCheck
CandidOrgWebCheck visits nonprofit websites to verify and update organization profiles in Candid's nonprofit and foundation database.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
captify-crawler
captify-crawler gathers web content and contextual signals for Captify's Search Intelligence platform.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
centryx-domain-mill
centryx-domain-mill is a web crawler operated by Centryx that collects domain and website information for its B2B prospecting workflows.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
channable
channable bot automates multichannel e-commerce marketing by crawling product data from webshops to optimize feeds, listings, and advertising campaigns across 3000+ platf…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
CheckMarkNetwork
CheckMarkNetwork is a web crawler operated by CheckMark Network, a brand protection and trademark monitoring company. The bot crawls websites to help clients track their …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Cincraw
Cincraw is an intelligence gatherer operated by CINC.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Clickagy Intelligence Bot
Clickagy Intelligence Bot is a web crawler operated by Clickagy, a company that gathers intelligence and data from websites. This bot is classified as an Intelligence Gat…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Clickagy Intelligence Bot v2
Clickagy Intelligence Bot v2 performs advanced ad verification, privacy compliance tracking, and digital advertising intelligence gathering across websites for market ana…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
CompanyMapBot
CompanyMapBot matches UK business websites to Companies House records using public registration numbers, VAT numbers, addresses, and other company details.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ContextualBot
ContextualBot is a web crawler operated by Mobian that gathers intelligence and contextual information from websites. This bot is categorized as an intelligence gatherer,…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ContextWebCom-AdsTxt
ContextWebCom-AdsTxt is a crawler that retrieves ads.txt files for digital-advertising inventory verification.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
contxbot
contxbot is Amazon's web crawler that processes and indexes webpage content to understand website topics and context for delivering relevant advertisements through Amazon…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
CriteoBot
CriteoBot is Criteo's web crawler that visits and analyzes web pages to understand content and user behavior patterns for serving personalized advertising campaigns.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
cXensebot
cXensebot is Cxense's web crawler that performs content indexing and behavioral data collection to power Piano's customer data platform, enabling real-time analytics and …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
CypressGrowthDiligence
CypressGrowthDiligence is a web crawler that reads public company about and team pages for private-company sourcing.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Dataprovider
Dataprovider is a web crawler that indexes over 700 million domains to create a structured database of website information, technologies, and business insights for data i…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Dataprovider.com
Dataprovider.com is an intelligence gatherer operated by Dataprovider.com.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
DomainDrift
DomainDrift continuously monitors a large catalog of domains for changes to nameservers, mail servers, TLS certificates, hosting providers, and other infrastructure. It p…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Dragonfly
Dragonfly is a web crawler operated by Publisher Discovery that gathers intelligence about publishers and websites. It is used to discover and collect information about o…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ds9
ds9 is operated by Copyright Clearance Center and crawls websites to gather information about published content for copyright licensing and rights management purposes. Th…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
DVbot
DVbot is operated by DoubleVerify, a digital advertising verification company that monitors and measures media transactions across websites to ensure ad quality, detect f…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
dwelltime-bot
dwelltime-bot is a web crawler operated by Dwell that collects public content for personalized daily recommendations.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Echobot Bot
Echobot Bot is an intelligence gatherer operated by Echobox.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
EcoVadisSustainabilityBot
EcoVadisSustainabilityBot is a web crawler operated by EcoVadis, a company that provides sustainability ratings and intelligence for businesses and their supply chains. T…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
EpivozCrawler
EpivozCrawler is Techmeme's web crawler that systematically crawls news articles and blog posts to gather information for Techmeme's technology news aggregation service.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ev-crawler
ev-crawler is an intelligence gatherer operated by Headline.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
EzLynx
EzLynx is a web crawler operated by Ezoic, a platform that provides website optimization and ad testing services. This bot gathers intelligence from websites to help anal…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
EzoicBot
EzoicBot is a crawler operated by Ezoic, a data-driven ad monetization platform that provides advertising optimization services to website publishers. This bot performs i…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
EzoicBot-Nicheiq
EzoicBot-Nicheiq is a web crawler operated by Ezoic, a platform that provides ad optimization and site testing services for publishers. This bot gathers intelligence abou…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
factset_spyderbot
factset_spyderbot is a web crawler operated by FactSet that gathers financial and business data from websites to support their comprehensive financial data platform and a…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
FDL Stats Bot
FDL Stats Bot crawls publicly available Rocket League player data from various platforms to generate analytical statistics for the Frontier Doubles League competition.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Fedicabot
Fedicabot is a web crawler operated by Fedica, a social media analytics and publishing platform. It likely visits websites to gather data related to social media content …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
FirmCredBot
FirmCredBot collects public company information for Firm Cred's directory of B2B service providers. The platform combines website research with verified client reviews an…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
FlowIQLabsBot
FlowIQLabsBot is an internet-measurement crawler operated by FlowIQ Labs that records protocol, banner, handshake, TLS certificate, and geolocation data from public servi…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ForestEngine
ForestEngine scans publicly accessible internet services and records TLS certificates, response headers, service banners, and web homepages. The data powers Forest's sear…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
getdomaindata
getdomaindata requests public website homepages and detects technologies such as hosting providers, ecommerce platforms, content management systems, JavaScript frameworks…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
GlobRadarBot
GlobRadarBot is a web crawler operated by GlobRadar that collects public company and contact information for its Portuguese business database.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
GnowitNewsbot
GnowitNewsbot collects news, government, regulatory, and industry content for Gnowit's media and policy monitoring platform.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google AdsBot
Google AdsBot is an intelligence gatherer operated by Google.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google AdSense
Google AdSense is an intelligence gatherer operated by Google.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google-adstxt
Google-adstxt is an intelligence gatherer operated by Google.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google-Adwords-Instant
Google-Adwords-Instant is the web crawler bot connected to the Google Ads platform that visits advertiser landing pages to perform quality checks, verification, and compl…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google-Display-Ads-Bot
Google-Display-Ads-Bot is operated by Google and crawls websites to analyze their content for contextual ad targeting and placement in the Google Display Network. This bo…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
GovAPIEnricher
GovAPIEnricher is a web crawler operated by Mega Impacts that collects public government API information for data enrichment.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
GrapeshotCrawler
GrapeshotCrawler analyzes web content for Oracle Advertising's contextual targeting system, classifying pages to ensure brand-safe ad placements.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
GroovinaAdsbot
GroovinaAdsbot is the web crawler used by Groovinads to gather data from e-commerce websites and digital advertising spaces to support their AI-powered display campaign o…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
GrowthXBot
GrowthXBot retrieves public website content for GrowthX's organic-growth platform. GrowthX analyzes the content for search optimization, answer-engine visibility, and con…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
HubSpot
HubSpot is an intelligence gatherer operated by HubSpot.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
IAS crawler
ias_crawler from Integral Ad Science performs digital ad verification, brand safety monitoring, and fraud detection across digital advertising channels to ensure quality …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →