Agent Directory
The definitive guide to every known AI agent, crawler, scraper, and other bot on the internet, updated daily.
Intelligence Gatherers
PostitLeadDiscovery
PostitLeadDiscovery is a web crawler that collects public business contact information for lead research.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
PoweredByBot
PoweredByBot scans website homepages for technology fingerprints and declared AI-crawler policies. The data powers the PoweredBy technology-intelligence service operated …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
productsup.io/crawler
productsup.io/crawler is a web crawler operated by Productsup, a product feed management platform that crawls websites to import product data for e-commerce and marketing…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
PrognostiXonThinMiner
PrognostiXonThinMiner collects legislative and government information from public web pages for PrognostiXon's policy-monitoring and legislative-intelligence platform.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
proximic
proximic is a contextual advertising crawler that analyzes website content to provide advanced contextual intelligence for programmatic advertising targeting and media op…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Quantcastbot
Quantcastbot is Quantcast's web crawler used for advertisement quality assurance and analyzing page content to build Interest-Based Audiences for targeted advertising and…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
QuuuBot
QuuuBot is operated by Quuu, a content curation and social media automation platform that uses machine learning to discover and schedule engaging content for brands to sh…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Qwairy-Bot
Qwairy-Bot is a web crawler operated by Qwairy that collects public web content to monitor brand visibility across AI search systems.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Qwarrybot
Qwarrybot is a web crawler operated by Qwarry, a French advertising technology company that provides contextual targeting and audience analysis services for programmatic …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
RankshiftFetcher
RankshiftFetcher retrieves web pages cited by AI assistants and search engines for Rankshift. The platform uses the content to track brand mentions, source citations, and…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
RankurBot
RankurBot is a web crawler operated by Rankur, an online reputation management and social media monitoring service. The bot scans web pages to collect data about brand me…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
RetroListeCOM
RetroListeCOM is a monitoring bot that regularly visits gaming websites, particularly Habbo Hotel retros, to collect and track real-time user count statistics for display…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
revops-nuvo-detector
revops-nuvo-detector scans public websites to identify the software and technologies used by businesses. Nuvo uses these signals for account research supporting its order…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
SalesViewerBot
SalesViewerBot is an intelligence gatherer operated by SalesViewer.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ScalinthBot
ScalinthBot is a web crawler operated by Scalinth that collects and updates public company information for its B2B prospecting database.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
scoop.it
scoop.it is an intelligence gatherer operated by Meltwater.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Scope3
The scope3 crawler indexes publicly available web content and paywalled media to assess content classification and brand safety.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
scraping@nytimes.com
NYTimes.com newsroom scraping bot collects publicly available, non-copyrighted data for journalistic projects including election result tracking, COVID-19 data aggregatio…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
semantic-visions-analytica
semantic-visions-analytica is a web crawler operated by Semantic Visions that collects public news and web content for risk, compliance, and market-intelligence analysis.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
semantic-visions-infoseeker
semantic-visions-infoseeker is a web crawler operated by Semantic Visions that collects public news and web content for risk, compliance, and market-intelligence analysis…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
SemanticVisionsBot
SemanticVisionsBot collects articles from online news sources and blogs for Semantic Visions' open-source intelligence platform. The platform analyzes multilingual media …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
SenderBot
SenderBot is a web crawler operated by Sender Online Marketing that collects links and page text for internal analysis of client projects.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
SentiBot
SentiBot is a web crawler operated by SentiOne that indexes user-generated content for the SentiOne Listen platform. The bot analyzes over 300,000 domains daily from vari…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
SirdataBot
SirdataBot crawls web pages for Sirdata's Semantic API to analyze and classify content for contextual targeting.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
SiteStatsBot
SiteStatsBot collects public website metadata and measurements for Site Stats Database, where the information is organized into searchable site profiles and statistics.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
SlickBot
SlickBot is Slickstream's web crawler that indexes customer websites to power engagement features like site search, content recommendations, and personalization for impro…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
slickstream
slickstream is an intelligence gatherer operated by Slickstream.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
SmartologyBot
SmartologyBot is a contextual advertising crawler that analyzes web content to generate semantic vectors for matching publisher content with relevant advertisements on th…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
SMBsBot
SMBsBot collects public company information for SMBs.com's business directory and M&A origination database.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
SMTBot
SMTBot is a web crawler operated by Similarweb that scans websites to detect and catalog the technologies and software tools being used. The collected data powers Similar…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Sottopop
Sottopop is a web crawler operated by UpContent, a content curation and discovery platform that helps marketers find and share relevant articles and content. The bot fetc…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
SpamCipherBot
SpamCipherBot reads public company websites and job boards to keep business information current for SpamCipher's sales-prospecting and buying-signal features.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Speroll-AdsTxt-Crawler
Speroll-AdsTxt-Crawler retrieves ads.txt files for Speroll Media to verify authorized digital-advertising sellers and validate programmatic inventory.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
StatistikAustria
StatistikAustria crawls e-commerce websites to collect product pricing data for calculating the official consumer price index of Austria, contributing to national economi…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
StormIntelCrawler
StormIntelCrawler gathers hurricane and tropical-storm information for Hurricane Intel, which publishes advisories, forecasts, and analysis from meteorologist Bryan Norcr…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Stripebot
Stripebot is a web crawler operated by Stripe, a payment processing platform, that fetches and analyzes web content related to merchant websites and online businesses tha…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Taboola
Taboola is an intelligence gatherer operated by Taboola.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Taboolabot
Taboolabot is a web crawler used by Taboola to audit advertiser campaign websites, collecting content metadata and site information to enable targeted content recommendat…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
TechSpyBot
TechSpyBot is an intelligence gathering bot operated by TechSpy. It crawls websites to collect competitive intelligence and market data.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
TheWebReport
TheWebReport crawls websites to measure technology adoption, performance, security, and implementation quality across the web.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
TitanBot
TitanBot is a web crawler operated by Titan Materials Corp that collects public construction-industry information for Titan Construction IQ.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
topicsearch-crawler
topicsearch-crawler is a web crawler operated by FatGrid that indexes website topics for marketing, SEO, and business-discovery recommendations.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
tphotobot
tphotobot scans public web pages for photographs supplied by copyright owners and flags possible unauthorized uses for human review.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
trendictionbot
trendictionbot is a web crawler operated by Talkwalker that gathers social media and online content data for social listening, media monitoring, and consumer intelligence…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
TrendsmapResolver
TrendsmapResolver is an intelligence gatherer operated by Trendsmap.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
TTD-Content
TTD-Content is a web crawler that classifies and analyzes webpage content for programmatic advertising purposes, helping advertisers determine brand-safe placement opport…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
TurnitinBot
TurnitinBot is a web crawler operated by Turnitin, an education technology company that provides plagiarism detection and academic integrity solutions. The bot collects w…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
TweetmemeBot
TweetmemeBot is an intelligence gatherer operated by Meltwater.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Twingly
Twingly is an intelligence gatherer operated by Twingly.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Twingly Recon-Sjostrom
Twingly Recon-Sjostrom is a web crawler operated by Twingly, a company that provides social data and news data from millions of online sources including news sites, blogs…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →