Agents
Submit an Agent
All Agent Types
A directory of every known AI agent, crawler, scraper, and other bot on the internet.
Intelligence Gatherers
NetcraftSurveyAgent
NetcraftSurveyAgent is operated by Netcraft, a cybersecurity company specializing in threat intelligence and digital risk protection. The bot crawls websites to build thr…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
netEstate NE Crawler
netEstate NE Crawler systematically crawls websites to extract public contact information and business data for the netEstate business directory platform.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Neticle Crawler
Neticle Crawler is a web crawler operated by Neticle, a browser-based social and online media monitoring service. The bot collects web content to quantify online opinions…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
NetSeer crawler
NetSeer crawler is a web crawler operated by NetSeer that collects and analyzes web content for intelligence gathering purposes. This bot systematically visits websites t…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Netvibes
Netvibes is a web crawler operated by Netvibes, a dashboard and intelligence gathering service. The bot collects publicly available web content to aggregate and display i…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
NeuwoBot
NeuwoBot is a web crawler operated by Neuwo, a company that provides AI-powered contextual advertising solutions. It analyzes and classifies web content to generate conte…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
NewsRoom.BI
NewsRoom.BI is a web crawler operated by Marfeel, a company that provides analytics and personalization solutions for publishers. This bot likely collects data to support…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
NostoCrawlerBot
NostoCrawlerBot is operated by Nosto, a company that provides ecommerce personalization solutions including product recommendations, search personalization, and merchandi…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
OAI-AdsBot
OAI-AdsBot is OpenAI's bot that validates the safety and policy compliance of web pages submitted as advertisements on ChatGPT.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
outboundbuddy-enrichment
outboundbuddy-enrichment is operated by Outbound Buddy, a B2B go-to-market growth agency that specializes in helping SaaS and agency teams connect with ecommerce brands. …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
outbrain
outbrain is Outbrain's web crawler that analyzes content on publisher websites to understand context and topics for content recommendation and advertising purposes.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Owler
Owler is a business intelligence bot that gathers competitive intelligence and company information data. It crawls websites to collect publicly available information abou…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
page-preview-tool
page-preview-tool is SalesViewer's web crawler that visits websites to generate page previews and enrich company information for sales and marketing intelligence services…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Pandalytics
Pandalytics is a web crawler operated by Domainsbot, a company that provides domain-related data and business intelligence services to clients in the domain, hosting, and…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
panscient.com
panscient.com is an intelligence gatherer operated by Panscient. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
parse.ly scraper
parse.ly scraper is a web crawler operated by Parse.ly, a content analytics platform used by newsrooms and content marketers. The bot collects web content data to provide…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
PartnerOptimizer-bot
PartnerOptimizer-bot is a web crawler operated by PartnerOptimizer, a partner ecosystem intelligence platform that discovers, profiles, and analyzes B2B technology compan…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
productsup.io/crawler
productsup.io/crawler is a web crawler operated by Productsup, a product feed management platform that crawls websites to import product data for e-commerce and marketing…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
proximic
proximic is a contextual advertising crawler that analyzes website content to provide advanced contextual intelligence for programmatic advertising targeting and media op…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Quantcastbot
Quantcastbot is Quantcast's web crawler used for advertisement quality assurance and analyzing page content to build Interest-Based Audiences for targeted advertising and…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
QuuuBot
QuuuBot is operated by Quuu, a content curation and social media automation platform that uses machine learning to discover and schedule engaging content for brands to sh…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Qwarrybot
Qwarrybot is a web crawler operated by Qwarry, a French advertising technology company that provides contextual targeting and audience analysis services for programmatic …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
RankurBot
RankurBot is a web crawler operated by Rankur, an online reputation management and social media monitoring service. The bot scans web pages to collect data about brand me…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
RetroListeCOM
RetroListeCOM is a monitoring bot that regularly visits gaming websites, particularly Habbo Hotel retros, to collect and track real-time user count statistics for display…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
SalesViewerBot
SalesViewerBot is an intelligence gatherer operated by SalesViewer. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
scoop.it
scoop.it is an intelligence gatherer operated by Meltwater. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Scope3
The scope3 crawler indexes publicly available web content and paywalled media to assess content classification and brand safety.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
scraping@nytimes.com
NYTimes.com newsroom scraping bot collects publicly available, non-copyrighted data for journalistic projects including election result tracking, COVID-19 data aggregatio…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
SentiBot
SentiBot is a web crawler operated by SentiOne that indexes user-generated content for the SentiOne Listen platform. The bot analyzes over 300,000 domains daily from vari…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
SlickBot
SlickBot is Slickstream's web crawler that indexes customer websites to power engagement features like site search, content recommendations, and personalization for impro…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
slickstream
slickstream is an intelligence gatherer operated by Slickstream. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
SmartologyBot
SmartologyBot is a contextual advertising crawler that analyzes web content to generate semantic vectors for matching publisher content with relevant advertisements on th…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
SMTBot
SMTBot is a web crawler operated by Similarweb that scans websites to detect and catalog the technologies and software tools being used. The collected data powers Similar…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Sottopop
Sottopop is a web crawler operated by UpContent, a content curation and discovery platform that helps marketers find and share relevant articles and content. The bot fetc…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
StatistikAustria
StatistikAustria crawls e-commerce websites to collect product pricing data for calculating the official consumer price index of Austria, contributing to national economi…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Stripebot
Stripebot is a web crawler operated by Stripe, a payment processing platform, that fetches and analyzes web content related to merchant websites and online businesses tha…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Taboola
Taboola is an intelligence gatherer operated by Taboola. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Taboolabot
Taboolabot is a web crawler used by Taboola to audit advertiser campaign websites, collecting content metadata and site information to enable targeted content recommendat…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
TechSpyBot
TechSpyBot is an intelligence gathering bot operated by TechSpy. It crawls websites to collect competitive intelligence and market data.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
trendictionbot
trendictionbot is a web crawler operated by Talkwalker that gathers social media and online content data for social listening, media monitoring, and consumer intelligence…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
TrendsmapResolver
TrendsmapResolver is an intelligence gatherer operated by Trendsmap. If you think this is incorrect or can provide additional detail about its purpose, please let us know…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
TTD-Content
TTD-Content is a web crawler that classifies and analyzes webpage content for programmatic advertising purposes, helping advertisers determine brand-safe placement opport…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
TurnitinBot
TurnitinBot is a web crawler operated by Turnitin, an education technology company that provides plagiarism detection and academic integrity solutions. The bot collects w…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
TweetmemeBot
TweetmemeBot is an intelligence gatherer operated by Meltwater. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Twingly
Twingly is an intelligence gatherer operated by Twingly. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Twingly Recon-Sjostrom
Twingly Recon-Sjostrom is a web crawler operated by Twingly, a company that provides social data and news data from millions of online sources including news sites, blogs…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
uipbot
uipbot is a web crawler operated by Semasio, a semantic targeting and advertising technology company that analyzes web content to understand its meaning and context for d…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
um-FC
um-FC is a web crawler operated by Ubermetrics Technologies, a company that develops solutions for media monitoring and communications intelligence. This bot collects pub…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
um-IC
um-IC is a web crawler operated by Ubermetrics Technologies, the research and development arm of the UNICEPTA Group. The bot collects web content to support advanced solu…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
um-LN
um-LN is a web crawler operated by Ubermetrics Technologies, the research and development center of the UNICEPTA Group. This bot collects web content to support AI-based …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →