Agents
All Agent Types
Every known artificial agent (bot) on the internet. You can track their activity on your website with Agent Analytics, or control their behavior with Automatic Robots.txt.
Intelligence Gatherers
Klaviyo
Klaviyo is a web tracking script that collects visitor behavior data, product views, and site interactions to enable personalized email and SMS marketing campaigns throug…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
KStandBot
KStandBot is an intelligence gatherer operated by URL Classification. If you think this is incorrect or can provide additional detail about its purpose, please let us kno…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Leikibot
Leikibot is a web crawler operated by DoubleVerify that analyzes webpage content for digital advertising verification, brand safety, and ad fraud detection services.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
LightspeedSystemsCrawler
LightspeedSystemsCrawler is an intelligence gatherer operated by Lightspeed Systems. If you think this is incorrect or can provide additional detail about its purpose, pl…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
linkfluence
linkfluence is an intelligence gatherer operated by Meltwater. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
LinkWalker
LinkWalker is an intelligence gatherer operated by Fortra. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Macrobondbot
Macrobondbot implements custom web crawlers to fetch macroeconomic and financial data from 2,400+ official data sources for Macrobond's integrated research platform. Gath…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
magpie-crawler
magpie-crawler indexes web content and social media posts for Brandwatch's social media monitoring and consumer intelligence platform to analyze brand mentions.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
McontextualBot
McontextualBot is a web crawler operated by MContextual that collects content from websites for contextual advertising targeting and analysis. The company uses the crawle…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
MedialogiaBot
MedialogiaBot is a media monitoring crawler that collects content from online news sources and social media platforms to provide comprehensive media analytics and brand m…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
MediaMonitoringBot
MediaMonitoringBot crawls news and media publisher websites to index new content and match it against customer-provided keywords, delivering automated media monitoring up…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Mediapartners-Google
Mediapartners-Google crawls website content to analyze page context and keywords for Google AdSense ad targeting, determining appropriate advertisements to display based …
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Mediatoolkitbot
Mediatoolkitbot is Determ's media monitoring crawler that scans the open internet searching for brand mentions, keywords, and phrases that users track, helping marketers …
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Mediavine Medatada Parser
Mediavine Medatada Parser is an intelligence gatherer operated by Mediavine. If you think this is incorrect or can provide additional detail about its purpose, please let…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
MediavineMetadataParser
MediavineMetadataParser is Mediavine's content analysis tool for their Grow platform that enables publishers to add bookmarking, social sharing, and search functionality …
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
meta-externalads
meta-externalads is a web crawler operated by Meta that scans websites to gather information about content that may be shared or advertised on Facebook's platform. The bo…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
MgidBot
MgidBot is MGID's web crawler that analyzes website content to detect context categories and topics for targeted native advertising recommendations and content discovery.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Missinglettr Bot
Missinglettr Bot is an intelligence gatherer operated by Missinglettr. If you think this is incorrect or can provide additional detail about its purpose, please let us kn…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
MixrankBot
MixrankBot is a web crawler operated by MixRank that collects data about websites, companies, mobile apps, and technologies. The bot gathers information such as technolog…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
MuckRack
MuckRack is a bot operated by Muck Rack, a platform that connects journalists with public relations professionals. This bot likely crawls websites to gather information a…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
NanoInteractive
NanoInteractive is a web crawler operated by Nano Interactive, a digital advertising and targeting company. The bot likely crawls websites to gather intelligence for audi…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Netcraft
Netcraft is a web crawler that conducts comprehensive internet surveys, analyzing web server technologies and infrastructure across millions of websites to provide market…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
NetcraftSurveyAgent
NetcraftSurveyAgent is operated by Netcraft, a cybersecurity company specializing in threat intelligence and digital risk protection. The bot crawls websites to build thr…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
netEstate NE Crawler
netEstate NE Crawler systematically crawls websites to extract public contact information and business data for the netEstate business directory platform.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Neticle Crawler
Neticle Crawler is a web crawler operated by Neticle, a browser-based social and online media monitoring service. The bot collects web content to quantify online opinions…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
NetSeer crawler
NetSeer crawler is a web crawler operated by NetSeer that collects and analyzes web content for intelligence gathering purposes. This bot systematically visits websites t…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Netvibes
Netvibes is a web crawler operated by Netvibes, a dashboard and intelligence gathering service. The bot collects publicly available web content to aggregate and display i…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
NewsRoom.BI
NewsRoom.BI is a web crawler operated by Marfeel, a company that provides analytics and personalization solutions for publishers. This bot likely collects data to support…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
NostoCrawlerBot
NostoCrawlerBot is operated by Nosto, a company that provides ecommerce personalization solutions including product recommendations, search personalization, and merchandi…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
OAI-AdsBot
OAI-AdsBot is OpenAI's bot that validates the safety and policy compliance of web pages submitted as advertisements on ChatGPT.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
outboundbuddy-enrichment
outboundbuddy-enrichment is operated by Outbound Buddy, a B2B go-to-market growth agency that specializes in helping SaaS and agency teams connect with ecommerce brands. …
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
outbrain
outbrain is Outbrain's web crawler that analyzes content on publisher websites to understand context and topics for content recommendation and advertising purposes.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Owler
Owler is a business intelligence bot that gathers competitive intelligence and company information data. It crawls websites to collect publicly available information abou…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
page-preview-tool
page-preview-tool is SalesViewer's web crawler that visits websites to generate page previews and enrich company information for sales and marketing intelligence services…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Pandalytics
Pandalytics is a web crawler operated by Domainsbot, a company that provides domain-related data and business intelligence services to clients in the domain, hosting, and…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
panscient.com
panscient.com is an intelligence gatherer operated by Panscient. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
parse.ly scraper
parse.ly scraper is a web crawler operated by Parse.ly, a content analytics platform used by newsrooms and content marketers. The bot collects web content data to provide…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
PartnerOptimizer-bot
PartnerOptimizer-bot is a web crawler operated by PartnerOptimizer, a partner ecosystem intelligence platform that discovers, profiles, and analyzes B2B technology compan…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
productsup.io/crawler
productsup.io/crawler is a web crawler operated by Productsup, a product feed management platform that crawls websites to import product data for e-commerce and marketing…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
proximic
proximic is a contextual advertising crawler that analyzes website content to provide advanced contextual intelligence for programmatic advertising targeting and media op…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Quantcastbot
Quantcastbot is Quantcast's web crawler used for advertisement quality assurance and analyzing page content to build Interest-Based Audiences for targeted advertising and…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
QuuuBot
QuuuBot is operated by Quuu, a content curation and social media automation platform that uses machine learning to discover and schedule engaging content for brands to sh…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Qwarrybot
Qwarrybot is a web crawler operated by Qwarry, a French advertising technology company that provides contextual targeting and audience analysis services for programmatic …
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
RetroListeCOM
RetroListeCOM is a monitoring bot that regularly visits gaming websites, particularly Habbo Hotel retros, to collect and track real-time user count statistics for display…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
SalesViewerBot
SalesViewerBot is an intelligence gatherer operated by SalesViewer. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
scoop.it
scoop.it is an intelligence gatherer operated by Meltwater. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Scope3
The scope3 crawler indexes publicly available web content and paywalled media to assess content classification and brand safety.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
scraping@nytimes.com
NYTimes.com newsroom scraping bot collects publicly available, non-copyrighted data for journalistic projects including election result tracking, COVID-19 data aggregatio…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
SentiBot
SentiBot is a web crawler operated by SentiOne that indexes user-generated content for the SentiOne Listen platform. The bot analyzes over 300,000 domains daily from vari…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
SlickBot
SlickBot is Slickstream's web crawler that indexes customer websites to power engagement features like site search, content recommendations, and personalization for impro…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →