Agents
All Agent Types
Every known artificial agent (bot) on the internet. You can track their activity on your website with Agent Analytics, or control their behavior with Automatic Robots.txt.
Intelligence Gatherers
AudigentAdBot
AudigentAdBot is a web crawler operated by Audigent that collects metadata from HTML page headers to support targeted advertising solutions. The bot gathers information f…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Automattic Analytics Crawler
Automattic Analytics Crawler is a web crawler operated by WordPress (Automattic) that gathers analytics and intelligence data from websites. This bot collects information…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Awario
Awario is a social media monitoring bot that crawls over 13 billion web pages daily to track brand mentions, conversations, and social media content across platforms for …
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
AwarioBot
AwarioBot is the web crawler for Awario, a brand monitoring and social listening service. This bot crawls over 13 billion web pages daily to gather brand mentions and dis…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
AwarioSmartBot
AwarioSmartBot is a web crawler operated by Awario that collects publicly available web data to help Internet marketers monitor and discover brand mentions online. The bo…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
BigUpDataBot
BigUpDataBot automates the pipeline of active product deals for advertisement purposes, systematically collecting product pricing and promotional data to support data-dri…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Bing Ads
Bing Ads is an intelligence gatherer operated by Microsoft. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
BitSightBot
BitSightBot is an intelligence gatherer operated by Bitsight. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Blackboard
Blackboard is an intelligence gatherer operated by Anthology. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
BomboraBot
BomboraBot is a web crawler operated by Bombora, a B2B data intelligence company that specializes in intent data and audience solutions. The bot collects behavioral data …
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
BrandVerity
BrandVerity is an intelligence gathering bot that monitors online advertising and affiliate marketing activities to detect unauthorized trademark use and policy violation…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
BrightEdge Bot
BrightEdge Bot is an intelligence gatherer operated by BrightEdge. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Buck
Buck is a web crawler operated by Hypefactors, a unified PR software platform that provides media monitoring and analytics services. The bot collects media coverage data …
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
channable
channable bot automates multichannel e-commerce marketing by crawling product data from webshops to optimize feeds, listings, and advertising campaigns across 3000+ platf…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
CheckMarkNetwork
CheckMarkNetwork is a web crawler operated by CheckMark Network, a brand protection and trademark monitoring company. The bot crawls websites to help clients track their …
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Cincraw
Cincraw is an intelligence gatherer operated by CINC. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Clickagy Intelligence Bot
Clickagy Intelligence Bot is a web crawler operated by Clickagy, a company that gathers intelligence and data from websites. This bot is classified as an Intelligence Gat…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Clickagy Intelligence Bot v2
Clickagy Intelligence Bot v2 performs advanced ad verification, privacy compliance tracking, and digital advertising intelligence gathering across websites for market ana…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ContextualBot
ContextualBot is a web crawler operated by Mobian that gathers intelligence and contextual information from websites. This bot is categorized as an intelligence gatherer,…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
contxbot
contxbot is Amazon's web crawler that processes and indexes webpage content to understand website topics and context for delivering relevant advertisements through Amazon…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
CriteoBot
CriteoBot is Criteo's web crawler that visits and analyzes web pages to understand content and user behavior patterns for serving personalized advertising campaigns.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
cXensebot
cXensebot is Cxense's web crawler that performs content indexing and behavioral data collection to power Piano's customer data platform, enabling real-time analytics and …
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ds9
ds9 is operated by Copyright Clearance Center and crawls websites to gather information about published content for copyright licensing and rights management purposes. Th…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
DVbot
DVbot is operated by DoubleVerify, a digital advertising verification company that monitors and measures media transactions across websites to ensure ad quality, detect f…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Echobot Bot
Echobot Bot is an intelligence gatherer operated by Echobox. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
EcoVadisSustainabilityBot
EcoVadisSustainabilityBot is a web crawler operated by EcoVadis, a company that provides sustainability ratings and intelligence for businesses and their supply chains. T…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
EpivozCrawler
EpivozCrawler is Techmeme's web crawler that systematically crawls news articles and blog posts to gather information for Techmeme's technology news aggregation service.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ev-crawler
ev-crawler is an intelligence gatherer operated by Headline. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
EzLynx
EzLynx is a web crawler operated by Ezoic, a platform that provides website optimization and ad testing services. This bot gathers intelligence from websites to help anal…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
EzoicBot
EzoicBot is a crawler operated by Ezoic, a data-driven ad monetization platform that provides advertising optimization services to website publishers. This bot performs i…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
EzoicBot-Nicheiq
EzoicBot-Nicheiq is a web crawler operated by Ezoic, a platform that provides ad optimization and site testing services for publishers. This bot gathers intelligence abou…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
factset_spyderbot
factset_spyderbot is a web crawler operated by FactSet that gathers financial and business data from websites to support their comprehensive financial data platform and a…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
FDL Stats Bot
FDL Stats Bot crawls publicly available Rocket League player data from various platforms to generate analytical statistics for the Frontier Doubles League competition.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Fedicabot
Fedicabot is a web crawler operated by Fedica, a social media analytics and publishing platform. It likely visits websites to gather data related to social media content …
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google AdsBot
Google AdsBot is an intelligence gatherer operated by Google. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google AdSense
Google AdSense is an intelligence gatherer operated by Google. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google-Adwords-Instant
Google-Adwords-Instant is the web crawler bot connected to the Google Ads platform that visits advertiser landing pages to perform quality checks, verification, and compl…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google-Display-Ads-Bot
Google-Display-Ads-Bot is operated by Google and crawls websites to analyze their content for contextual ad targeting and placement in the Google Display Network. This bo…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
GrapeshotCrawler
GrapeshotCrawler analyzes web content for Oracle Advertising's contextual targeting system, classifying pages to ensure brand-safe ad placements.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
GroovinaAdsbot
GroovinaAdsbot is the web crawler used by Groovinads to gather data from e-commerce websites and digital advertising spaces to support their AI-powered display campaign o…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
HubSpot
HubSpot is an intelligence gatherer operated by HubSpot. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
IAS crawler
ias_crawler from Integral Ad Science performs digital ad verification, brand safety monitoring, and fraud detection across digital advertising channels to ensure quality …
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ias-ie
ias-ie is a web crawler operated by Integral Ad Science, a company that provides digital ad measurement and optimization services. The bot analyzes web page content to as…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ImagesiftBot
ImagesiftBot is an intelligence gatherer operated by Hive. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Innguma
Innguma is a web crawler that performs competitive intelligence and technology monitoring by automatically collecting and analyzing information from various sources to he…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
InteractiveAdvertisingBureau
InteractiveAdvertisingBureau crawler by OneTag verifies ads.txt files from publishers to confirm authorized reseller relationships and ad placement authentication for pro…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
IonCrawl
IonCrawl is a web crawler operated by IONOS, a web hosting and cloud services provider. The bot gathers intelligence by crawling websites to collect data for search funct…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Jugendschutzprogramm-Crawler
Jugendschutzprogramm-Crawler is a web crawler operated by JusProg, a German youth protection organization that develops filtering software to protect children from inappr…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
KargoBot
KargoBot is a web crawler operated by Kargo, an advertising technology company that provides ad solutions across mobile, CTV, social media, and e-commerce platforms. The …
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
KargoBot-Artemis-Mobile
KargoBot-Artemis-Mobile is a web crawler operated by Kargo, an advertising technology company that creates ad solutions for brands. This mobile bot collects web content i…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →