Agents
Intelligence Gatherers
Every known artificial agent (bot) on the internet. You can track their activity on your website with Agent Analytics, or control their behavior with Automatic Robots.txt.
Intelligence Gatherers
factset_spyderbot
factset_spyderbot is a web crawler operated by FactSet that gathers financial and business data from websites to support their comprehensive financial data platform and a…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
FDL Stats Bot
FDL Stats Bot crawls publicly available Rocket League player data from various platforms to generate analytical statistics for the Frontier Doubles League competition.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Fedicabot
Fedicabot is a web crawler operated by Fedica, a social media analytics and publishing platform. It likely visits websites to gather data related to social media content …
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google AdsBot
Google AdsBot is an intelligence gatherer operated by Google. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google AdSense
Google AdSense is an intelligence gatherer operated by Google. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google-Adwords-Instant
Google-Adwords-Instant is the web crawler bot connected to the Google Ads platform that visits advertiser landing pages to perform quality checks, verification, and compl…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google-Display-Ads-Bot
Google-Display-Ads-Bot is operated by Google and crawls websites to analyze their content for contextual ad targeting and placement in the Google Display Network. This bo…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
GrapeshotCrawler
GrapeshotCrawler analyzes web content for Oracle Advertising's contextual targeting system, classifying pages to ensure brand-safe ad placements.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
GroovinaAdsbot
GroovinaAdsbot is the web crawler used by Groovinads to gather data from e-commerce websites and digital advertising spaces to support their AI-powered display campaign o…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
HubSpot
HubSpot is an intelligence gatherer operated by HubSpot. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
IAS crawler
ias_crawler from Integral Ad Science performs digital ad verification, brand safety monitoring, and fraud detection across digital advertising channels to ensure quality …
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ias-ie
ias-ie is a web crawler operated by Integral Ad Science, a company that provides digital ad measurement and optimization services. The bot analyzes web page content to as…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ImagesiftBot
ImagesiftBot is an intelligence gatherer operated by Hive. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Innguma
Innguma is a web crawler that performs competitive intelligence and technology monitoring by automatically collecting and analyzing information from various sources to he…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
InteractiveAdvertisingBureau
InteractiveAdvertisingBureau crawler by OneTag verifies ads.txt files from publishers to confirm authorized reseller relationships and ad placement authentication for pro…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
IonCrawl
IonCrawl is a web crawler operated by IONOS, a web hosting and cloud services provider. The bot gathers intelligence by crawling websites to collect data for search funct…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Jugendschutzprogramm-Crawler
Jugendschutzprogramm-Crawler is a web crawler operated by JusProg, a German youth protection organization that develops filtering software to protect children from inappr…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
KargoBot
KargoBot is a web crawler operated by Kargo, an advertising technology company that provides ad solutions across mobile, CTV, social media, and e-commerce platforms. The …
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
KargoBot-Artemis-Mobile
KargoBot-Artemis-Mobile is a web crawler operated by Kargo, an advertising technology company that creates ad solutions for brands. This mobile bot collects web content i…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Klaviyo
Klaviyo is a web tracking script that collects visitor behavior data, product views, and site interactions to enable personalized email and SMS marketing campaigns throug…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
KStandBot
KStandBot is an intelligence gatherer operated by URL Classification. If you think this is incorrect or can provide additional detail about its purpose, please let us kno…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Leikibot
Leikibot is a web crawler operated by DoubleVerify that analyzes webpage content for digital advertising verification, brand safety, and ad fraud detection services.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
LightspeedSystemsCrawler
LightspeedSystemsCrawler is an intelligence gatherer operated by Lightspeed Systems. If you think this is incorrect or can provide additional detail about its purpose, pl…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
linkfluence
linkfluence is an intelligence gatherer operated by Meltwater. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
LinkWalker
LinkWalker is an intelligence gatherer operated by Fortra. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Macrobondbot
Macrobondbot implements custom web crawlers to fetch macroeconomic and financial data from 2,400+ official data sources for Macrobond's integrated research platform. Gath…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
magpie-crawler
magpie-crawler indexes web content and social media posts for Brandwatch's social media monitoring and consumer intelligence platform to analyze brand mentions.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
McontextualBot
McontextualBot is a web crawler operated by MContextual that collects content from websites for contextual advertising targeting and analysis. The company uses the crawle…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
MedialogiaBot
MedialogiaBot is a media monitoring crawler that collects content from online news sources and social media platforms to provide comprehensive media analytics and brand m…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
MediaMonitoringBot
MediaMonitoringBot crawls news and media publisher websites to index new content and match it against customer-provided keywords, delivering automated media monitoring up…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Mediapartners-Google
Mediapartners-Google crawls website content to analyze page context and keywords for Google AdSense ad targeting, determining appropriate advertisements to display based …
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Mediatoolkitbot
Mediatoolkitbot is Determ's media monitoring crawler that scans the open internet searching for brand mentions, keywords, and phrases that users track, helping marketers …
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Mediavine Medatada Parser
Mediavine Medatada Parser is an intelligence gatherer operated by Mediavine. If you think this is incorrect or can provide additional detail about its purpose, please let…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
MediavineMetadataParser
MediavineMetadataParser is Mediavine's content analysis tool for their Grow platform that enables publishers to add bookmarking, social sharing, and search functionality …
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
meta-externalads
meta-externalads is a web crawler operated by Meta that scans websites to gather information about content that may be shared or advertised on Facebook's platform. The bo…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
MgidBot
MgidBot is MGID's web crawler that analyzes website content to detect context categories and topics for targeted native advertising recommendations and content discovery.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Missinglettr Bot
Missinglettr Bot is an intelligence gatherer operated by Missinglettr. If you think this is incorrect or can provide additional detail about its purpose, please let us kn…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
MixrankBot
MixrankBot is a web crawler operated by MixRank that collects data about websites, companies, mobile apps, and technologies. The bot gathers information such as technolog…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
MuckRack
MuckRack is a bot operated by Muck Rack, a platform that connects journalists with public relations professionals. This bot likely crawls websites to gather information a…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
NanoInteractive
NanoInteractive is a web crawler operated by Nano Interactive, a digital advertising and targeting company. The bot likely crawls websites to gather intelligence for audi…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Netcraft
Netcraft is a web crawler that conducts comprehensive internet surveys, analyzing web server technologies and infrastructure across millions of websites to provide market…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
NetcraftSurveyAgent
NetcraftSurveyAgent is operated by Netcraft, a cybersecurity company specializing in threat intelligence and digital risk protection. The bot crawls websites to build thr…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
netEstate NE Crawler
netEstate NE Crawler systematically crawls websites to extract public contact information and business data for the netEstate business directory platform.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Neticle Crawler
Neticle Crawler is a web crawler operated by Neticle, a browser-based social and online media monitoring service. The bot collects web content to quantify online opinions…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
NetSeer crawler
NetSeer crawler is a web crawler operated by NetSeer that collects and analyzes web content for intelligence gathering purposes. This bot systematically visits websites t…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Netvibes
Netvibes is a web crawler operated by Netvibes, a dashboard and intelligence gathering service. The bot collects publicly available web content to aggregate and display i…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
NewsRoom.BI
NewsRoom.BI is a web crawler operated by Marfeel, a company that provides analytics and personalization solutions for publishers. This bot likely collects data to support…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
NostoCrawlerBot
NostoCrawlerBot is operated by Nosto, a company that provides ecommerce personalization solutions including product recommendations, search personalization, and merchandi…
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
OAI-AdsBot
OAI-AdsBot is OpenAI's bot that validates the safety and policy compliance of web pages submitted as advertisements on ChatGPT.
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
outboundbuddy-enrichment
outboundbuddy-enrichment is operated by Outbound Buddy, a B2B go-to-market growth agency that specializes in helping SaaS and agency teams connect with ecommerce brands. …
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →