Agents
Submit an Agent
All Agent Types
A directory of every known AI agent, crawler, scraper, and other bot on the internet.
Intelligence Gatherers
EpivozCrawler
EpivozCrawler is Techmeme's web crawler that systematically crawls news articles and blog posts to gather information for Techmeme's technology news aggregation service.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ev-crawler
ev-crawler is an intelligence gatherer operated by Headline. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
EzLynx
EzLynx is a web crawler operated by Ezoic, a platform that provides website optimization and ad testing services. This bot gathers intelligence from websites to help anal…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
EzoicBot
EzoicBot is a crawler operated by Ezoic, a data-driven ad monetization platform that provides advertising optimization services to website publishers. This bot performs i…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
EzoicBot-Nicheiq
EzoicBot-Nicheiq is a web crawler operated by Ezoic, a platform that provides ad optimization and site testing services for publishers. This bot gathers intelligence abou…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
factset_spyderbot
factset_spyderbot is a web crawler operated by FactSet that gathers financial and business data from websites to support their comprehensive financial data platform and a…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
FDL Stats Bot
FDL Stats Bot crawls publicly available Rocket League player data from various platforms to generate analytical statistics for the Frontier Doubles League competition.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Fedicabot
Fedicabot is a web crawler operated by Fedica, a social media analytics and publishing platform. It likely visits websites to gather data related to social media content …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google AdsBot
Google AdsBot is an intelligence gatherer operated by Google. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google AdSense
Google AdSense is an intelligence gatherer operated by Google. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google-adstxt
Google-adstxt is an intelligence gatherer operated by Google. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google-Adwords-Instant
Google-Adwords-Instant is the web crawler bot connected to the Google Ads platform that visits advertiser landing pages to perform quality checks, verification, and compl…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google-Display-Ads-Bot
Google-Display-Ads-Bot is operated by Google and crawls websites to analyze their content for contextual ad targeting and placement in the Google Display Network. This bo…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
GrapeshotCrawler
GrapeshotCrawler analyzes web content for Oracle Advertising's contextual targeting system, classifying pages to ensure brand-safe ad placements.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
GroovinaAdsbot
GroovinaAdsbot is the web crawler used by Groovinads to gather data from e-commerce websites and digital advertising spaces to support their AI-powered display campaign o…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
HubSpot
HubSpot is an intelligence gatherer operated by HubSpot. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
IAS crawler
ias_crawler from Integral Ad Science performs digital ad verification, brand safety monitoring, and fraud detection across digital advertising channels to ensure quality …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ias-ie
ias-ie is a web crawler operated by Integral Ad Science, a company that provides digital ad measurement and optimization services. The bot analyzes web page content to as…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
IDG/IT
IDG/IT is a web scraper operated by SpazioDati, an Italian company specializing in business intelligence and data services. This bot collects publicly available web data …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ImagesiftBot
ImagesiftBot is an intelligence gatherer operated by Hive. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Innguma
Innguma is a web crawler that performs competitive intelligence and technology monitoring by automatically collecting and analyzing information from various sources to he…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
InteractiveAdvertisingBureau
InteractiveAdvertisingBureau crawler by OneTag verifies ads.txt files from publishers to confirm authorized reseller relationships and ad placement authentication for pro…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
IonCrawl
IonCrawl is a web crawler operated by IONOS, a web hosting and cloud services provider. The bot gathers intelligence by crawling websites to collect data for search funct…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Jugendschutzprogramm-Crawler
Jugendschutzprogramm-Crawler is a web crawler operated by JusProg, a German youth protection organization that develops filtering software to protect children from inappr…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
KargoBot
KargoBot is a web crawler operated by Kargo, an advertising technology company that provides ad solutions across mobile, CTV, social media, and e-commerce platforms. The …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
KargoBot-Artemis-Mobile
KargoBot-Artemis-Mobile is a web crawler operated by Kargo, an advertising technology company that creates ad solutions for brands. This mobile bot collects web content i…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Klaviyo
Klaviyo is a web tracking script that collects visitor behavior data, product views, and site interactions to enable personalized email and SMS marketing campaigns throug…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
KStandBot
KStandBot is an intelligence gatherer operated by URL Classification. If you think this is incorrect or can provide additional detail about its purpose, please let us kno…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Leikibot
Leikibot is a web crawler operated by DoubleVerify that analyzes webpage content for digital advertising verification, brand safety, and ad fraud detection services.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
LightspeedSystemsCrawler
LightspeedSystemsCrawler is an intelligence gatherer operated by Lightspeed Systems. If you think this is incorrect or can provide additional detail about its purpose, pl…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
linkfluence
linkfluence is an intelligence gatherer operated by Meltwater. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
LinkWalker
LinkWalker is an intelligence gatherer operated by Fortra. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Macrobondbot
Macrobondbot implements custom web crawlers to fetch macroeconomic and financial data from 2,400+ official data sources for Macrobond's integrated research platform. Gath…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
magpie-crawler
magpie-crawler indexes web content and social media posts for Brandwatch's social media monitoring and consumer intelligence platform to analyze brand mentions.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Mantisbot
Mantisbot is operated by Mantis. It's used to crawl web pages for contextual advertising and brand safety signals.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
McontextualBot
McontextualBot is a web crawler operated by MContextual that collects content from websites for contextual advertising targeting and analysis. The company uses the crawle…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
mediaboardbot
mediaboardbot is a web crawler operated by Mediaboard, a PR and media intelligence platform. It monitors online media sources for brand mentions, news coverage, and senti…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
MedialogiaBot
MedialogiaBot is a media monitoring crawler that collects content from online news sources and social media platforms to provide comprehensive media analytics and brand m…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
MediaMonitoringBot
MediaMonitoringBot crawls news and media publisher websites to index new content and match it against customer-provided keywords, delivering automated media monitoring up…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Mediapartners-Google
Mediapartners-Google crawls website content to analyze page context and keywords for Google AdSense ad targeting, determining appropriate advertisements to display based …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Mediatoolkitbot
Mediatoolkitbot is Determ's media monitoring crawler that scans the open internet searching for brand mentions, keywords, and phrases that users track, helping marketers …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Mediavine Medatada Parser
Mediavine Medatada Parser is an intelligence gatherer operated by Mediavine. If you think this is incorrect or can provide additional detail about its purpose, please let…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
MediavineMetadataParser
MediavineMetadataParser is Mediavine's content analysis tool for their Grow platform that enables publishers to add bookmarking, social sharing, and search functionality …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
meta-externalads
meta-externalads is a web crawler operated by Meta that scans websites to gather information about content that may be shared or advertised on Facebook's platform. The bo…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
MgidBot
MgidBot is MGID's web crawler that analyzes website content to detect context categories and topics for targeted native advertising recommendations and content discovery.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Missinglettr Bot
Missinglettr Bot is an intelligence gatherer operated by Missinglettr. If you think this is incorrect or can provide additional detail about its purpose, please let us kn…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
MixrankBot
MixrankBot is a web crawler operated by MixRank that collects data about websites, companies, mobile apps, and technologies. The bot gathers information such as technolog…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
MuckRack
MuckRack is a bot operated by Muck Rack, a platform that connects journalists with public relations professionals. This bot likely crawls websites to gather information a…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
NanoInteractive
NanoInteractive is a web crawler operated by Nano Interactive, a digital advertising and targeting company. The bot likely crawls websites to gather intelligence for audi…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Netcraft
Netcraft is a web crawler that conducts comprehensive internet surveys, analyzing web server technologies and infrastructure across millions of websites to provide market…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →