Agent Directory

The definitive guide to every known AI agent, crawler, scraper, and other bot on the internet, updated daily.

Submit an Agent →
Intelligence Gatherers
All Categories
AI Agents AI Assistants AI Coding Agents AI Data Providers AI Data Scrapers AI Search Crawlers Archivers Automated Agents Developer Helpers Fetchers Intelligence Gatherers Scrapers Search Engine Crawlers Security Scanners SEO Crawlers Uncategorized Agents Undocumented AI Agents

Intelligence Gatherers

Dataprovider
Dataprovider is a web crawler that indexes over 700 million domains to create a structured database of website information, technologies, and business insights for data i…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Dataprovider.com
Dataprovider.com is an intelligence gatherer operated by Dataprovider.com.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
DomainDrift
DomainDrift continuously monitors a large catalog of domains for changes to nameservers, mail servers, TLS certificates, hosting providers, and other infrastructure. It p…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Dragonfly
Dragonfly is a web crawler operated by Publisher Discovery that gathers intelligence about publishers and websites. It is used to discover and collect information about o…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ds9
ds9 is operated by Copyright Clearance Center and crawls websites to gather information about published content for copyright licensing and rights management purposes. Th…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
DVbot
DVbot is operated by DoubleVerify, a digital advertising verification company that monitors and measures media transactions across websites to ensure ad quality, detect f…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
dwelltime-bot
dwelltime-bot is a web crawler operated by Dwell that collects public content for personalized daily recommendations.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Echobot Bot
Echobot Bot is an intelligence gatherer operated by Echobox.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
EcoVadisSustainabilityBot
EcoVadisSustainabilityBot is a web crawler operated by EcoVadis, a company that provides sustainability ratings and intelligence for businesses and their supply chains. T…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
EpivozCrawler
EpivozCrawler is Techmeme's web crawler that systematically crawls news articles and blog posts to gather information for Techmeme's technology news aggregation service.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ev-crawler
ev-crawler is an intelligence gatherer operated by Headline.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
EzLynx
EzLynx is a web crawler operated by Ezoic, a platform that provides website optimization and ad testing services. This bot gathers intelligence from websites to help anal…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
EzoicBot
EzoicBot is a crawler operated by Ezoic, a data-driven ad monetization platform that provides advertising optimization services to website publishers. This bot performs i…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
EzoicBot-Nicheiq
EzoicBot-Nicheiq is a web crawler operated by Ezoic, a platform that provides ad optimization and site testing services for publishers. This bot gathers intelligence abou…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
factset_spyderbot
factset_spyderbot is a web crawler operated by FactSet that gathers financial and business data from websites to support their comprehensive financial data platform and a…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
FDL Stats Bot
FDL Stats Bot crawls publicly available Rocket League player data from various platforms to generate analytical statistics for the Frontier Doubles League competition.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Fedicabot
Fedicabot is a web crawler operated by Fedica, a social media analytics and publishing platform. It likely visits websites to gather data related to social media content …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
FirmCredBot
FirmCredBot collects public company information for Firm Cred's directory of B2B service providers. The platform combines website research with verified client reviews an…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
FlowIQLabsBot
FlowIQLabsBot is an internet-measurement crawler operated by FlowIQ Labs that records protocol, banner, handshake, TLS certificate, and geolocation data from public servi…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ForestEngine
ForestEngine scans publicly accessible internet services and records TLS certificates, response headers, service banners, and web homepages. The data powers Forest's sear…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
getdomaindata
getdomaindata requests public website homepages and detects technologies such as hosting providers, ecommerce platforms, content management systems, JavaScript frameworks…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
GlobRadarBot
GlobRadarBot is a web crawler operated by GlobRadar that collects public company and contact information for its Portuguese business database.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
GnowitNewsbot
GnowitNewsbot collects news, government, regulatory, and industry content for Gnowit's media and policy monitoring platform.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google AdsBot
Google AdsBot is an intelligence gatherer operated by Google.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google AdSense
Google AdSense is an intelligence gatherer operated by Google.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google-adstxt
Google-adstxt is an intelligence gatherer operated by Google.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google-Adwords-Instant
Google-Adwords-Instant is the web crawler bot connected to the Google Ads platform that visits advertiser landing pages to perform quality checks, verification, and compl…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Google-Display-Ads-Bot
Google-Display-Ads-Bot is operated by Google and crawls websites to analyze their content for contextual ad targeting and placement in the Google Display Network. This bo…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
GovAPIEnricher
GovAPIEnricher is a web crawler operated by Mega Impacts that collects public government API information for data enrichment.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
GrapeshotCrawler
GrapeshotCrawler analyzes web content for Oracle Advertising's contextual targeting system, classifying pages to ensure brand-safe ad placements.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
GroovinaAdsbot
GroovinaAdsbot is the web crawler used by Groovinads to gather data from e-commerce websites and digital advertising spaces to support their AI-powered display campaign o…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
GrowthXBot
GrowthXBot retrieves public website content for GrowthX's organic-growth platform. GrowthX analyzes the content for search optimization, answer-engine visibility, and con…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
HubSpot
HubSpot is an intelligence gatherer operated by HubSpot.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
IAS crawler
ias_crawler from Integral Ad Science performs digital ad verification, brand safety monitoring, and fraud detection across digital advertising channels to ensure quality …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ias-ie
ias-ie is a web crawler operated by Integral Ad Science, a company that provides digital ad measurement and optimization services. The bot analyzes web page content to as…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
IDG/IT
IDG/IT is a web scraper operated by SpazioDati, an Italian company specializing in business intelligence and data services. This bot collects publicly available web data …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ImagesiftBot
ImagesiftBot is an intelligence gatherer operated by Hive.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
IncumbINTBot
IncumbINTBot is a web crawler operated by Reticle that collects public information about U.S. federal contracting and grants for IncumbINT.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Innguma
Innguma is a web crawler that performs competitive intelligence and technology monitoring by automatically collecting and analyzing information from various sources to he…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
IntentBeamBot
IntentBeamBot collects public business contact details and leadership information for IntentBeam.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
InteractiveAdvertisingBureau
InteractiveAdvertisingBureau crawler by OneTag verifies ads.txt files from publishers to confirm authorized reseller relationships and ad placement authentication for pro…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
InterviewOS
InterviewOS is a web crawler operated by Subspace that monitors company career sites and records job openings, closures, and posting duration.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
IonCrawl
IonCrawl is a web crawler operated by IONOS, a web hosting and cloud services provider. The bot gathers intelligence by crawling websites to collect data for search funct…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Jugendschutzprogramm-Crawler
Jugendschutzprogramm-Crawler is a web crawler operated by JusProg, a German youth protection organization that develops filtering software to protect children from inappr…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
KargoBot
KargoBot is a web crawler operated by Kargo, an advertising technology company that provides ad solutions across mobile, CTV, social media, and e-commerce platforms. The …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
KargoBot-Artemis-Mobile
KargoBot-Artemis-Mobile is a web crawler operated by Kargo, an advertising technology company that creates ad solutions for brands. This mobile bot collects web content i…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
KimeBot
KimeBot is a web crawler operated by KIME that collects public web content to monitor brand visibility across AI search systems.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Klaviyo
Klaviyo is a web tracking script that collects visitor behavior data, product views, and site interactions to enable personalized email and SMS marketing campaigns throug…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Konturbot
Konturbot is a web crawler operated by Kontur that collects public business information for its company-data and business-intelligence services.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
KStandBot
KStandBot is an intelligence gatherer operated by URL Classification.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
← Previous Page 2 of 5 Next →