Agent Directory
The definitive guide to every known AI agent, crawler, scraper, and other bot on the internet, updated daily.
Fetchers
Podimo
Podimo is a podcast and audiobook streaming platform bot that fetches content from websites, likely to discover, index, or aggregate podcast episodes and audio content fo…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
PressEngine Bot
PressEngine Bot is a fetcher operated by PressEngine.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
PressEngineBot
PressEngineBot is an automated verification crawler that confirms video game press coverage URLs exist and are viewable when submitted by journalists who receive review k…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Protopage
Protopage is an RSS reader and web portal service that crawls and indexes RSS news feeds from various sources to create personalized dashboard start pages and aggregated …
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
qcbot
qcbot is a web crawler used by QUIC.cloud to fetch data from websites for various online services including image optimization, CSS optimization, and other website perfor…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Quora-Bot
Quora-Bot is a web crawler operated by Quora, a question-and-answer platform where users can ask questions and get answers from the community. This bot fetches web conten…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
rakutenusabot-image
rakutenusabot-image is a specialized web crawler used by Rakuten to crawl and fetch product images from merchant websites. This enables Rakuten to display cashback deals …
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Readwise
Readwise is a bot that fetches content from web pages to sync highlights and annotations from articles, ebooks, and other reading materials into users' Readwise accounts.…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Readybot.io
Readybot.io is a Discord bot that fetches and monitors RSS feeds, YouTube channels, Reddit posts, Twitch streams, and social media content from platforms like Twitter and…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
redditbot
redditbot is a web crawler operated by Reddit, a social news aggregation and discussion platform. This bot fetches web content to create thumbnails and rich previews when…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Reelevant
Reelevant is a web crawler that fetches product images at runtime to dynamically update content inside email campaigns for personalized marketing experiences.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
reward-gateway
reward-gateway is a web crawler operated by Reward Gateway, an employee experience platform company. The bot likely fetches content related to employee benefits, workplac…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
RSS API
RSS API is a fetcher operated by Tibush.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
RSS.Social
RSS.Social is a fetcher bot that retrieves RSS feeds, likely as part of a service that automates social media posting or manages RSS content distribution.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
rss2tg bot
rss2tg bot is an automated service that monitors RSS feeds and sends content updates to Telegram channels or users, enabling real-time notifications for feed content.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
RSSAPI
RSSAPI is a service that periodically monitors RSS, ATOM, and JSON feeds for customers, parsing and normalizing content, then delivering updates via webhooks in near real…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
RSSExtractor
RSSExtractor is a web fetcher that retrieves and extracts RSS feeds from websites.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
scoopit-crawler
scoopit-crawler is a web crawler operated by Scoop.it, a content curation platform that helps users discover, curate, and share content on various topics. The bot fetches…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
scour.ing
scour.ing is Scour's AI-powered web crawler that fetches content from RSS feeds and websites to create personalized content recommendations based on user interests.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
ScourRSSBot
ScourRSSBot is a fetcher bot operated by Scour that retrieves RSS feed content from websites. The bot is likely used to collect and aggregate syndicated content for the S…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
serendeputybot
serendeputybot is a fetcher operated by Serendeputy.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
SFDC-Callout
SFDC-Callout is the user agent used by Salesforce when making HTTP callouts and API requests from Apex code, workflow rules, and other Salesforce automated processes to e…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
ShortPixel
ShortPixel is a bot from an image optimization service that compresses and converts images to formats like WebP and AVIF. It visits websites to fetch and optimize images …
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Shortwave Image Fetcher
Shortwave Image Fetcher is a privacy-focused service that proxies images from HTML emails through Shortwave's servers to protect users' IP addresses and maintain email pr…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
SimplePie
SimplePie is a fetcher operated by SimplePie.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Skroutz ImageBot
Skroutz ImageBot crawls and fetches product images from e-commerce websites to display in Skroutz's price comparison platform, enabling visual product browsing and compar…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
SkroutzBot
SkroutzBot is a specialized web crawler used by Skroutz to download XML data feeds, product images, and sample product pages from merchant websites for quality control an…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Skype
Skype is a fetcher operated by Skype.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
SkypeUriPreview
SkypeUriPreview is Skype's link preview bot that fetches page content when users share URLs in Skype messages, extracting metadata to display rich previews with titles, d…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Slack Image Proxy
Slack Image Proxy is a fetcher operated by Slack.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Slack-ImgProxy
Slack-ImgProxy is a web crawler used by Slack to fetch, process, and cache images that are shared in Slack channels, ensuring they can be displayed properly within the me…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Slackbot
Slackbot is operated by Slack and is used to fetch link previews and unfurl content from websites when users share URLs in Slack conversations. When a link is posted, thi…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Slackbot-LinkExpanding
Slackbot-LinkExpanding is Slack's link unfurling bot that fetches web page content when users post links in channels, extracting meta tags like oEmbed, Twitter Cards, and…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
SlackbotLinkExpanding
SlackbotLinkExpanding is a fetcher operated by Slack.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Snap URL Preview Service
Snap URL Preview Service is a bot operated by Snap that fetches web page content to generate URL previews and rich link cards for links shared in Snapchat conversations. …
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Snapchat
Snapchat is a fetcher operated by Snapchat.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Sottopop-user-rss
Sottopop-user-rss is a feed fetcher operated by UpContent that retrieves RSS content to support UpContent content discovery and curation features.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
SottopopNone
SottopopNone is a web crawler operated by UpContent, a content curation and discovery platform that helps users find and share relevant content for their marketing and so…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
StartmeBot
StartmeBot is a fetcher bot operated by Start.me, a personalized startpage and bookmarking service. The bot fetches content from websites to generate previews, thumbnails…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Statabot
Statabot is StataCorp's web crawler that searches for and indexes Stata statistical software table of contents files (stata.toc) for software package management.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
SteamChat
SteamChat is Valve's web crawler that fetches URL previews and metadata for links shared within Steam's chat functionality, enabling rich link previews in conversations b…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
SubstackContentFetch
SubstackContentFetch is a bot operated by Substack, a newsletter and subscription publishing platform. This bot fetches content from external websites to generate link pr…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Superfeedr
Superfeedr is a fetcher operated by Superfeedr.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Superfeedr bot
Superfeedr bot is a feed fetching crawler operated by Superfeedr, a real-time RSS and feed API service. The bot retrieves and parses feeds on behalf of subscribers, provi…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
SurdotlyBot
SurdotlyBot is the web crawler for Sur.ly, a content preview and link shortening service. This bot fetches content to generate previews and thumbnails for links shared th…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Synapse
Synapse is a fetcher operated by Matrix.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Telegram Bot
Telegram Bot is a fetcher operated by Telegram.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
TelegramBot
TelegramBot is Telegram's web crawler that fetches webpage content to generate Instant View pages and link previews for users, enabling rich content display directly with…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
TextRazor Downloader
TextRazor Downloader is a web fetcher operated by TextRazor that retrieves URLs submitted to its natural-language-processing API for analysis.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
TikTokSpider
TikTokSpider is a web crawler operated by TikTok that fetches content from websites when users share external URLs on the platform. The bot collects information for link …
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →