What is Superfeedr bot?

Superfeedr bot is a feed fetching crawler operated by Superfeedr, a real-time RSS and feed API service. The bot retrieves and parses feeds on behalf of subscribers, providing push notifications for new entries to help track updates across millions of websites in real-time. Agent Analytics can track when it visits your website.

Overview

Operated By Superfeedr
Source Official Website
Expected To Follow Robots.txt No
Insights Last Updated August 11, 2026

Do you operate this agent? Contact us to suggest an update.

Category

Fetcher
Retrieves web page metadata to power app features like link previews or feeds

Expected Behavior

Superfeedr bot usually makes a single request within seconds of a URL being shared, without crawling further. Traffic rises and falls with sharing activity, so a widely circulated link can produce a sharp burst of fetches.

Superfeedr bot's User Agent

User Agent Superfeedr bot/2.0 http://superfeedr.com - Make your feeds realtime: get in touch - feed-id:1378402890

How To Block Superfeedr bot With Robots.txt

Add this rule to your robots.txt file to request that Superfeedr bot not access your website, or use Automatic Robots.txt to request the same of all fetchers at once. You can customize which pages are blocked by swapping out / for a different path.

User-agent: Superfeedr bot # https://knownagents.com/agents/superfeedr-bot
Disallow: /

Global Statistics for Superfeedr bot

As of August 11, 2026, this data reflects agent visits measured across thousands of websites using Agent Analytics, combined with daily scans of the top 1000 websites and their robots.txt files.

Robots.txt Blocked Percentage

0%
0% of top websites are blocking Superfeedr bot
Learn How →

Country of Origin

United States
Superfeedr bot normally visits From the United States

Robots.txt Blocking Trend

0% of top websites block Superfeedr bot in their robots.txt files.

Overall Fetcher Traffic

2.6% of all web traffic came from fetchers.

Top Visited Website Categories

People and Society
News
Business and Industrial
Science
Arts and Entertainment

The types of websites most frequently visited by Superfeedr bot.

Frequently Asked Questions

Should I Block Superfeedr bot?

Usually not. Blocking Superfeedr bot may leave shared links without a title or image, making them less inviting to click. If it begins fetching at unexpected volume, try rate limiting before blocking it outright. Almost none of the top websites we track currently have robots.txt rules for Superfeedr bot.


Does Superfeedr bot Follow Robots.txt Rules?

No. Superfeedr bot is not expected to follow robots.txt directives, so a disallow rule only communicates your preference. Enforce the block with firewall or server rules, then use Agent Analytics to verify that its requests stop.


Does Superfeedr bot Access Private Content?

No. Superfeedr bot has no credentials and should access only the public URL and assets needed for a preview. It does not continue through the rest of your site.


Why Is Superfeedr bot Visiting My Website?

Someone shared a link to your page. Superfeedr bot fetched it to build a preview card, and each new share may trigger another request. A spike often means your content is circulating more widely.


How Can I Tell if Superfeedr bot Is Visiting My Website?

Agent Analytics tracks Superfeedr bot visits in real time alongside every other known AI agent, crawler, and scraper. You can also check your server logs for requests whose user-agent string contains "Superfeedr bot". Look for a page and its preview assets being requested without follow-up navigation. Because Superfeedr bot does not publish a verification method, any client can claim its identity and a log match is only a clue.