What is redditbot?

redditbot is a web crawler operated by Reddit, a social news aggregation and discussion platform. This bot fetches web content to create thumbnails and rich previews when users submit links or share external content on Reddit. Agent Analytics can track when it visits your website.

Overview

Operated By Reddit
Source Official Website
Expected To Follow Robots.txt No
Insights Last Updated August 11, 2026

Do you operate this agent? Contact us to suggest an update.

Category

Fetcher
Retrieves web page metadata to power app features like link previews or feeds

Expected Behavior

redditbot usually makes a single request within seconds of a URL being shared, without crawling further. Traffic rises and falls with sharing activity, so a widely circulated link can produce a sharp burst of fetches.

redditbot's User Agent

User Agent Mozilla/5.0 (compatible; redditbot/1.0; +http://www.reddit.com/feedback)

How To Block redditbot With Robots.txt

Add this rule to your robots.txt file to request that redditbot not access your website, or use Automatic Robots.txt to request the same of all fetchers at once. You can customize which pages are blocked by swapping out / for a different path.

User-agent: redditbot # https://knownagents.com/agents/redditbot
Disallow: /

Global Statistics for redditbot

As of August 11, 2026, this data reflects agent visits measured across thousands of websites using Agent Analytics, combined with daily scans of the top 1000 websites and their robots.txt files.

Robots.txt Blocked Percentage

1%
1% of top websites are blocking redditbot
Learn How →

Country of Origin

United States
redditbot normally visits From the United States

Robots.txt Blocking Trend

1% of top websites block redditbot in their robots.txt files.

Overall Fetcher Traffic

2.6% of all web traffic came from fetchers.

Top Visited Website Categories

News
Sports
Business and Industrial
Computers and Electronics
Science

The types of websites most frequently visited by redditbot.

Frequently Asked Questions

Should I Block redditbot?

Usually not. Blocking redditbot may leave shared links without a title or image, making them less inviting to click. If it begins fetching at unexpected volume, try rate limiting before blocking it outright. For context, 1% of the top websites we track currently have robots.txt rules for redditbot.


Does redditbot Follow Robots.txt Rules?

No. redditbot is not expected to follow robots.txt directives, so a disallow rule only communicates your preference. Enforce the block with firewall or server rules, then use Agent Analytics to verify that its requests stop.


Does redditbot Access Private Content?

No. redditbot has no credentials and should access only the public URL and assets needed for a preview. It does not continue through the rest of your site.


Why Is redditbot Visiting My Website?

Someone shared a link to your page. redditbot fetched it to build a preview card, and each new share may trigger another request. A spike often means your content is circulating more widely.


How Can I Tell if redditbot Is Visiting My Website?

Agent Analytics tracks redditbot visits in real time alongside every other known AI agent, crawler, and scraper. You can also check your server logs for requests whose user-agent string contains "redditbot". Look for a page and its preview assets being requested without follow-up navigation. Because redditbot does not publish a verification method, any client can claim its identity and a log match is only a clue.