What is UpContent?
UpContent is a web crawler that finds relevant public articles for people to review, curate, and share with their audiences, helping publishers reach engaged human readers. You can set up Agent Analytics to see when UpContent visits your website.
Category
| Example User Agent | Mozilla/5.0 (compatible; UpContent/1.0; +https://platform.upcontent.com/bot) |
| Operated By | UpContent |
| Source | Official Website |
| Identity |
Verified
Verified Identification
Requests claiming to be this agent can be authenticated using its published verification method. |
| Triggered By | Automated crawl |
| Used for AI Model Training | No |
| Affects AI Chat & Search Visibility | Not directly |
| Expected To Follow Robots.txt | Yes |
Why Is UpContent Visiting My Website?
UpContent found a public article that may be relevant to an UpContent user's chosen topics. It gathers the article for a person to review and potentially share with their audience. UpContent does not use it for AI training or republish it as original content.
Should I Block UpContent?
Usually no. UpContent helps people discover articles to review and share with their audiences, which can send engaged human readers to the original publisher. It does not collect content for AI training or generation. Block it only if you do not want your public articles considered for that distribution. For context, 7% of the top websites we track currently have robots.txt rules for UpContent.
How Do I Block UpContent Using Robots.txt?
Add this rule to your robots.txt file to block UpContent from accessing your website, or use Automatic Robots.txt to block all intelligence gatherers at once. You can customize which pages are blocked by swapping out / for a different path.
User-agent: UpContent # https://knownagents.com/agents/upcontent
Disallow: /Insights for UpContent
As of November 10, 2026, this data reflects agent visits measured across thousands of websites using Agent Analytics, combined with daily scans of the top 1000 websites and their robots.txt files.
Robots.txt Compliance
Country of Origin
Robots.txt Blocked Percentage
UpContent Traffic
Frequently Asked Questions
What Traffic Patterns Should I Expect From UpContent?
UpContent crawls public articles for UpContent users to review and share, not for AI training or generation. Expect sporadic visits when new information is available, normally capped at two requests per five seconds per hostname. Selected articles can send engaged readers to the original publisher. It respects robots.txt and crawl-delay rules.
Does UpContent Follow Robots.txt Rules?
Yes. UpContent says UpContent fully respects robots.txt user-agent restrictions and crawl-delay rules. A disallow rule prevents it from accessing the blocked path, while crawl-delay adjusts its request rate. Agent Analytics can confirm that its requests follow those rules.
Is UpContent Used for AI Model Training?
No. UpContent says UpContent collects public articles for people to review and share, not for AI training or generation.
Does Blocking UpContent Affect AI Search or Citations?
Not directly. Blocking UpContent does not control an AI search index, but it can keep your articles from being discovered and shared by UpContent users.
Does UpContent Access Private Content?
No. UpContent is designed to index publicly accessible web content and has no special access to private pages. Content that should stay private should still require authentication rather than relying only on robots.txt or an unlinked URL.
How Can I Verify a Request From UpContent?
Agent Analytics tracks UpContent visits in real time alongside every other known AI agent, crawler, and scraper. You can also check your server logs for the user agent shown above. Expect sporadic requests for public articles, normally no more than two requests per five seconds per hostname. A user-agent match alone can be spoofed; UpContent recommends reverse DNS to verify the requesting server.
How Is UpContent Different From Other UpContent Agents?
UpContent operates separate agents for different purposes, so each agent should be evaluated and controlled independently.
- Sottopop-user-rss: Sottopop-user-rss is a feed fetcher operated by UpContent that retrieves RSS content to support UpContent content discovery and curation features.
- SottopopNone: SottopopNone is a web crawler operated by UpContent, a content curation and discovery platform that helps users find and share relevant content for their marketing and so…
- Sottopop: Sottopop is a web crawler operated by UpContent, a content curation and discovery platform that helps marketers find and share relevant articles and content. The bot fetc…
- UpContent-QA: UpContent-QA is a QA crawler that requests public articles to test UpContent's human-focused content discovery and curation system before production use.
- UpContent-Test: UpContent-Test is a test web crawler operated by UpContent that requests public web pages to validate UpContent crawler behavior and content discovery systems.