What is UpContent?

Usually no. UpContent helps people discover articles to review and share with their audiences, which can send engaged human readers to the original publisher. It does not collect content for AI training or generation. Block it only if you do not want your public articles considered for that distribution. Almost none of the top websites we track currently have robots.txt rules for UpContent.

Yes. UpContent says UpContent fully respects robots.txt user-agent restrictions and crawl-delay directives. A disallow rule prevents it from accessing the blocked path, while crawl-delay adjusts its request rate. Agent Analytics can confirm that its requests follow those rules.

No. UpContent is designed to index publicly accessible web content and has no special access to private pages. Content that should stay private should still require authentication rather than relying only on robots.txt or an unlinked URL.

UpContent found a public article that may be relevant to an UpContent user's chosen topics. It gathers the article for a person to review and potentially share with their audience. UpContent does not use it for AI training or republish it as original content.

Agent Analytics tracks UpContent visits in real time alongside every other known AI agent, crawler, and scraper. You can also check your server logs for the user agent shown above. Expect sporadic requests for public articles, normally no more than two requests per five seconds per hostname. A user-agent match alone can be spoofed; UpContent recommends reverse DNS to verify the requesting server.