Agents
AI Assistants
Every known artificial agent (bot) on the internet. You can track their activity on your website with Agent Analytics, or control their behavior with Automatic Robots.txt.
AI Assistants
AI2Bot-DeepResearchEval
Ai2Bot-DeepResearchEval is operated by Ai2, a non-profit AI research institute. It's used to collect and scan resources used in deep research queries performed by Ai2's o…
AI Assistant
Fetches website content in response to a user prompt, to include in an AI-generated answer
See More →
Amzn-User
Amzn-User is an AI assistant operated by Amazon, used for fetching web content to answer user queries through Alexa and other Amazon AI services.
AI Assistant
Fetches website content in response to a user prompt, to include in an AI-generated answer
See More →
bigsur.ai
bigsur.ai is a web crawler operated by Big Sur AI that fetches website content to enable AI-powered web agents, sales assistants, and content marketing solutions for busi…
AI Assistant
Fetches website content in response to a user prompt, to include in an AI-generated answer
See More →
ChatGPT-User
ChatGPT-User is OpenAI's web crawler that visits websites when ChatGPT users request information. This enables ChatGPT to include links in its responses.
AI Assistant
Fetches website content in response to a user prompt, to include in an AI-generated answer
See More →
Claude-User
Claude-User is dispatched by Anthropic's Claude AI assistant in response to user prompts, when it needs to fetch content to include in its answers.
AI Assistant
Fetches website content in response to a user prompt, to include in an AI-generated answer
See More →
DuckAssistBot
DuckAssistBot is a web crawler that scans websites to collect content for DuckDuckGo's AI-assisted answers feature, which generates brief responses to search queries usin…
AI Assistant
Fetches website content in response to a user prompt, to include in an AI-generated answer
See More →
Gemini-Deep-Research
Gemini-Deep-Research is the agent responsible for collecting and scanning resources used in Google Gemini's Deep Research feature, which acts as a personal research assis…
AI Assistant
Fetches website content in response to a user prompt, to include in an AI-generated answer
See More →
Google-NotebookLM
Google-NotebookLM is an AI-powered research and note-taking assistant that helps users synthesize information from uploaded sources like documents, transcripts, or web co…
AI Assistant
Fetches website content in response to a user prompt, to include in an AI-generated answer
See More →
kagi-fetcher
kagi-fetcher is an AI Assistant operated by Kagi that fetches web content to answer user queries through Kagi AI, their suite of AI-powered tools including Assistant, Res…
AI Assistant
Fetches website content in response to a user prompt, to include in an AI-generated answer
See More →
KlaviyoAIBot
KlaviyoAIBot is Klaviyo's web crawler that fetches publicly available pages from domains explicitly connected to user accounts to power the Kai Customer Agent feature. Th…
AI Assistant
Fetches website content in response to a user prompt, to include in an AI-generated answer
See More →
LinerBot
LinerBot is the web crawler used by Liner AI assistant to gather information from academic sources and websites to provide accurate answers with line-by-line source citat…
AI Assistant
Fetches website content in response to a user prompt, to include in an AI-generated answer
See More →
meta-externalfetcher
meta-externalfetcher is used by Meta to perform user-initiated fetches of individual links from AI assistant product functions.
AI Assistant
Fetches website content in response to a user prompt, to include in an AI-generated answer
See More →
MistralAI-User
MistralAI-User is Mistral's AI assistant bot that performs web browsing and data gathering tasks for users in Le Chat, including opening web pages and retrieving informat…
AI Assistant
Fetches website content in response to a user prompt, to include in an AI-generated answer
See More →
Perplexity-User
Perplexity-User supports user actions within Perplexity. When users ask Perplexity a question, it might visit a web page to help provide an accurate answer and include a …
AI Assistant
Fetches website content in response to a user prompt, to include in an AI-generated answer
See More →
PhindBot
Phind is an AI-powered answer engine designed for developers, offering technical answers and code examples. It uses real-time web search and specialized AI models to prov…
AI Assistant
Fetches website content in response to a user prompt, to include in an AI-generated answer
See More →
Poggio-Citations
Poggio-Citations is a web crawler operated by Poggio, a company that provides AI sales enablement tools for creating tailored narratives, business cases, and account plan…
AI Assistant
Fetches website content in response to a user prompt, to include in an AI-generated answer
See More →
QualifiedBot
QualifiedBot is Qualified's web crawler that analyzes customer websites to provide contextual information for their AI-powered chatbots and conversational marketing platf…
AI Assistant
Fetches website content in response to a user prompt, to include in an AI-generated answer
See More →
Page 1 of 1