Agents

Archive-It

Archive-It is a web archiving crawler operated by Internet Archive that preserves copies of web pages for long-term digital preservation and historical record-keeping. It…

Archiver

Captures and stores historical website snapshots for long-term digital preservation

See More →

archive.org_bot

archive.org_bot is the Internet Archive's web crawler for the Wayback Machine, systematically crawling and preserving publicly accessible web pages for historical record …

Archiver

Captures and stores historical website snapshots for long-term digital preservation

See More →

Arquivo-web-crawler

Arquivo-web-crawler is the Portuguese web archive's bot that systematically crawls and preserves Portuguese websites for historical research, creating a comprehensive dig…

Archiver

Captures and stores historical website snapshots for long-term digital preservation

See More →

Authory

Authory is an automated content archiving crawler that systematically searches for and backs up published articles, podcasts, and videos by journalists and content creato…

Archiver

Captures and stores historical website snapshots for long-term digital preservation

See More →

bl.uk_lddc_bot

bl.uk_lddc_bot is operated by the British Library as part of their legal deposit web archiving program, which collects and preserves UK web content for the national archi…

Archiver

Captures and stores historical website snapshots for long-term digital preservation

See More →

bne.es_bot

bne.es_bot is an archiver. If you think this is incorrect or can provide additional detail about its purpose, please let us know.

Archiver

Captures and stores historical website snapshots for long-term digital preservation

See More →

bnf.fr_bot

bnf.fr_bot is the official web crawler of the Bibliothèque nationale de France (BNF), systematically collecting and archiving digital content from French websites to pres…

Archiver

Captures and stores historical website snapshots for long-term digital preservation

See More →

CUCH.org Archive Bot

CUCH.org Archive Bot is a web crawler that archives web content on behalf of C U Cyber History.

Archiver

Captures and stores historical website snapshots for long-term digital preservation

See More →

heritrix

heritrix is an archiver operated by Internet Archive. If you think this is incorrect or can provide additional detail about its purpose, please let us know.

Archiver

Captures and stores historical website snapshots for long-term digital preservation

See More →

ia_archiver

ia_archiver is an archiver operated by Internet Archive. If you think this is incorrect or can provide additional detail about its purpose, please let us know.

Archiver

Captures and stores historical website snapshots for long-term digital preservation

See More →

ia_archiver-web.archive.org

ia_archiver-web.archive.org is an archiver operated by Internet Archive. If you think this is incorrect or can provide additional detail about its purpose, please let us …

Archiver

Captures and stores historical website snapshots for long-term digital preservation

See More →

IABot

IABot (InternetArchiveBot) is a Wikipedia bot operated by the Internet Archive that combats link rot by finding dead links on Wikipedia articles and adding archived versi…

Archiver

Captures and stores historical website snapshots for long-term digital preservation

See More →

Internet Archive

Internet Archive is an archiver operated by Internet Archive. If you think this is incorrect or can provide additional detail about its purpose, please let us know.

Archiver

Captures and stores historical website snapshots for long-term digital preservation

See More →

mirrorweb

mirrorweb is a web archiving crawler that captures websites in their entirety, including dynamic content and interactive elements, creating tamper-proof WARC archives for…

Archiver

Captures and stores historical website snapshots for long-term digital preservation

See More →

netarkivindsamling

netarkivindsamling is a web crawler operated by the Royal Danish Library that collects Danish internet content according to the Danish Legal Deposit Act for preservation …

Archiver

Captures and stores historical website snapshots for long-term digital preservation

See More →

Nicecrawler

Nicecrawler is an archiver operated by NiceCrawler. If you think this is incorrect or can provide additional detail about its purpose, please let us know.

Archiver

Captures and stores historical website snapshots for long-term digital preservation

See More →

SmarshBot

SmarshBot is an archiving bot operated by Smarsh that crawls and captures web content for compliance management and regulatory recordkeeping purposes. Organizations use t…

Archiver

Captures and stores historical website snapshots for long-term digital preservation

See More →

special_archiver

special_archiver is a web crawler operated by Internet Archive as part of their Archive-It service, which creates and preserves collections of web content. This bot visit…

Archiver

Captures and stores historical website snapshots for long-term digital preservation

See More →

Turnitin

Turnitin crawler gathers web content to build a comprehensive database for plagiarism detection services, comparing student papers against internet content for academic i…

Archiver

Captures and stores historical website snapshots for long-term digital preservation

See More →

XY-Archive-Compliance

XY-Archive-Compliance creates website archives to help customers meet regulatory and legal compliance requirements for data retention and historical website preservation.

Archiver

Captures and stores historical website snapshots for long-term digital preservation

See More →

XY-Archive-Compliance-Archiver

XY-Archive-Compliance-Archiver is an archiving bot operated by XY Planning Network, a membership organization for fee-only financial advisors. This bot archives web conte…

Archiver

Captures and stores historical website snapshots for long-term digital preservation

See More →

Archivers