🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

• UpdatedNov 15, 2025
• Python

Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.

• UpdatedNov 26, 2025
• Java

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

• UpdatedMay 23, 2025
• Python

Collect and revisit web pages.

• UpdatedJan 11, 2025
• Python

A High-Fidelity Web Archiving Extension for Chrome and Chromium based browsers!

• UpdatedNov 4, 2025
• TypeScript

Run a high-fidelity browser-based web archiving crawler in a single Docker container

• UpdatedNov 28, 2025
• TypeScript

Serverless replay of web archives directly in the browser

• UpdatedNov 29, 2025
• TypeScript

InterPlanetary Wayback: A distributed and persistent archive replay system using IPFS

• UpdatedOct 10, 2025
• Python

Webrecorder Player for Desktop (OSX/Windows/Linux). (Built with Electron + Webrecorder)

• UpdatedSep 17, 2020
• JavaScript

Streaming WARC/ARC library for fast web archive IO

• UpdatedDec 10, 2024
• Python

WarcDB: Web crawl data as SQLite databases.

• UpdatedJul 13, 2024
• Python

🐋 Web Archiving Integration Layer: One-Click User Instigated Preservation

• UpdatedMar 12, 2025
• Roff

News crawling with StormCrawler - stores content as WARC

• UpdatedFeb 19, 2025
• Java

Browsertrix is the hosted, high-fidelity, browser-based crawling service from Webrecorder designed to make web archiving easier and more accessible for all!

• UpdatedNov 28, 2025
• TypeScript

Bitextor generates translation memories from multilingual websites

• UpdatedNov 11, 2024
• Python

WARC + AI - Experimental Retrieval Augmented Generation Pipeline for Web Archive Collections.

• UpdatedFeb 11, 2025
• Python

Chrome extension to "Create WARC files from any webpage"

• UpdatedDec 6, 2023
• JavaScript

CoCrawler is a versatile web crawler built using modern tools and concurrency.

• UpdatedApr 29, 2022
• Python

A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine

• UpdatedNov 21, 2025
• Python

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

• UpdatedOct 8, 2025
• Scala