ArchiveTeam / grab-site
The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
☆1,420Updated 6 months ago
Alternatives and similar repositories for grab-site:
Users that are interested in grab-site are comparing it to the libraries listed below
- Wget-compatible web downloader and crawler.☆561Updated 8 months ago
- An Awesome List for getting started with web archiving☆2,108Updated 2 weeks ago
- Core Python Web Archiving Toolkit for replay and recording of web archives☆1,434Updated 2 months ago
- Collect and revisit web pages.☆1,490Updated last week
- Run a high-fidelity browser-based web archiving crawler in a single Docker container☆686Updated this week
- brozzler - distributed browser-based web crawler☆682Updated this week
- A Python and Command-Line Interface to Archive.org☆1,655Updated last week
- Serverless replay of web archives directly in the browser☆734Updated this week
- Make a ZIM file from any Web site and surf offline!☆441Updated last week
- Web Archiving Integration Layer: One-Click User Instigated Preservation☆355Updated 3 months ago
- A Tool To Push Web Resources Into Web Archives☆412Updated 11 months ago
- Browsertrix is the hosted, high-fidelity, browser-based crawling service from Webrecorder designed to make web archiving easier and more …☆223Updated this week
- WARC writing MITM HTTP/S proxy☆391Updated last month
- A curated list of awesome tools for website diffing and change monitoring.☆501Updated 2 years ago
- An archiving tool with an IM-style interface that prioritizes privacy and accessibility, integrated with various archival services includ…☆1,862Updated this week
- Lightning-fast file system indexer and search tool☆920Updated this week
- A Dockerfile for the ArchiveTeam Warrior☆309Updated last month
- I consume the world via RSS feeds, and this is my attempt to keep it that way.☆778Updated 8 months ago
- Browser extension for viewing archived and cached versions of web pages, available for Chrome, Edge and Safari☆1,237Updated last month
- Download the entire Wayback Machine archive for a given URL.☆2,928Updated 8 months ago
- A High-Fidelity Web Archiving Extension for Chrome and Chromium based browsers!☆921Updated last week
- 💾 dn - offline full-text search and archiving for your Chromium-based browser.☆3,806Updated this week
- Indexes open directories☆1,171Updated 2 weeks ago
- The ultimate collection of scripts for YouTube-DL.☆2,345Updated 3 months ago
- Self-Hosted Bookmark And Archive Manager☆1,786Updated 8 months ago
- RSS generator website☆382Updated last year
- Web Extension to save a faithful copy of an entire web page in a self-extracting ZIP file☆1,849Updated 3 months ago
- A curated list of awesome IRC resources.☆971Updated 6 months ago
- Diskover Community Edition - Open source file indexer, file search engine and data management and analytics powered by Elasticsearch☆1,494Updated last week