ArchiveTeam / grab-siteLinks
The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
☆1,547Updated 7 months ago
Alternatives and similar repositories for grab-site
Users that are interested in grab-site are comparing it to the libraries listed below
Sorting:
- Wget-compatible web downloader and crawler.☆597Updated last year
- Core Python Web Archiving Toolkit for replay and recording of web archives☆1,598Updated last month
- Collect and revisit web pages.☆1,531Updated last week
- An Awesome List for getting started with web archiving☆2,432Updated 2 months ago
- A Python and Command-Line Interface to Archive.org☆1,809Updated this week
- Webrecorder Player for Desktop (OSX/Windows/Linux). (Built with Electron + Webrecorder)☆445Updated 5 years ago
- Run a high-fidelity browser-based web archiving crawler in a single Docker container☆948Updated this week
- Web Archiving Integration Layer: One-Click User Instigated Preservation☆385Updated 9 months ago
- ArchiveBot, an IRC bot for archiving websites☆404Updated 5 months ago
- Serverless replay of web archives directly in the browser☆895Updated last month
- Use yt-dlp to download video/metadata and upload to the Internet Archive.☆468Updated 2 months ago
- An archiving tool with an IM-style interface that prioritizes privacy and accessibility, integrated with various archival services includ…☆2,123Updated 3 weeks ago
- List of data-hoarding related tools☆1,254Updated 2 years ago
- Chrome extension to "Create WARC files from any webpage"☆227Updated last month
- Utilities for dealing with Tumblr blogs, Tumblr backup☆692Updated 11 months ago
- Self-Hosted Bookmark And Archive Manager☆1,834Updated last year
- A curated list of awesome tools for website diffing and change monitoring.☆512Updated 2 months ago
- Webrecorder Desktop App!☆205Updated 4 years ago
- Offline Internet Archive project☆309Updated last year
- A Dockerfile for the ArchiveTeam Warrior☆419Updated 4 months ago
- Indexes open directories☆1,307Updated last month
- Starting point for archiving entire YouTube channels using yt-dlp (originally youtube-dl)☆511Updated 3 months ago
- Library of Alexandria (LoA in short) is a project that aims to collect and archive documents from the internet.☆129Updated last year
- archive reddit data as offline friendly web pages☆173Updated 5 years ago
- 💾 dn - offline full-text search and archiving for your Chromium-based browser.☆3,858Updated last week
- Shell scripts for organizing and managing ebook collections☆758Updated 5 years ago
- Extremely fast tool to remove duplicates and other lint from your filesystem☆2,244Updated this week
- A simple Python wrapper for the archive.is capturing service☆210Updated 11 months ago
- Download an entire website from the Wayback Machine.☆5,766Updated last year
- Bash scripts which interact with Internet Archive Wayback Machine's Save Page Now☆136Updated 9 months ago