ArchiveTeam / grab-siteLinks
The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
☆1,529Updated 4 months ago
Alternatives and similar repositories for grab-site
Users that are interested in grab-site are comparing it to the libraries listed below
Sorting:
- Wget-compatible web downloader and crawler.☆592Updated last year
- Webrecorder Player for Desktop (OSX/Windows/Linux). (Built with Electron + Webrecorder)☆447Updated 5 years ago
- A Python and Command-Line Interface to Archive.org☆1,777Updated this week
- Web Archiving Integration Layer: One-Click User Instigated Preservation☆379Updated 7 months ago
- Use yt-dlp to download video/metadata and upload to the Internet Archive.☆462Updated this week
- An archiving tool with an IM-style interface that prioritizes privacy and accessibility, integrated with various archival services includ…☆2,074Updated last week
- ArchiveBot, an IRC bot for archiving websites☆400Updated 2 months ago
- WARC writing MITM HTTP/S proxy☆426Updated 2 weeks ago
- List of data-hoarding related tools☆1,227Updated 2 years ago
- Starting point for archiving entire YouTube channels using yt-dlp (originally youtube-dl)☆507Updated 2 weeks ago
- Chrome extension to "Create WARC files from any webpage"☆223Updated last year
- Utilities for dealing with Tumblr blogs, Tumblr backup☆686Updated 8 months ago
- A curated list of awesome tools for website diffing and change monitoring.☆512Updated 3 years ago
- Self-Hosted Bookmark And Archive Manager☆1,828Updated last year
- Extremely fast tool to remove duplicates and other lint from your filesystem☆2,194Updated 3 weeks ago
- Indexes open directories☆1,276Updated last month
- Webrecorder Desktop App!☆205Updated 4 years ago
- archive reddit data as offline friendly web pages☆174Updated 5 years ago
- find duplicate files utility☆1,179Updated last month
- MediaWiki scraper: all your wiki articles in one highly compressed ZIM file☆399Updated this week
- The ultimate collection of scripts for YouTube-DL.☆2,502Updated 4 months ago
- A Dockerfile for the ArchiveTeam Warrior☆412Updated last month
- Web Extension to save a faithful copy of an entire web page in a self-extracting ZIP file☆1,910Updated 2 months ago
- Bash scripts which interact with Internet Archive Wayback Machine's Save Page Now☆133Updated 6 months ago
- Offline Internet Archive project☆297Updated last year
- Browser extension for viewing archived and cached versions of web pages, available for Chrome, Edge and Safari☆1,418Updated last week
- The personal, minimalist, super-fast, database free, bookmarking service - community repo☆3,717Updated 2 months ago
- Download an entire website from the Wayback Machine.☆5,708Updated last year
- Scrapes Reddit to download media of your choice.☆1,139Updated 2 years ago
- Download the entire Wayback Machine archive for a given URL.☆3,091Updated 6 months ago