nla / httrack2warcLinks
Converts HTTrack crawls to WARC files
☆33Updated last year
Alternatives and similar repositories for httrack2warc
Users that are interested in httrack2warc are comparing it to the libraries listed below
Sorting:
- 🎭 An introduction to the Internet Archiving ecosystem, tooling, and some of the ethical dilemmas that the community faces.☆58Updated last year
- Recover lost websites from the Web Infrastructure☆91Updated 5 months ago
- Official Python package for ArchiveBox, the self-hosted internet archiving solution.☆12Updated last year
- Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.☆130Updated 4 months ago
- A collection of tools for archiving and analysing the internet.☆78Updated 3 years ago
- ☆11Updated 4 years ago
- 🎭 An introduction to the Internet Archiving ecosystem, tooling, and some of the ethical dilemmas that the community faces.☆15Updated 5 years ago
- Archiving public telegram messages.☆16Updated 4 months ago
- Bash scripts which interact with Internet Archive Wayback Machine's Save Page Now☆136Updated 9 months ago
- Home of the official apt/deb package for Ubuntu/Debian-based systems.☆16Updated last year
- A list of things related to software, literature, and other content for 🕣 Memento☆103Updated last year
- URLTeam's second generation of URL shortener archiving tools☆79Updated 4 months ago
- Scripts to build and boot warrior virtual machine containing Docker☆122Updated 9 months ago
- A server to collect & archive websites that also supports video downloads☆84Updated 2 years ago
- Strip advertisements from downloaded YouTube videos☆60Updated 4 years ago
- [mirror] Backup a list of github starred repositories for the specified user.☆143Updated 2 years ago
- A youtube-dl extension with pluggable extractors☆53Updated 8 months ago
- Archiving URLs (outlinks) from a variety of sources.☆25Updated 3 weeks ago
- Grabbing everything from reddit.☆61Updated last year
- Tool and library for handling Web ARChive (WARC) files.☆164Updated last year
- The (new) discovery backend for https://odcrawler.xyz☆36Updated 2 years ago
- Command line tools and libraries for handling and manipulating WARC files (and HTTP contents)☆168Updated 4 months ago
- 🔍 Reverse search an image on every search engine☆42Updated 5 years ago
- wpull fork with fixes and faster parsing using html5-parser; used by grab-site; should go away when wpull is similarly improved☆30Updated 3 months ago
- Wayback Machine Downloader. 🔥 Download your entire archived websites from the Internet Archive Wayback Machine.☆100Updated 3 years ago
- Scrape https://unlistedvideos.com/☆15Updated 4 years ago
- Mozilla LZ4 File Decryption and Mining Tools☆38Updated 8 months ago
- DigestBox takes any webpage URL (news article, video link, comment thread, etc.) and gives you just the raw content. It's powered by Arch…☆19Updated last year
- A collection of scripts that make spending time on the web easy.☆70Updated 2 years ago
- Sources for urls-grab.☆12Updated this week