Tool and library for handling Web ARChive (WARC) files.
☆165Oct 11, 2024Updated last year
Alternatives and similar repositories for warcat
Users that are interested in warcat are comparing it to the libraries listed below
Sorting:
- Streaming WARC/ARC library for fast web archive IO☆451Dec 10, 2024Updated last year
- Command line tools and libraries for handling and manipulating WARC files (and HTTP contents)☆171Aug 18, 2025Updated 7 months ago
- Parse And Create Web ARChive (WARC) files with node.js☆104Jan 29, 2025Updated last year
- A collection of tools for archiving and analysing the internet.☆78Jul 6, 2022Updated 3 years ago
- Wget-compatible web downloader and crawler.☆603Apr 29, 2024Updated last year
- Nondestructive warc-in-tar to warc conversion☆27Apr 21, 2013Updated 12 years ago
- Convert HTTP Archive (HAR) -> Web Archive (WARC) format☆56Oct 21, 2018Updated 7 years ago
- a PhoneGap/Cordova plugin for OpenEars:☆10Apr 27, 2015Updated 10 years ago
- The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns☆1,561May 23, 2025Updated 9 months ago
- An evil web server.☆13May 9, 2015Updated 10 years ago
- Speech Recognition Plugin for Phonegap based on https://github.com/currycat/SpeechToText.git☆13Jan 13, 2015Updated 11 years ago
- Webrecorder Player for Desktop (OSX/Windows/Linux). (Built with Electron + Webrecorder)☆448Sep 17, 2020Updated 5 years ago
- ☆14Nov 22, 2013Updated 12 years ago
- WarcMiddleware lets users seamlessly download a mirror copy of a website when running a web crawl with the Python web crawler Scrapy.☆48Mar 19, 2018Updated 8 years ago
- WARC writing MITM HTTP/S proxy☆447Feb 3, 2026Updated last month
- Please note that the warc-indexer tool & code is now supported by NetArchiveSuite. The 'warc-indexer' directory and code that exists in t…☆132Nov 21, 2025Updated 4 months ago
- NOTE: This project is no longer being actively developed.. Check out https://replayweb.page / https://github.com/webrecorder/replayweb.pa…☆201Jan 22, 2025Updated last year
- Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head☆174May 19, 2020Updated 5 years ago
- Core Python Web Archiving Toolkit for replay and recording of web archives☆1,636Jan 21, 2026Updated 2 months ago
- Parse WARC (Web Archive Files) as a node.js stream☆23Oct 20, 2014Updated 11 years ago
- Python library for reading and writing warc files☆248Mar 7, 2022Updated 4 years ago
- ☆16May 17, 2012Updated 13 years ago
- An archival and backup file system for Linux using FUSE.☆25Jan 22, 2017Updated 9 years ago
- Cordova plugin to support iAd on iOS☆38Mar 22, 2015Updated 11 years ago
- c++ wrapper for libpuzzle☆16Jul 23, 2014Updated 11 years ago
- An app for viewing grapheme-to-color synesthesia sets (if you have no idea what that means, check Wikipedia! It's pretty cool.)☆13Oct 16, 2021Updated 4 years ago
- Content Based Image Recognition Platform for Early Printed Materials☆11Mar 28, 2019Updated 6 years ago
- A slow JS-based HTML parser with good error feedback and debugging metadata.☆117Mar 28, 2019Updated 6 years ago
- Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.☆47Dec 4, 2017Updated 8 years ago
- The OpenWayback Development☆516Jan 3, 2024Updated 2 years ago
- iNQUIRE is a digital research platform, designed to surface any digital repository using any metadata schema. Coded in HTML5, and leverag…☆11Mar 3, 2023Updated 3 years ago
- One Round Trip! Based off https://github.com/erikras/react-redux-universal-hot-example☆18Aug 20, 2015Updated 10 years ago
- An example of using the P-Eigenfaces Processing library to perform face recognition☆17Oct 22, 2012Updated 13 years ago
- Precompile inline Handlebars templates.☆15Mar 26, 2018Updated 7 years ago
- Saves proxied HTTP traffic to a WARC file.☆28Oct 22, 2013Updated 12 years ago
- Collect and revisit web pages.☆1,535Jan 5, 2026Updated 2 months ago
- Skmatc (schematic) is the powerful JavaScript object validation framework powering Iridium☆23Jun 14, 2020Updated 5 years ago
- A Rust library for reading and writing WARC files☆59Nov 27, 2024Updated last year
- A dockerized, queued high fidelity web archiver based on Squidwarc☆62Jul 9, 2024Updated last year