Tool and library for handling Web ARChive (WARC) files.
☆164Oct 11, 2024Updated last year
Alternatives and similar repositories for warcat
Users that are interested in warcat are comparing it to the libraries listed below
Sorting:
- Command line tools and libraries for handling and manipulating WARC files (and HTTP contents)☆171Aug 18, 2025Updated 6 months ago
- Streaming WARC/ARC library for fast web archive IO☆451Dec 10, 2024Updated last year
- Parse And Create Web ARChive (WARC) files with node.js☆104Jan 29, 2025Updated last year
- A collection of tools for archiving and analysing the internet.☆78Jul 6, 2022Updated 3 years ago
- a PhoneGap/Cordova plugin for OpenEars:☆10Apr 27, 2015Updated 10 years ago
- Wget-compatible web downloader and crawler.☆600Apr 29, 2024Updated last year
- WarcMiddleware lets users seamlessly download a mirror copy of a website when running a web crawl with the Python web crawler Scrapy.☆48Mar 19, 2018Updated 7 years ago
- Convert HTTP Archive (HAR) -> Web Archive (WARC) format☆56Oct 21, 2018Updated 7 years ago
- Please note that the warc-indexer tool & code is now supported by NetArchiveSuite. The 'warc-indexer' directory and code that exists in t…☆132Nov 21, 2025Updated 3 months ago
- Parse WARC (Web Archive Files) as a node.js stream☆23Oct 20, 2014Updated 11 years ago
- The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns☆1,554May 23, 2025Updated 9 months ago
- Webrecorder Player for Desktop (OSX/Windows/Linux). (Built with Electron + Webrecorder)☆447Sep 17, 2020Updated 5 years ago
- CMOA Provenance entry tool☆15Aug 1, 2015Updated 10 years ago
- WARC writing MITM HTTP/S proxy☆445Feb 3, 2026Updated 3 weeks ago
- RoyGBiv is a python module for analyzing image colors☆25Aug 2, 2018Updated 7 years ago
- Python library for reading and writing warc files☆247Mar 7, 2022Updated 3 years ago
- [Abandoned] As mentioned by Pamela Fox ( @pamelafox )☆16Apr 20, 2016Updated 9 years ago
- Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head☆173May 19, 2020Updated 5 years ago
- c++ wrapper for libpuzzle☆16Jul 23, 2014Updated 11 years ago
- An app for viewing grapheme-to-color synesthesia sets (if you have no idea what that means, check Wikipedia! It's pretty cool.)☆13Oct 16, 2021Updated 4 years ago
- An example of using the P-Eigenfaces Processing library to perform face recognition☆17Oct 22, 2012Updated 13 years ago
- Sea battle client and server☆14Jul 29, 2012Updated 13 years ago
- A slow JS-based HTML parser with good error feedback and debugging metadata.☆117Mar 28, 2019Updated 6 years ago
- Leverage state of the art NLP models to generate human sounding musics☆11Jul 27, 2019Updated 6 years ago
- A library of examples showing how to use the Common Crawl corpus (2008-2012, ARC format)☆65Aug 5, 2016Updated 9 years ago
- NOTE: This project is no longer being actively developed.. Check out https://replayweb.page / https://github.com/webrecorder/replayweb.pa…☆201Jan 22, 2025Updated last year
- Various plugins for Impact JS☆28Mar 29, 2013Updated 12 years ago
- Content Based Image Recognition Platform for Early Printed Materials☆11Mar 28, 2019Updated 6 years ago
- Saves proxied HTTP traffic to a WARC file.☆28Oct 22, 2013Updated 12 years ago
- The OpenWayback Development☆516Jan 3, 2024Updated 2 years ago
- Core Python Web Archiving Toolkit for replay and recording of web archives☆1,627Jan 21, 2026Updated last month
- Sokoban for Android, puzzle game☆12Feb 2, 2017Updated 9 years ago
- Dokku (https://github.com/progrium/dokku) plugin to rebuild an app without a git push☆68Aug 31, 2016Updated 9 years ago
- A tool for analyzing dependency trees.☆11Sep 28, 2018Updated 7 years ago
- Python script to streamline the process of posting external HITs to Amazon's Mechanical Turk crowdsourcing website.☆11Oct 20, 2020Updated 5 years ago
- This is the supporting material for the API Jam workshop that introduce developers to Apigee Edge.☆13May 7, 2018Updated 7 years ago
- Utils to process stock data☆12May 20, 2019Updated 6 years ago
- Automatic Forms generation from Mongoose Models☆55Sep 22, 2015Updated 10 years ago
- Leaderboards backed by Redis in Node.js☆50Sep 3, 2021Updated 4 years ago