📚 A compilation of research relevant to Data Together's efforts tackling the general problem of data resilience & interactivity
☆99Sep 27, 2018Updated 7 years ago
Alternatives and similar repositories for research
Users that are interested in research are comparing it to the libraries listed below
Sorting:
- Convert Directories, Files and ZIP Files to Web Archives (WARC)☆97Apr 22, 2025Updated 11 months ago
- Web application to allow users to add content metadata about crawled resources☆13Feb 15, 2018Updated 8 years ago
- Tools for access, "diff"-ing, and analyzing archived web pages☆22Mar 12, 2026Updated last week
- An Awesome List for getting started with web archiving☆2,505Mar 4, 2026Updated 2 weeks ago
- linkbak is a web page archiver : it reads a list of links and dumps the corresponding pages in HTML and PDF.☆13Dec 8, 2022Updated 3 years ago
- A ServiceWorker for client-side reconstruction of composite mementos☆16Mar 6, 2025Updated last year
- Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head☆174May 19, 2020Updated 5 years ago
- Web Archiving Integration Layer: One-Click User Instigated Preservation☆393Mar 12, 2025Updated last year
- The OpenWayback Development☆516Jan 3, 2024Updated 2 years ago
- Please note that the warc-indexer tool & code is now supported by NetArchiveSuite. The 'warc-indexer' directory and code that exists in t…☆132Nov 21, 2025Updated 4 months ago
- Parse OCR result files for pagenos, tables of contents, etc.☆14Nov 30, 2011Updated 14 years ago
- brozzler - distributed browser-based web crawler☆791Updated this week
- Host, backup, and share hyperdrive archives☆13Aug 22, 2017Updated 8 years ago
- Request For Comments (RFCs) documenting changes to Qri☆12Nov 23, 2021Updated 4 years ago
- Protobuf/gRPC schemas for the Hyperdrive API☆14Jul 14, 2020Updated 5 years ago
- An HTTP API for tracking and annotating changes to a set of web pages.☆21Mar 12, 2026Updated last week
- A tool to scrape the ipfs network for information on the number of peers in the network.☆21Mar 22, 2024Updated 2 years ago
- A list of things related to software, literature, and other content for 🕣 Memento☆112Feb 4, 2026Updated last month
- Layout and custom fields for DanePubliczne.gov.pl☆10Dec 7, 2022Updated 3 years ago
- utility to fetch provenance information from Internet Archive's Wayback Machine☆14Feb 5, 2026Updated last month
- qri electron & web frontend☆23Aug 10, 2021Updated 4 years ago
- The public display of the homosaurus vocabulary.☆12Mar 10, 2026Updated last week
- UI to enable analysts to quickly assess changes to monitored government websites☆38Mar 5, 2026Updated 2 weeks ago
- simple dat downloading module☆10Jan 11, 2023Updated 3 years ago
- simple script to convert web resources to a single warc file☆23May 11, 2023Updated 2 years ago
- Uploads items into the Internet Archive after they have been downloaded with youtube-dl☆15Feb 28, 2015Updated 11 years ago
- How to use Scrivener to write HTMLBook☆17Jun 15, 2021Updated 4 years ago
- Parallelized web crawler written in Golang☆15Oct 2, 2018Updated 7 years ago
- Basic python script to list following and followed blogs on Tumblr☆20Oct 16, 2014Updated 11 years ago
- Documentation for Project Electron☆14Dec 2, 2024Updated last year
- ☆11Dec 15, 2025Updated 3 months ago
- DEPRECATED see coboxcoop/peerfs ~~ multiwriter peer-to-peer filesystem, built on kappa-core and hyperdrive☆15Aug 10, 2019Updated 6 years ago
- Reconcile artist names to the Getty Union List of Artist Names☆19Oct 10, 2016Updated 9 years ago
- push a dat to remote peers☆22May 11, 2020Updated 5 years ago
- Webrecorder Player for Desktop (OSX/Windows/Linux). (Built with Electron + Webrecorder)☆448Sep 17, 2020Updated 5 years ago
- Dat's way of encoding and decoding dat links [ DEPRECATED - see https://github.com/mafintosh/abstract-encoding and https://github.com/com…☆18Jan 6, 2022Updated 4 years ago
- Custom code for dataverse.harvard.edu and an issue tracker for the IQSS Dataverse team's operational work, for better tracking on https:/…☆11Updated this week
- A curated list of awesome tools for website diffing and change monitoring.☆513Oct 17, 2025Updated 5 months ago
- high level thoughts and issues for the future of cabal☆14Jan 9, 2024Updated 2 years ago