📚 A compilation of research relevant to Data Together's efforts tackling the general problem of data resilience & interactivity
☆100Sep 27, 2018Updated 8 years ago
Alternatives and similar repositories for research
Users that are interested in research are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Web application to allow users to add content metadata about crawled resources☆13Feb 15, 2018Updated 8 years ago
- Convert Directories, Files and ZIP Files to Web Archives (WARC)☆102Aug 28, 2026Updated 2 months ago
- ☆10Jun 10, 2016Updated 10 years ago
- Hacking challenges to learn web archive security.☆35Jun 23, 2017Updated 9 years ago
- Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head☆178May 19, 2020Updated 6 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- utility to fetch provenance information from Internet Archive's Wayback Machine☆15Feb 5, 2026Updated 8 months ago
- Tools for access, "diff"-ing, and analyzing archived web pages☆24Oct 23, 2026Updated last week
- Official Python package for ArchiveBox, the self-hosted internet archiving solution.☆12Oct 5, 2024Updated 2 years ago
- brozzler - distributed browser-based web crawler☆822Updated this week
- A dockerized, queued high fidelity web archiver based on Squidwarc☆62Jul 9, 2024Updated 2 years ago
- Visegrad+ Parliament API. Access to parliament data of Visegrad+ countries in a common data standard.☆11May 17, 2016Updated 10 years ago
- A ServiceWorker for client-side reconstruction of composite mementos☆16Mar 6, 2025Updated last year
- A list of things related to software, literature, and other content for 🕣 Memento☆126May 22, 2026Updated 5 months ago
- linkbak is a web page archiver : it reads a list of links and dumps the corresponding pages in HTML and PDF.☆13Dec 8, 2022Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- The OpenWayback Development☆530Jan 3, 2024Updated 2 years ago
- Host, backup, and share hyperdrive archives☆13Aug 22, 2017Updated 9 years ago
- Collaborative collection development for web archives☆19Sep 5, 2019Updated 7 years ago
- Start here! Discussion for Data Together: Building a better future for data☆47Oct 21, 2019Updated 7 years ago
- Protobuf/gRPC schemas for the Hyperdrive API☆14Jul 14, 2020Updated 6 years ago
- A service that provides archive-aware oEmbed-compatible embeddable surrogates (social cards, thumbnails, etc.) for archived web pages (me…☆14Nov 15, 2021Updated 4 years ago
- Tools for helping you work with web platform archive downloads.☆18Mar 27, 2020Updated 6 years ago
- Web archiving using Google Chrome☆44Dec 30, 2019Updated 6 years ago
- simple dat downloading module☆10Jan 11, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- An HTTP API for tracking and annotating changes to a set of web pages.☆24Oct 23, 2026Updated last week
- Request For Comments (RFCs) documenting changes to Qri☆12Nov 23, 2021Updated 4 years ago
- Command line tool for digging into WARC files☆52Aug 5, 2026Updated 2 months ago
- A collection of tools for archiving and analysing the internet.☆81Jul 6, 2022Updated 4 years ago
- golang readers for ARC and WARC webarchive formats☆20Apr 3, 2023Updated 3 years ago
- Clone the NPM registry into IPFS☆20May 1, 2025Updated last year
- Webrecorder Player for Desktop (OSX/Windows/Linux). (Built with Electron + Webrecorder)☆445Sep 17, 2020Updated 6 years ago
- Web Archiving Integration Layer: One-Click User Instigated Preservation☆402Jun 19, 2026Updated 4 months ago
- Parse And Create Web ARChive (WARC) files with node.js☆105Jan 29, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Implementation of the Block data structure in JavaScript.☆13Dec 6, 2022Updated 3 years ago
- A Memento Aggregator CLI and Server in Go☆83Apr 9, 2026Updated 6 months ago
- This software (prototype) extracts values of Excel spreadsheet properties and calculates a tentative spreadsheet complexity assessment ba…☆13May 15, 2026Updated 5 months ago
- WARC writing MITM HTTP/S proxy☆468Jun 17, 2026Updated 4 months ago
- [DEPRECATED]: now part of the https://github.com/libp2p/js-libp2p repo☆14Aug 23, 2019Updated 7 years ago
- Parse OCR result files for pagenos, tables of contents, etc.☆14Nov 30, 2011Updated 14 years ago
- UI to enable analysts to quickly assess changes to monitored government websites☆40Oct 24, 2026Updated last week