Internet Archive's Sparkling Data Processing Library
☆16May 4, 2026Updated 2 weeks ago
Alternatives and similar repositories for Sparkling
Users that are interested in Sparkling are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Web application for distributed compute analysis of Archive-It web archive collections.☆20Mar 24, 2026Updated last month
- ☆18Apr 29, 2026Updated 3 weeks ago
- OCFL tools in Python☆25Aug 22, 2025Updated 9 months ago
- This project has been archived and is no longer being developed or supported. The Curator's Workbench is an extensible digital collectio…☆24Jun 25, 2020Updated 5 years ago
- ☆26May 5, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Add editing UI and other power-user features to Datasette.☆14Mar 4, 2023Updated 3 years ago
- Download GitHub repositories☆12May 10, 2025Updated last year
- A minter for opaque identifiers in the style of California Digital Library's NOID.☆13May 14, 2018Updated 8 years ago
- Original GOKb repo - Moving to https://github.com/openlibraryenvironment/gokb☆11Jan 23, 2018Updated 8 years ago
- (Note: This repository is obsolete, please see the new Browsertrix webrecorder/browsertrix) Browser-Based On-Demand Web Archiving Automat…☆38Apr 23, 2019Updated 7 years ago
- A repository to organize materials from the AI4LAM Teach and Learning Working Group☆14May 5, 2023Updated 3 years ago
- Experimental proxy and wrapper for safely embedding Web Archives (warc, warc.gz, wacz) into web pages.☆43Nov 24, 2025Updated 5 months ago
- demos using the OpenRNDR framework☆13Mar 27, 2020Updated 6 years ago
- visualizations/charts for media collections, based on mediainfo☆14Sep 15, 2022Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A tool for collection archival slivers of the web and web archives☆17Feb 18, 2025Updated last year
- A framework for creating digital exhibits by loading collection metadata directly from a CSV (such as a published Google Sheet!). See the…☆14Feb 20, 2026Updated 3 months ago
- The paper repository for "10 quick tips for making your software outlive your job"☆19Oct 28, 2025Updated 6 months ago
- Seeder - Czech webarchive curating tool and public site☆17Feb 12, 2026Updated 3 months ago
- A polite and user-friendly downloader for Common Crawl data☆80May 4, 2026Updated 2 weeks ago
- A utility for staging files, calculating and validating file checksums, and comparing checksum values between storage locations.☆14Jul 10, 2023Updated 2 years ago
- Scientific articles using or citing Common Crawl data☆29Mar 19, 2026Updated 2 months ago
- Generates large collages of images using OpenSeadragon☆53Apr 9, 2024Updated 2 years ago
- Tools to analyze web archives☆20Jul 12, 2016Updated 9 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Common web archive utility code.☆63May 2, 2026Updated 2 weeks ago
- Library for fast text representation and classification.☆31Jan 9, 2024Updated 2 years ago
- Automatically generate Doom-metal album covers☆10May 29, 2015Updated 10 years ago
- Python script to create CDX index files of WARC data☆16Sep 7, 2018Updated 7 years ago
- ☆10May 18, 2017Updated 9 years ago
- Go OCFL Implementation☆18May 15, 2026Updated last week
- An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed…☆159Oct 8, 2025Updated 7 months ago
- ☆14Mar 24, 2026Updated last month
- The overarching project of Java code related to the Open Provenance specifications.☆25Apr 18, 2011Updated 15 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A tool for exporting an Rdio collection to a portable file format like markdown.☆11Sep 4, 2016Updated 9 years ago
- utility to fetch provenance information from Internet Archive's Wayback Machine☆15Feb 5, 2026Updated 3 months ago
- ☆16Apr 29, 2024Updated 2 years ago
- Takes query parameters from a url to create the first cell of a jupyter notebook.☆17Nov 13, 2024Updated last year
- API definition, resources and reference implementation of URL Frontiers☆60Updated this week
- Citadel: Enterprise Search☆15May 2, 2023Updated 3 years ago
- The ultimate Vim configuration: .vimrc (heavily customized, uncompromising and opinionated)☆11Mar 2, 2024Updated 2 years ago