Internet Archive's Sparkling Data Processing Library
☆16Mar 3, 2026Updated last month
Alternatives and similar repositories for Sparkling
Users that are interested in Sparkling are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Web application for distributed compute analysis of Archive-It web archive collections.☆20Mar 24, 2026Updated 2 weeks ago
- ☆18Apr 19, 2025Updated 11 months ago
- Web Archiving Course☆23Mar 4, 2024Updated 2 years ago
- OCFL tools in Python☆25Aug 22, 2025Updated 7 months ago
- --DEPRECATED--. Use other top level repository under IntellectualHeaven.☆42Jan 30, 2015Updated 11 years ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- This project has been archived and is no longer being developed or supported. The Curator's Workbench is an extensible digital collectio…☆24Jun 25, 2020Updated 5 years ago
- An evil web server.☆13May 9, 2015Updated 10 years ago
- ☆26May 5, 2023Updated 2 years ago
- Add editing UI and other power-user features to Datasette.☆14Mar 4, 2023Updated 3 years ago
- Download GitHub repositories☆12May 10, 2025Updated 11 months ago
- Original GOKb repo - Moving to https://github.com/openlibraryenvironment/gokb☆11Jan 23, 2018Updated 8 years ago
- (Note: This repository is obsolete, please see the new Browsertrix webrecorder/browsertrix) Browser-Based On-Demand Web Archiving Automat…☆38Apr 23, 2019Updated 6 years ago
- A repository to organize materials from the AI4LAM Teach and Learning Working Group☆14May 5, 2023Updated 2 years ago
- visualizations/charts for media collections, based on mediainfo☆14Sep 15, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- A tool for collection archival slivers of the web and web archives☆17Feb 18, 2025Updated last year
- A framework for creating digital exhibits by loading collection metadata directly from a CSV (such as a published Google Sheet!). See the…☆14Feb 20, 2026Updated last month
- The paper repository for "10 quick tips for making your software outlive your job"☆19Oct 28, 2025Updated 5 months ago
- Seeder - Czech webarchive curating tool and public site☆17Feb 12, 2026Updated last month
- ☆29Feb 11, 2026Updated 2 months ago
- A polite and user-friendly downloader for Common Crawl data☆74Updated this week
- A utility for staging files, calculating and validating file checksums, and comparing checksum values between storage locations.☆14Jul 10, 2023Updated 2 years ago
- Scientific articles using or citing Common Crawl data☆28Mar 19, 2026Updated 3 weeks ago
- Tools to analyze web archives☆20Jul 12, 2016Updated 9 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Generates large collages of images using OpenSeadragon☆52Apr 9, 2024Updated 2 years ago
- Common web archive utility code.☆63Apr 1, 2026Updated last week
- Python script to create CDX index files of WARC data☆16Sep 7, 2018Updated 7 years ago
- Automatically generate Doom-metal album covers☆10May 29, 2015Updated 10 years ago
- Library for fast text representation and classification.☆31Jan 9, 2024Updated 2 years ago
- ☆10May 18, 2017Updated 8 years ago
- An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed…☆158Oct 8, 2025Updated 6 months ago
- ☆14Mar 24, 2026Updated 2 weeks ago
- The overarching project of Java code related to the Open Provenance specifications.☆25Apr 18, 2011Updated 14 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- A tool for exporting an Rdio collection to a portable file format like markdown.☆11Sep 4, 2016Updated 9 years ago
- utility to fetch provenance information from Internet Archive's Wayback Machine☆15Feb 5, 2026Updated 2 months ago
- golang readers for ARC and WARC webarchive formats☆20Apr 3, 2023Updated 3 years ago
- ☆16Apr 29, 2024Updated last year
- API definition, resources and reference implementation of URL Frontiers☆58Jan 23, 2026Updated 2 months ago
- Takes query parameters from a url to create the first cell of a jupyter notebook.☆17Nov 13, 2024Updated last year
- Citadel: Enterprise Search☆15May 2, 2023Updated 2 years ago