harvard-lil / bag-nabitLinks
Download and attach provenance to public datasets
☆35Updated 7 months ago
Alternatives and similar repositories for bag-nabit
Users that are interested in bag-nabit are comparing it to the libraries listed below
Sorting:
- Data Catalog Vocabulary (DCAT) - United States Profile Chief Data Officers Council & Federal Committee on Statistical Methodology☆74Updated 5 months ago
- Adds a reconciliation API endpoint to Datasette, based on the Reconciliation Service API specification.☆24Updated last year
- Experimental proxy and wrapper for safely embedding Web Archives (warc, warc.gz, wacz) into web pages.☆38Updated 5 months ago
- (Experimental) High-fidelity capture of Twitter threads as sealed PDFs.☆55Updated last year
- A tool for collection archival slivers of the web and web archives☆16Updated 8 months ago
- 🍨 High-fidelity, browser-based, single-page web archiving library and CLI for witnessing the web.☆178Updated last month
- Command line tool for digging into WARC files☆46Updated this week
- A command line utility for listing and searching snapshots in web archives☆17Updated last year
- A static site generator for SPARQL backends.☆136Updated 2 months ago
- poetry from dirty ocr☆62Updated 4 years ago
- ReproZip for the Preservation of Web Applications☆17Updated last year
- WARC + AI - Experimental Retrieval Augmented Generation Pipeline for Web Archive Collections.☆261Updated 8 months ago
- A general purpose tool for text-based crosswalking☆107Updated last year
- A search interface and wayback machine for the UKWA Solr based warc-indexer framework.☆131Updated this week
- Tools for running OCR against files stored in S3☆119Updated 3 years ago
- Create and edit WARC and WACZ files☆17Updated 10 months ago
- Command-line tool and Rust library for handling Web ARChive (WARC) files☆25Updated 5 months ago
- Web Archiving Course☆23Updated last year
- A tool for detecting viruses and NSFW material in WARC files☆17Updated last year
- Add website scraping abilities to Datasette☆65Updated 2 years ago
- Please note that the warc-indexer tool & code is now supported by NetArchiveSuite. The 'warc-indexer' directory and code that exists in t…☆130Updated 3 months ago
- Platform for journalists to search, analyse, categorise and share unstructured data☆56Updated last week
- Shell script to run OpenRefine in batch mode (import, transform, export). It orchestrates OpenRefine (server) and a python client that co…☆86Updated last year
- JavaScript module and CLI tool for working with web archive data using the WACZ format specification.☆16Updated 7 months ago
- Tools for personal analytics using SQLite and Datasette☆125Updated last year
- A Github Action for turning Markdown into ReSpec HTML☆14Updated last year
- Tracking the history of trees in San Francisco☆46Updated last week
- Convert Directories, Files and ZIP Files to Web Archives (WARC)☆89Updated 6 months ago
- Python IMage MIning☆14Updated 7 months ago
- Converts WARC files to static HTML☆49Updated last month