harvard-lil / scoopLinks
π¨ High-fidelity, browser-based, single-page web archiving library and CLI for witnessing the web.
β162Updated this week
Alternatives and similar repositories for scoop
Users that are interested in scoop are comparing it to the libraries listed below
Sorting:
- Browsertrix is the hosted, high-fidelity, browser-based crawling service from Webrecorder designed to make web archiving easier and more β¦β286Updated this week
- Experimental proxy and wrapper for safely embedding Web Archives (warc, warc.gz, wacz) into web pages.β32Updated last month
- (Experimental) High-fidelity capture of Twitter threads as sealed PDFs.β54Updated last year
- wabac.js - Web Archive Browsing Augmentation Clientβ108Updated last week
- Static Site Generator for Viewing Web Archives (in WACZ) formatβ27Updated last year
- π A compilation of research relevant to Data Together's efforts tackling the general problem of data resilience & interactivityβ95Updated 6 years ago
- Automated behaviors that run in browser to interact with complex sites automatically. Used by ArchiveWeb.page and Browsertrix Crawler.β41Updated this week
- A tool for detecting viruses and NSFW material in WARC filesβ15Updated 10 months ago
- Passively capture, archive, and hoard your web browsing history, including the contents of the pages you visit, for later offline viewingβ¦β80Updated 2 months ago
- Specifications developed and maintained by the Webrecorder community.β131Updated 5 months ago
- A list of things related to software, literature, and other content for π£ Mementoβ99Updated last year
- Converts WARC files to static HTMLβ44Updated 11 months ago
- π§© Proposal to allow user scripts like "expand comments", "hide popups", "fill out this form", etc. to be reusable across pure browser enβ¦β18Updated 3 months ago
- Chrome extension to "Create WARC files from any webpage"β221Updated last year
- Download and attach provenance to public datasetsβ33Updated 2 months ago
- Chrome extension that uses Memento to indicate that a page a user is viewing on the live web has an archived copy and to give the user acβ¦β54Updated 4 months ago
- Convert Directories, Files and ZIP Files to Web Archives (WARC)β85Updated 2 months ago
- Creates a complete full text historical archive for an RSS or ATOM feed.β120Updated last week
- Command line tool for digging into WARC filesβ40Updated last week
- Command line tools and libraries for handling and manipulating WARC files (and HTTP contents)β161Updated 3 weeks ago
- A search interface and wayback machine for the UKWA Solr based warc-indexer framework.β114Updated 2 weeks ago
- β46Updated last year
- A command line utility for listing and searching snapshots in web archivesβ16Updated last year
- Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.β123Updated 5 months ago
- A tool for collection archival slivers of the web and web archivesβ13Updated 4 months ago
- Web archive index server based on RocksDBβ34Updated last month
- Better-looking RSS & Atom links when viewed in a browserβ25Updated 2 months ago
- A simple Python wrapper and command-line interface for archive.orgβs "Save Page Now" capturing serviceβ180Updated 8 months ago
- JS Streaming WARC IO optimized for Browser and Nodeβ44Updated 2 months ago
- β11Updated last year