harvard-lil / scoopLinks
π¨ High-fidelity, browser-based, single-page web archiving library and CLI for witnessing the web.
β170Updated last week
Alternatives and similar repositories for scoop
Users that are interested in scoop are comparing it to the libraries listed below
Sorting:
- Browsertrix is the hosted, high-fidelity, browser-based crawling service from Webrecorder designed to make web archiving easier and more β¦β321Updated this week
- Experimental proxy and wrapper for safely embedding Web Archives (warc, warc.gz, wacz) into web pages.β36Updated 4 months ago
- (Experimental) High-fidelity capture of Twitter threads as sealed PDFs.β54Updated last year
- wabac.js - Web Archive Browsing Augmentation Clientβ113Updated last week
- Specifications developed and maintained by the Webrecorder community.β136Updated 8 months ago
- A list of things related to software, literature, and other content for π£ Mementoβ99Updated last year
- Converts WARC files to static HTMLβ48Updated last year
- Static Site Generator for Viewing Web Archives (in WACZ) formatβ28Updated 2 years ago
- Passively capture, archive, and hoard your web browsing history, including the contents of the pages you visit, for later offline viewingβ¦β89Updated last month
- π A compilation of research relevant to Data Together's efforts tackling the general problem of data resilience & interactivityβ97Updated 6 years ago
- π§© Proposal to allow user scripts like "expand comments", "hide popups", "fill out this form", etc. to be reusable across pure browser enβ¦β19Updated 2 months ago
- A simple Python wrapper and command-line interface for archive.orgβs "Save Page Now" capturing serviceβ182Updated 10 months ago
- Chrome extension to "Create WARC files from any webpage"β223Updated last year
- Chrome extension that uses Memento to indicate that a page a user is viewing on the live web has an archived copy and to give the user acβ¦β54Updated 2 weeks ago
- Convert Directories, Files and ZIP Files to Web Archives (WARC)β86Updated 4 months ago
- Web archive index server based on RocksDBβ35Updated last week
- A search interface and wayback machine for the UKWA Solr based warc-indexer framework.β131Updated last month
- Creates a complete full text historical archive for an RSS or ATOM feed.β124Updated last month
- Please note that the warc-indexer tool & code is now supported by NetArchiveSuite. The 'warc-indexer' directory and code that exists in tβ¦β128Updated last month
- Download and attach provenance to public datasetsβ34Updated 5 months ago
- Automated behaviors that run in browser to interact with complex sites automatically. Used by ArchiveWeb.page and Browsertrix Crawler.β49Updated last week
- searchmysite.net is an open source search engine and search as a serviceβ133Updated 2 months ago
- Command line tool for digging into WARC filesβ46Updated 2 weeks ago
- A tool for detecting viruses and NSFW material in WARC filesβ16Updated last year
- A Memento Aggregator CLI and Server in Goβ68Updated 6 months ago
- A command line utility for listing and searching snapshots in web archivesβ16Updated last year
- Create and edit WARC and WACZ filesβ15Updated 9 months ago
- Browsertrix: Containerized High-Fidelity Browser-Based Automated Crawling + Behavior Systemβ87Updated 4 years ago
- Web Archiving Integration Layer: One-Click User Instigated Preservationβ377Updated 5 months ago
- JavaScript module and CLI tool for working with web archive data using the WACZ format specification.β16Updated 6 months ago