internetarchive / Zeno
State-of-the-art web crawler 🔱
☆119Updated this week
Alternatives and similar repositories for Zeno:
Users that are interested in Zeno are comparing it to the libraries listed below
- Experimental proxy and wrapper for safely embedding Web Archives (warc, warc.gz, wacz) into web pages.☆30Updated 2 months ago
- A tool for detecting viruses and NSFW material in WARC files☆11Updated 6 months ago
- Command line tool for digging into WARC files☆38Updated this week
- wabac.js - Web Archive Browsing Augmentation Client☆106Updated this week
- JavaScript module and CLI tool for working with web archive data using the WACZ format specification.☆13Updated 2 weeks ago
- Wombat.js client-side rewriting library☆90Updated 2 weeks ago
- Browsertrix is the hosted, high-fidelity, browser-based crawling service from Webrecorder designed to make web archiving easier and more …☆241Updated this week
- Command line tool to convert a file in the WARC format to a file in the ZIM format☆54Updated 2 weeks ago
- 🍨 High-fidelity, browser-based, single-page web archiving library and CLI for witnessing the web.☆150Updated this week
- Specifications developed and maintained by the Webrecorder community.☆129Updated last month
- Digital Preservation of HTTP in documentary heritage.☆22Updated last year
- (Experimental) High-fidelity capture of Twitter threads as sealed PDFs.☆54Updated last year
- Web archive index server based on RocksDB☆34Updated 3 months ago
- CDXJ Indexing of WARC/ARCs☆25Updated 2 months ago
- A Memento Aggregator CLI and Server in Go☆61Updated 3 weeks ago
- ☆10Updated 3 years ago
- Centralised repository for WARC usage specifications.☆107Updated 3 months ago
- Command-line tool and Rust library for handling Web ARChive (WARC) files☆14Updated 3 months ago
- A framework for quick web archiving; canonical repository: https://gitea.arpa.li/JustAnotherArchivist/qwarc☆27Updated 3 years ago
- Static Site Generator for Viewing Web Archives (in WACZ) format☆22Updated last year
- Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.☆115Updated 2 months ago
- Arquivo.pt main goal is the preservation and access of web contents that are no longer available online. During the developing of the PW…☆43Updated last month
- A search interface and wayback machine for the UKWA Solr based warc-indexer framework.☆109Updated last month
- Converts WARC files to static HTML☆43Updated 8 months ago
- A command line tool to archive a git repository from GitHub to the Internet Archive.☆93Updated 4 years ago
- search interface for scholarly works☆84Updated 7 months ago
- Webrecorder Automated In-Page Behavior Framework☆13Updated 3 years ago
- Simple golang firehose for Bluesky.☆60Updated last month
- WARC and ARC indexing and discovery tools.☆122Updated 6 months ago
- Automated behaviors that run in browser to interact with complex sites automatically. Used by ArchiveWeb.page and Browsertrix Crawler.☆39Updated last week