steffenfritz / html2warc
simple script to convert web resources to a single warc file
☆21Updated last year
Alternatives and similar repositories for html2warc:
Users that are interested in html2warc are comparing it to the libraries listed below
- ArchiveBoxMatic: configure ArchiveBox with the simplicity of a yaml file.☆14Updated 4 years ago
- Web archive index server based on RocksDB☆34Updated 5 months ago
- CDXJ Indexing of WARC/ARCs☆25Updated 4 months ago
- Official Python package for ArchiveBox, the self-hosted internet archiving solution.☆13Updated 7 months ago
- A list of things related to software, literature, and other content for 🕣 Memento☆97Updated 11 months ago
- Chrome extension that uses Memento to indicate that a page a user is viewing on the live web has an archived copy and to give the user ac …☆54Updated 2 months ago
- 🎭 An introduction to the Internet Archiving ecosystem, tooling, and some of the ethical dilemmas that the community faces.☆54Updated 8 months ago
- A Memento Aggregator CLI and Server in Go☆64Updated 2 months ago
- A dockerized, queued high fidelity web archiver based on Squidwarc☆58Updated 10 months ago
- The root of the webcurator tool project, containing all modules needed to run a fully functional webcurator tool.☆8Updated last week
- A social media open post web archiving tool☆25Updated this week
- Homebrew formula for the ArchiveBox self-hosted internet archiving solution.☆28Updated 7 months ago
- Digital Preservation of HTTP in documentary heritage.☆22Updated last year
- ☆10Updated 3 years ago
- Simple workflow tool for imaging optical media☆10Updated 8 months ago
- An Awesome List for getting started with web archiving☆19Updated 6 years ago
- Comparing warc files☆17Updated 6 years ago
- A listing of world wide web archives, for humans and machines using Web Archive Manifest (WAM) yaml format☆53Updated 2 years ago
- Awesome list dedicated to digital and data preservation tools, sources, services and so on.☆25Updated 2 years ago
- A command line utility for listing and searching snapshots in web archives☆16Updated last year
- Static Site Generator for Viewing Web Archives (in WACZ) format☆26Updated last year
- ☆27Updated 2 years ago
- ☆43Updated last year
- 📚 A compilation of research relevant to Data Together's efforts tackling the general problem of data resilience & interactivity☆95Updated 6 years ago
- A Rails engine supporting the discovery of web archives.☆50Updated last year
- Selected code and data for The Online Books Page and related applications☆11Updated last week
- Clean a series of links, resolving redirects and finding Wayback results if page is gone. Originally written to aid with importing from A…☆18Updated 7 months ago
- DigestBox takes any webpage URL (news article, video link, comment thread, etc.) and gives you just the raw content. It's powered by Arch…☆19Updated last year
- Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.☆120Updated 4 months ago
- Command line tool for digging into WARC files☆39Updated this week