Python script to create CDX index files of WARC data
☆22Sep 4, 2025Updated last year
Alternatives and similar repositories for CDX-Writer
Users that are interested in CDX-Writer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- URL-agnostic WARC dedupe server☆12Jun 6, 2026Updated 5 months ago
- ☆23Feb 22, 2024Updated 2 years ago
- Python script to create CDX index files of WARC data☆16Sep 7, 2018Updated 8 years ago
- Seeder - Czech webarchive curating tool and public site☆18Nov 7, 2026Updated last week
- The Seesaw pipeline grab script for the URLTeam (terroroftinytown) project☆28Jul 17, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆59Jan 6, 2023Updated 3 years ago
- React components to render differences between captures at the Wayback Machine☆45Nov 2, 2026Updated 2 weeks ago
- Web archive index server based on RocksDB☆46Nov 13, 2026Updated last week
- A queue-controlled browser automation tool for improving web crawl quality☆69Nov 6, 2026Updated last week
- DeDuplicator add-on for Heritrix 3☆14Oct 9, 2026Updated last month
- Wget with Lua extension☆24Dec 17, 2015Updated 10 years ago
- Object Resource Stream and CDXJ Drafts☆15Nov 28, 2018Updated 7 years ago
- Java library for reading and writing WARC files with a typed API☆64Sep 1, 2026Updated 2 months ago
- Go package providing tools for working with Library of Congress data.☆12Oct 3, 2024Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Java library implementing the IIIF Presentation API☆15Feb 28, 2018Updated 8 years ago
- WARC writing MITM HTTP/S proxy☆470Jun 17, 2026Updated 5 months ago
- Prototype SOLR-powered web archive exploration UI.☆44Jun 3, 2020Updated 6 years ago
- Web archiving using Google Chrome☆44Dec 30, 2019Updated 6 years ago
- Backend, IA-specific tools for crawling and processing the scholarly web. Content ends up in https://fatcat.wiki☆28Jul 31, 2024Updated 2 years ago
- Citation Tools☆13May 15, 2017Updated 9 years ago
- The OpenWayback Development☆530Jan 3, 2024Updated 2 years ago
- Puzzle language written in Linear A☆12Mar 29, 2018Updated 8 years ago
- 小黑犬 FM | random music listening for weirdo☆11May 30, 2018Updated 8 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Archive Research Services Workshop☆31Sep 29, 2017Updated 9 years ago
- A proof-of-concept in-browser JavaScript-based search engine☆12Aug 25, 2015Updated 11 years ago
- WASAPI data transfer APIs☆51Apr 23, 2022Updated 4 years ago
- CDXJ Indexing of WARC/ARCs☆37Updated this week
- The Son of Suda On Line☆17Nov 11, 2026Updated last week
- Chrome extension that uses Memento to indicate that a page a user is viewing on the live web has an archived copy and to give the user ac…☆59Aug 27, 2025Updated last year
- The Guardian's configuration library☆14Nov 12, 2026Updated last week
- "The Pilotbird (Pycnoptilus floccosus) acts like nothing is wrong, but maybe she's just really good at lying."☆11Oct 23, 2026Updated 3 weeks ago
- A tool for detecting viruses and NSFW material in WARC files☆18Nov 6, 2026Updated 2 weeks ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- URLTeam's second generation of URL shortener archiving tools☆81Mar 12, 2026Updated 8 months ago
- Stand alone utilities for Scribe log server (Scribe C++ clients, Scribe C++ shared library)☆11Jun 8, 2012Updated 14 years ago
- Create HTML timelines by exporting .org files☆11Mar 30, 2026Updated 7 months ago
- IA's public Wayback Machine (moved from SourceForge)☆875Mar 1, 2024Updated 2 years ago
- Tools to analyze web archives☆20Jul 12, 2016Updated 10 years ago
- Backend scripts, files, etc. for parsing/updating dictionaries.☆20Jun 22, 2015Updated 11 years ago
- Tools for helping you work with web platform archive downloads.☆18Mar 27, 2020Updated 6 years ago
Are these results useful?