Converts HTTrack crawls to WARC files
☆39Aug 6, 2024Updated 2 years ago
Alternatives and similar repositories for httrack2warc
Users that are interested in httrack2warc are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Backend, IA-specific tools for crawling and processing the scholarly web. Content ends up in https://fatcat.wiki☆28Jul 31, 2024Updated 2 years ago
- Java library for reading and writing WARC files with a typed API☆64Sep 1, 2026Updated last month
- Webrecorder Player for Desktop (OSX/Windows/Linux). (Built with Electron + Webrecorder)☆445Sep 17, 2020Updated 6 years ago
- This plugin automatically formats the styles of ordered lists, incrementing the list style for each layer.☆20Jun 14, 2026Updated 4 months ago
- ☆18Jun 19, 2019Updated 7 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Command line tool for digging into WARC files☆52Aug 5, 2026Updated 2 months ago
- A search interface and wayback machine for the UKWA Solr based warc-indexer framework.☆148Updated this week
- Support for writing WARC files with Scrapy☆24Dec 21, 2019Updated 6 years ago
- Span formats.☆16Sep 25, 2026Updated last month
- An Example CouchApp using JSON Schema☆13Jul 30, 2014Updated 12 years ago
- A simple, unsophisticated Graphical User Interface implementing some yt-dlp functional☆12Oct 16, 2025Updated last year
- Merged search-arctika and search-achon into a multi-module project☆14May 20, 2022Updated 4 years ago
- code and data used to build a training dataset for dragnet models☆10Nov 29, 2020Updated 5 years ago
- MSX-EQ PSG Spectrolyzer Cartridge☆13Jan 16, 2026Updated 9 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Nondestructive warc-in-tar to warc conversion☆27Apr 21, 2013Updated 13 years ago
- Data generator for sunshine project☆11Jul 31, 2017Updated 9 years ago
- Clone of https://git.kernel.org/pub/scm/linux/kernel/git/jejb/sbsigntools.git/ with patches for yubikey support☆10Aug 14, 2020Updated 6 years ago
- Obsidian companion plugin for Vault Hub: publish snippets, notes, and templates to GitHub with one click☆14Sep 8, 2026Updated last month
- Official Python package for ArchiveBox, the self-hosted internet archiving solution.☆12Oct 5, 2024Updated 2 years ago
- Object Resource Stream and CDXJ Drafts☆15Nov 28, 2018Updated 7 years ago
- a simple Elasticsearch/Dancer/Bootstrap application for demonstration☆14Sep 29, 2013Updated 13 years ago
- Personal Knowledge Management tools☆10Jul 20, 2026Updated 3 months ago
- JS Streaming WARC IO optimized for Browser and Node☆55Sep 4, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Diff two unist trees☆15Aug 21, 2020Updated 6 years ago
- BIND SDB driver for CouchDB☆10Jun 21, 2011Updated 15 years ago
- ☆11Nov 21, 2025Updated 11 months ago
- A tool to load test data into CouchDB and measure performance☆10Feb 28, 2012Updated 14 years ago
- Open-source Chrome extension for injecting and overriding HTTP request headers☆15Jul 4, 2024Updated 2 years ago
- Performance-related scripts☆10Sep 14, 2012Updated 14 years ago
- Tool to decrypt Artifactory encrypted secrets☆12Feb 28, 2022Updated 4 years ago
- An interactive visualization of cognitive biases that affect human thinking and decision-making☆17Jun 28, 2025Updated last year
- ☆15Oct 26, 2022Updated 4 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Parse WARC (Web Archive Files) as a node.js stream☆23Oct 20, 2014Updated 12 years ago
- A reddit bot that finds original publish dates on linked articles.☆10Nov 30, 2024Updated last year
- ☆14Feb 28, 2017Updated 9 years ago
- An append-only, key-multivalue store☆11Nov 10, 2023Updated 2 years ago
- DeDuplicator add-on for Heritrix 3☆14Oct 9, 2026Updated 3 weeks ago
- JSON with biographical and political data of Austrian Members of Parliament (Nationalrat/first Chamber) since 1920.☆13Dec 23, 2021Updated 4 years ago
- VocaDB, UtaiteDB, TouhouDB etc. tagging sources for Mp3tag☆16Jun 30, 2025Updated last year