Converts HTTrack crawls to WARC files
☆39Aug 6, 2024Updated 2 years ago
Alternatives and similar repositories for httrack2warc
Users that are interested in httrack2warc are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Extracts plain text, language identification and more metadata from WARC records☆22Apr 16, 2026Updated 7 months ago
- CDXJ Indexing of WARC/ARCs☆37Nov 14, 2026Updated last week
- Backend, IA-specific tools for crawling and processing the scholarly web. Content ends up in https://fatcat.wiki☆28Jul 31, 2024Updated 2 years ago
- simple script to convert web resources to a single warc file☆24May 11, 2023Updated 3 years ago
- Convert Directories, Files and ZIP Files to Web Archives (WARC)☆103Aug 28, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Web archive index server based on RocksDB☆46Nov 13, 2026Updated last week
- url canonicalization library for python and java☆44May 22, 2022Updated 4 years ago
- ☆18Jun 19, 2019Updated 7 years ago
- Command line tool for digging into WARC files☆52Nov 13, 2026Updated last week
- Awesome list dedicated to digital and data preservation tools, sources, services and so on.☆39Oct 22, 2026Updated 3 weeks ago
- UserScript for empornium.me☆12Mar 26, 2020Updated 6 years ago
- Collection filter based on the aldeed:simple-schema structure. It outputs a Mongo Selector based on the chosen options from the UI. It is…☆11May 20, 2016Updated 10 years ago
- ☆12Oct 13, 2024Updated 2 years ago
- Support for writing WARC files with Scrapy☆24Dec 21, 2019Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Translation of query languages to serialized KoralQuery protocol☆15Nov 12, 2026Updated last week
- Samsung Smart TV app for SVT Play☆12Oct 19, 2013Updated 13 years ago
- A simple, unsophisticated Graphical User Interface implementing some yt-dlp functional☆12Oct 16, 2025Updated last year
- Object Resource Stream and CDXJ Drafts☆15Nov 28, 2018Updated 7 years ago
- utility to create an element from a simple CSS selector☆14Aug 1, 2023Updated 3 years ago
- Benchmark scripts for comparing different tokenizers and sentence segmenters of German☆12Feb 27, 2023Updated 3 years ago
- ☆63Oct 13, 2026Updated last month
- ☆12Nov 6, 2026Updated 2 weeks ago
- ☆11Nov 21, 2025Updated 11 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Sources is a web application that allows your team to store, manage and annotate your sources and to make them easily available to your r…☆13Jun 2, 2022Updated 4 years ago
- Open-source Chrome extension for injecting and overriding HTTP request headers☆15Jul 4, 2024Updated 2 years ago
- Single file C header for UTF-x-to-y conversions + helpers☆13Jun 11, 2023Updated 3 years ago
- Benson turns a list of URLs into mp3s of the contents of each web page - take control over your reading backlog!☆16Oct 30, 2024Updated 2 years ago
- An append-only, key-multivalue store☆11Nov 10, 2023Updated 3 years ago
- ☆14Feb 28, 2017Updated 9 years ago
- A C# library for loading LSD: Dream Emulator data files.☆15Aug 28, 2023Updated 3 years ago
- JSON with biographical and political data of Austrian Members of Parliament (Nationalrat/first Chamber) since 1920.☆13Dec 23, 2021Updated 4 years ago
- Firefox Addon to automatically select the save folder (local destination folder) based on filters.☆12Apr 16, 2016Updated 10 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- a simple Elasticsearch/Dancer/Bootstrap application for demonstration☆14Sep 29, 2013Updated 13 years ago
- Summarize CDX(J) files for MIME analysis per 2nd-level domain☆10Sep 5, 2024Updated 2 years ago
- Media Downloader App☆16Jun 27, 2026Updated 4 months ago
- A reddit bot that finds original publish dates on linked articles.☆11Nov 30, 2024Updated last year
- Agent Skill for Portfolio123 (P123): 464 functions, 4456 factors, verified line-by-line against official docs. Factor investing, screenin…☆23Oct 31, 2026Updated 2 weeks ago
- ADS (alternate data stream) manipulation☆10Apr 14, 2019Updated 7 years ago
- Sublime Text API Version Documenter☆11Jan 3, 2023Updated 3 years ago
Are these results useful?