Support for writing WARC files with Scrapy
☆24Dec 21, 2019Updated 6 years ago
Alternatives and similar repositories for scrapy-warcio
Users that are interested in scrapy-warcio are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆14Dec 28, 2022Updated 3 years ago
- Command line tools and libraries for handling and manipulating WARC files (and HTTP contents)☆175Aug 18, 2025Updated 10 months ago
- Android/Linux vmlinux loader☆12Oct 15, 2019Updated 6 years ago
- A curated list of awesome Jupyter projects and guides from the GLAM community.☆19Oct 6, 2021Updated 4 years ago
- A command line utility for listing and searching snapshots in web archives☆19Jun 4, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- sign elf binaries with GPG☆17Oct 10, 2016Updated 9 years ago
- Tidy data for librarians☆29Jun 30, 2026Updated last week
- Scrape and structure raw data from the Norwegian parliament's API.☆12Oct 24, 2025Updated 8 months ago
- Python wrapper for phonetisaurus grapheme to phoneme tool☆12Mar 11, 2021Updated 5 years ago
- A Python port of the Apache Lucene ASCII Folding Filter that converts alphabetic, numeric, and symbolic Unicode characters which are not …☆15May 3, 2020Updated 6 years ago
- Python Intro for Libraries☆24Updated this week
- Library Carpentry Wikidata☆25Updated this week
- Comparing warc files☆17Feb 21, 2019Updated 7 years ago
- Gemini web proxy☆15Feb 20, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Extracts plain text, language identification and more metadata from WARC records☆23Apr 16, 2026Updated 2 months ago
- CloudFlare Worker Shell☆14Aug 29, 2020Updated 5 years ago
- Command line tool for digging into WARC files☆50Updated this week
- Single file C header for UTF-x-to-y conversions + helpers☆13Jun 11, 2023Updated 3 years ago
- Norwegian Speech Transformer Models☆19Mar 26, 2026Updated 3 months ago
- Hacker news on Console with auto classifer and recommender in reactjs style code☆15Aug 29, 2019Updated 6 years ago
- silly game over telnet☆12May 31, 2017Updated 9 years ago
- A trend viewer written in Python/JavaScript☆21Nov 15, 2024Updated last year
- Example configurations for the Community Solid Server☆22Mar 9, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Improvised json-based configurable Windows sandbox☆11Sep 29, 2020Updated 5 years ago
- Wrangler Compatible Cloudflare Deployment API☆19Mar 27, 2026Updated 3 months ago
- PlayStation GPU (WIP)☆17Oct 3, 2023Updated 2 years ago
- Converts HTTrack crawls to WARC files☆34Aug 6, 2024Updated last year
- A C# library for loading LSD: Dream Emulator data files.☆15Aug 28, 2023Updated 2 years ago
- CDXJ Indexing of WARC/ARCs☆34May 11, 2026Updated last month
- Code+CAD data for tempescope☆11Sep 8, 2015Updated 10 years ago
- Sublime Text API Version Documenter☆11Jan 3, 2023Updated 3 years ago
- Official Python package for ArchiveBox, the self-hosted internet archiving solution.☆12Oct 5, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Nondestructive warc-in-tar to warc conversion☆27Apr 21, 2013Updated 13 years ago
- Control Philips Hue Lights with a MIDI Pad Controller☆12Aug 29, 2017Updated 8 years ago
- A collection of tools for archiving and analysing the internet.☆79Jul 6, 2022Updated 4 years ago
- A small package to remove the branding from plotly plots☆14Mar 18, 2018Updated 8 years ago
- Download APKs from APKMirror.com☆12May 27, 2021Updated 5 years ago
- Collection of profiles I use to configure Apple and MacOS devices☆10Aug 10, 2017Updated 8 years ago
- MFT Fast Transcoder is a fast forensic tool to analyze MFT of NTFS partitions.☆13May 21, 2026Updated last month