Support for writing WARC files with Scrapy
☆24Dec 21, 2019Updated 6 years ago
Alternatives and similar repositories for scrapy-warcio
Users that are interested in scrapy-warcio are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆14Dec 28, 2022Updated 3 years ago
- Python for Librarians☆22Aug 1, 2018Updated 8 years ago
- A command-line interface for Panoptes☆21Jan 19, 2026Updated 7 months ago
- sign elf binaries with GPG☆17Oct 10, 2016Updated 9 years ago
- Scrape and structure raw data from the Norwegian parliament's API.☆12Jul 16, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Python wrapper for phonetisaurus grapheme to phoneme tool☆12Mar 11, 2021Updated 5 years ago
- A Python port of the Apache Lucene ASCII Folding Filter that converts alphabetic, numeric, and symbolic Unicode characters which are not …☆17May 3, 2020Updated 6 years ago
- Streaming WARC/ARC library for fast web archive IO☆471Jun 10, 2026Updated 2 months ago
- Sentiment Corpus for Swedish 🇸🇪 Norwegian 🇳🇴 Danish 🇩🇰 Finnish 🇫🇮 (and English 🏴)☆15May 3, 2021Updated 5 years ago
- ☆15Aug 15, 2021Updated 5 years ago
- Command line tools and libraries for handling and manipulating WARC files (and HTTP contents)☆177Aug 18, 2025Updated last year
- Frontend for ipfs-search.com☆25Oct 7, 2023Updated 2 years ago
- Gemini web proxy☆15Feb 20, 2025Updated last year
- Extracts plain text, language identification and more metadata from WARC records☆22Apr 16, 2026Updated 4 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Hacker news on Console with auto classifer and recommender in reactjs style code☆15Aug 29, 2019Updated 7 years ago
- Single file C header for UTF-x-to-y conversions + helpers☆13Jun 11, 2023Updated 3 years ago
- Norwegian Speech Transformer Models☆19Mar 26, 2026Updated 5 months ago
- Gopher browser☆13May 15, 2022Updated 4 years ago
- A trend viewer written in Python/JavaScript☆21Nov 15, 2024Updated last year
- Official Python package for ArchiveBox, the self-hosted internet archiving solution.☆12Oct 5, 2024Updated last year
- Code+CAD data for tempescope☆11Sep 8, 2015Updated 10 years ago
- A fast python implementation of the SimHash algorithm.☆27Oct 27, 2021Updated 4 years ago
- A C# library for loading LSD: Dream Emulator data files.☆15Aug 28, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A Gemini-to-HTTP gateway proxy for the small web☆18Oct 2, 2025Updated 11 months ago
- Sublime Text API Version Documenter☆11Jan 3, 2023Updated 3 years ago
- https://git.gir.st/minesVIiper.git - Seldomly Updated Mirror: A minesweeper clone with vi keybindings; https://gir.st/mines.htm☆13Oct 27, 2023Updated 2 years ago
- Gopher+ protocol specification☆16Feb 23, 2021Updated 5 years ago
- a static html and gemini mail archive for the 21st century, written in Rust☆29Aug 15, 2024Updated 2 years ago
- Control Philips Hue Lights with a MIDI Pad Controller☆12Aug 29, 2017Updated 9 years ago
- Home of the official apt/deb package for Ubuntu/Debian-based systems.☆17Updated this week
- 🧉🌿 A delightful tiny framework for building reliable text-based applications☆19Mar 7, 2023Updated 3 years ago
- A small package to remove the branding from plotly plots☆14Mar 18, 2018Updated 8 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Modern ANSI & ASCII Art Editor☆18Apr 6, 2025Updated last year
- Fixed Point Math in C++ for Playstation 1☆13Aug 21, 2023Updated 3 years ago
- MFT Fast Transcoder is a fast forensic tool to analyze MFT of NTFS partitions.☆13May 21, 2026Updated 3 months ago
- Examine x86-64 machine code to find suboptimal encodings and sequences of instructions☆14Aug 28, 2026Updated last week
- This repository is a ASM->CPP translation of NFSIISE☆11May 1, 2026Updated 4 months ago
- ☆52Aug 18, 2024Updated 2 years ago
- A GUI based gopher (protocol) client☆23Dec 9, 2019Updated 6 years ago