Support for writing WARC files with Scrapy
☆24Dec 21, 2019Updated 6 years ago
Alternatives and similar repositories for scrapy-warcio
Users that are interested in scrapy-warcio are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Basis for constructing a new project on top of mu.semte.ch☆16Jun 5, 2026Updated 2 months ago
- sign elf binaries with GPG☆17Oct 10, 2016Updated 9 years ago
- Python wrapper for phonetisaurus grapheme to phoneme tool☆12Mar 11, 2021Updated 5 years ago
- 🔍 Web interface for exploring document leaks with Elasticsearch☆17Jun 20, 2022Updated 4 years ago
- Streaming WARC/ARC library for fast web archive IO☆468Jun 10, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Sentiment Corpus for Swedish 🇸🇪 Norwegian 🇳🇴 Danish 🇩🇰 Finnish 🇫🇮 (and English 🏴)☆15May 3, 2021Updated 5 years ago
- ☆16Jan 17, 2022Updated 4 years ago
- Linux CLI tool to forward TCP connections from one network namespace to another network namespace☆16Feb 15, 2026Updated 6 months ago
- Command line tools and libraries for handling and manipulating WARC files (and HTTP contents)☆176Aug 18, 2025Updated last year
- Gemini web proxy☆15Feb 20, 2025Updated last year
- broad template licenses for software that allow or prohibit use for specific purposes☆23Jan 21, 2022Updated 4 years ago
- 청와대 국민청원 데이터 아카이브☆16Aug 29, 2020Updated 5 years ago
- ✨ The Open-Source WorldServer☆12Mar 4, 2026Updated 5 months ago
- VT100 animations and slowcat to play them.☆13Feb 20, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Hacker news on Console with auto classifer and recommender in reactjs style code☆15Aug 29, 2019Updated 6 years ago
- Single file C header for UTF-x-to-y conversions + helpers☆13Jun 11, 2023Updated 3 years ago
- silly game over telnet☆12May 31, 2017Updated 9 years ago
- A bulk academic PDF extractor program, designed specifically for papers about behavioral science and design.☆15Nov 24, 2025Updated 8 months ago
- Gopher browser☆13May 15, 2022Updated 4 years ago
- A trend viewer written in Python/JavaScript☆21Nov 15, 2024Updated last year
- Write PubMed search results with two display options (citation or listview) to PDF or Word☆13Oct 18, 2020Updated 5 years ago
- Official Python package for ArchiveBox, the self-hosted internet archiving solution.☆12Oct 5, 2024Updated last year
- Code+CAD data for tempescope☆11Sep 8, 2015Updated 10 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A C# library for loading LSD: Dream Emulator data files.☆15Aug 28, 2023Updated 2 years ago
- A Gemini-to-HTTP gateway proxy for the small web☆18Oct 2, 2025Updated 10 months ago
- A simple and fast port scanner.☆19May 27, 2022Updated 4 years ago
- Sublime Text API Version Documenter☆11Jan 3, 2023Updated 3 years ago
- Now you can keep track of your followers from YouTube, Instagram and Twitter accounts - Followers scraper API on AWS serverless☆19Jan 23, 2023Updated 3 years ago
- https://git.gir.st/minesVIiper.git - Seldomly Updated Mirror: A minesweeper clone with vi keybindings; https://gir.st/mines.htm☆13Oct 27, 2023Updated 2 years ago
- Guia do bixo - IME-USP☆11Feb 9, 2024Updated 2 years ago
- Home of the official apt/deb package for Ubuntu/Debian-based systems.☆17Updated this week
- 🧉🌿 A delightful tiny framework for building reliable text-based applications☆19Mar 7, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Fixed Point Math in C++ for Playstation 1☆13Aug 21, 2023Updated 2 years ago
- Examine x86-64 machine code to find suboptimal encodings and sequences of instructions☆14Aug 10, 2026Updated last week
- A GUI based gopher (protocol) client☆23Dec 9, 2019Updated 6 years ago
- Tokamak plasma operation control through multi-objective reinforcement learning in KSTAR☆27Mar 7, 2025Updated last year
- Twisted Metal reverse-engineering☆16May 19, 2022Updated 4 years ago
- Backend, IA-specific tools for crawling and processing the scholarly web. Content ends up in https://fatcat.wiki☆28Jul 31, 2024Updated 2 years ago
- Dictionnary for https://botsin.space/@lesbianBot☆12Oct 4, 2024Updated last year