A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.
☆61May 10, 2026Updated 5 months ago
Alternatives and similar repositories for scrapy-distributed
Users that are interested in scrapy-distributed are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Type-safe CLI argument parser☆11Jul 29, 2024Updated 2 years ago
- ☆24Oct 8, 2026Updated last week
- Implement scrapy with asyncio☆71Jul 23, 2026Updated 2 months ago
- pip install realtime_web_logs 文件日志实时显示到web页面。附带全系统硬盘的文件浏览下载功能。支持日志显示自动滚动和暂停。☆13Jul 1, 2020Updated 6 years ago
- js_rpc通杀版本☆14Oct 9, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Script for setting up ADB for debugging over wifi☆13Aug 12, 2019Updated 7 years ago
- Signal processing features based on xtensor☆12Nov 25, 2023Updated 2 years ago
- ☆10Jun 29, 2021Updated 5 years ago
- geohash implementation in C++☆18Jul 4, 2023Updated 3 years ago
- Fast optimizing Brainfuck interpreter in pure python☆14Nov 8, 2025Updated 11 months ago
- Property Based Testing in C++ using RapidCheck☆12Nov 8, 2017Updated 8 years ago
- An abstraction on top of purescript-signal, for avoiding Channels☆15Apr 11, 2017Updated 9 years ago
- ☆12Feb 5, 2026Updated 8 months ago
- fecshop elasticsearch 功能部分扩展，用于将分类，产品，搜索页面，底层使用elasticSearch支持☆15Feb 9, 2018Updated 8 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Optimizing Brainfuck interpreter☆12Dec 30, 2020Updated 5 years ago
- Interactive Web Plotting with Bokeh in IPython notebook☆34Feb 25, 2018Updated 8 years ago
- coolq's python client☆12Mar 4, 2019Updated 7 years ago
- 基于Redis的Bloomfilter去重，并将其扩展到Scrapy框架。☆345Feb 26, 2023Updated 3 years ago
- This repository contains the reference genome assembly Ash1, built from data collected from an Ashkenazi individual.☆12Feb 2, 2022Updated 4 years ago
- dynamic recompilation and loading of code. A replacement for the old plugins library but now based around the GHC API.☆16Jul 30, 2017Updated 9 years ago
- A cross-platform GUI implementation of FiloSottile's "age"☆16May 16, 2022Updated 4 years ago
- ☆13Aug 29, 2022Updated 4 years ago
- A collection of pipelines for Scrapy☆16Oct 7, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This package includes Artisan Commands to create directory structure.☆10Mar 26, 2022Updated 4 years ago
- Demo of phantom types in Scala☆12Feb 25, 2016Updated 10 years ago
- Research prototype for new register_template_loaders LLM plugin hook☆20Apr 7, 2025Updated last year
- Универсальный парсер деклараций в формат для передачи в Декларатор.☆18Nov 2, 2024Updated last year
- Generate Chinese name according to statistic model.☆13Sep 4, 2015Updated 11 years ago
- 二维码命令行工具--将二维码输出到终端而不是图片文件☆12Aug 3, 2016Updated 10 years ago
- Haskell bindings to Xen hypervisor interface☆17Jul 31, 2015Updated 11 years ago
- Library for invertible parsing and printing☆34Aug 25, 2025Updated last year
- Auto Extractor Module☆337Aug 19, 2024Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Kubernetes KMS provider plugin, backed by Tencent Cloud KMS service☆17Jul 25, 2024Updated 2 years ago
- 基于puppeteer和NodeJS的服务端渲染，提供Docker一键部署及API调用接口。☆19Aug 30, 2022Updated 4 years ago
- Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js☆3,515Jul 4, 2026Updated 3 months ago
- 易盾图标识别，包含定位以及点选顺序的识别，定位 pytorch 模型大小只有3M，执行速度极快。内附代码和测试用例，直接使用即可测试。定位准确率 95% 以上，识别用的sift算法，测试通过率大概 50%。☆34Jun 2, 2020Updated 6 years ago
- A C++17 library for declarative flow control☆19Jun 26, 2023Updated 3 years ago
- ☆24Dec 21, 2025Updated 9 months ago
- Adds Flyway as an build step in Jenkins☆15Oct 5, 2026Updated last week