🕷️ Scrapyd is an application for deploying and running Scrapy spiders.
☆85May 4, 2026Updated 3 weeks ago
Alternatives and similar repositories for docker-scrapyd
Users that are interested in docker-scrapyd are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Page Object pattern for Scrapy☆127May 15, 2026Updated 2 weeks ago
- Command line client for Scrapyd server☆773Feb 27, 2026Updated 3 months ago
- Scrapy project boilerplate done right☆47Feb 26, 2026Updated 3 months ago
- Zyte API integration for Scrapy☆41May 14, 2026Updated 2 weeks ago
- Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…☆3,403Feb 19, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.☆1,226Nov 7, 2023Updated 2 years ago
- hello world examples of using reactive extensions (Rx) to build responsive ui in .NET on Windows☆35Feb 1, 2019Updated 7 years ago
- A simple custom Iframe state card for Home Assistant☆23May 15, 2019Updated 7 years ago
- scrapy-extras -- a collection of code samples and modules for the Scrapy framework.☆14Dec 14, 2020Updated 5 years ago
- Scrapy middleware to handle javascript pages using selenium☆20Jul 3, 2021Updated 4 years ago
- Latent Large Language Models☆19Aug 24, 2024Updated last year
- ☆10Sep 20, 2023Updated 2 years ago
- Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls☆276Feb 26, 2025Updated last year
- Scrapy Extension for monitoring spiders execution.☆558Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 🎭 Playwright integration for Scrapy☆1,408May 22, 2026Updated last week
- Simple Web UI for Scrapy spider management via Scrapyd☆50Jun 25, 2018Updated 7 years ago
- Scrapy project template. Use it to quickly spin up a new web scraping project☆16Nov 18, 2024Updated last year
- a (work-in-progress) grammatical WISYWIG text editor☆12Sep 13, 2018Updated 7 years ago
- 基金信息大全☆15Apr 6, 2025Updated last year
- Turn unstructured HTML pages into structured data. The OpenScraping library can extract information from HTML pages using a JSON config f…☆12Aug 23, 2018Updated 7 years ago
- A simple python script with zero dependencies that can be used to encrypt/decrypt secret credentials (API secret keys, HTTP passwords, et…☆15Feb 6, 2018Updated 8 years ago
- This is a collecton of CDK projects to show how to load data from streaming services into Amazon Redshift.☆13Sep 10, 2024Updated last year
- SaossionPage 简称 【骚神page】 Drissionpage 的姊妹版 Python库，内涵各种黑魔法👹☆22Jan 22, 2024Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- An open-source NLP library: fast text cleaning and preprocessing☆23Nov 9, 2021Updated 4 years ago
- A Docker Compose to Illustrate using oauth2-proxy to add JWT header and protect services served through a trafeik proxy☆12Feb 3, 2024Updated 2 years ago
- 为爬虫引用创建container，包括的模块：scrapy, mongo, celery, rabbitmq☆37Mar 22, 2016Updated 10 years ago
- ☆28Jul 22, 2014Updated 11 years ago
- ☆13Mar 21, 2024Updated 2 years ago
- simd enabled column imprints☆11Feb 12, 2018Updated 8 years ago
- docker scrapyd scrapy boot2docker crawler - a spider Python application that can be "Dockerized".☆42Apr 20, 2015Updated 11 years ago
- A service daemon to run Scrapy spiders☆3,089May 19, 2026Updated last week
- A iOS8 Template for embedding a UISplitViewController in a UITabViewController☆27Jan 26, 2016Updated 10 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆22May 10, 2026Updated 2 weeks ago
- AVPlayer module that implemented by subclass of UIView class☆11Jan 12, 2017Updated 9 years ago
- Sentence Clustering and visualization. Created Date: 25 Apr 2018☆13Jan 15, 2020Updated 6 years ago
- Secure shell command execution MCP server for Claude AI. Enables controlled shell access within specified directories.☆19Aug 19, 2025Updated 9 months ago
- Format code with uncrustify for Objective-C project easily.☆11Aug 7, 2025Updated 9 months ago
- Python 版 JustAuth，期待你的加入☆10Jun 11, 2021Updated 4 years ago
- A UIActivity subclass that share files via GCDWebServer with Twitter Bootstrap UI.☆40Feb 2, 2016Updated 10 years ago