🕷️ Scrapyd is an application for deploying and running Scrapy spiders.
☆85Jun 10, 2026Updated 3 weeks ago
Alternatives and similar repositories for docker-scrapyd
Users that are interested in docker-scrapyd are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Page Object pattern for Scrapy☆127Jun 8, 2026Updated last month
- Scrapy exporter for Big Data formats☆16Mar 10, 2026Updated 3 months ago
- spider-admin-pro 一个集爬虫Scrapy+Scrapyd爬虫项目查看 和 爬虫任务定时调度的可视化管理工具，SpiderAdmin的升级版☆610Jun 15, 2026Updated 3 weeks ago
- This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.☆1,224Nov 7, 2023Updated 2 years ago
- scrapy best practice☆38Sep 30, 2020Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A simple tool for pre-labeling the image and classification☆10Jun 14, 2018Updated 8 years ago
- A package to run DuckDB queries from Apache Airflow.☆21Jun 17, 2024Updated 2 years ago
- Discussion Summarization is the process of condensing a text document which is a collection of discussion threads, using CBS (Cluster Bas…☆12Apr 10, 2014Updated 12 years ago
- Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls☆276Feb 26, 2025Updated last year
- A collection of pipelines for Scrapy☆16Apr 27, 2026Updated 2 months ago
- 🎭 Playwright integration for Scrapy☆1,425Updated this week
- ☆13Nov 25, 2023Updated 2 years ago
- A web application designed to match mentors and students based on a series of survey, personality-related, questions.☆10Sep 11, 2020Updated 5 years ago
- Local Development of AWS Glue with Docker and Visual Studio Code☆14Nov 29, 2021Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- CDH compliant Apache Phoenix☆12Jan 25, 2019Updated 7 years ago
- Stylometric framework in Python☆17Apr 9, 2015Updated 11 years ago
- 💸爬取基金信息与用户评论并用于挖掘☆12Feb 24, 2018Updated 8 years ago
- 防溯源利器之ztor代理（自定义秒级更换IP）☆13Feb 23, 2024Updated 2 years ago
- Django 6.x + Vue3 using Nginx + PostgreSQL (deploy as Docker or Kubernetes)☆20Updated this week
- Quick development template for flask-socketio projects with heavy computation task☆17Dec 15, 2020Updated 5 years ago
- 基金信息大全☆15Apr 6, 2025Updated last year
- Portable C++ implementation of BIP39☆17Apr 19, 2019Updated 7 years ago
- Cognitive Atlas☆17Aug 15, 2016Updated 9 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A simple cookiecutter template for Scrapy projects☆20Dec 14, 2022Updated 3 years ago
- An open-source NLP library: fast text cleaning and preprocessing☆23Nov 9, 2021Updated 4 years ago
- 为爬虫引用创建container，包括的模块：scrapy, mongo, celery, rabbitmq☆37Mar 22, 2016Updated 10 years ago
- The inline calendar component for Vue3☆13Jun 22, 2023Updated 3 years ago
- simd enabled column imprints☆11Feb 12, 2018Updated 8 years ago
- docker scrapyd scrapy boot2docker crawler - a spider Python application that can be "Dockerized".☆42Apr 20, 2015Updated 11 years ago
- Scrapy schema validation pipeline and Item builder using JSON Schema☆45Mar 26, 2021Updated 5 years ago
- A service daemon to run Scrapy spiders☆3,096Jun 19, 2026Updated 2 weeks ago
- 🎒 OpenAI驱动的飞书多维表格助手☆17May 28, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Python 版 JustAuth，期待你的加入☆10Jun 11, 2021Updated 5 years ago
- Python利用selenium模拟登录淘宝☆13Jul 9, 2021Updated 5 years ago
- ☆29Apr 28, 2021Updated 5 years ago
- Scala Academy☆11Jun 2, 2022Updated 4 years ago
- Demonstration of using Files in Repos with Databricks Delta Live Tables☆36Jul 9, 2024Updated 2 years ago
- Classic Tetris based on Tetris DX on Gameboy-Color, Compatible with python3.10. Thanks for https://github.com/kitao/pyxel Retro game Engi…☆10Jan 25, 2024Updated 2 years ago
- A dark mini-platform/RPG/adventure game using Pyxel engine.☆15May 27, 2024Updated 2 years ago