🕷️ Scrapyd is an application for deploying and running Scrapy spiders.
☆85Jan 22, 2026Updated 2 months ago
Alternatives and similar repositories for docker-scrapyd
Users that are interested in docker-scrapyd are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Page Object pattern for Scrapy☆128Mar 15, 2026Updated 2 weeks ago
- Command line client for Scrapyd server☆777Feb 27, 2026Updated last month
- Listaa raideja ja silleen☆16Nov 2, 2022Updated 3 years ago
- Scrapy exporter for Big Data formats☆16Mar 10, 2026Updated 2 weeks ago
- Scrapy project boilerplate done right☆48Feb 26, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Building an API with the FastAPI framework to serve a scikit-learn model.☆18Jan 13, 2019Updated 7 years ago
- spider-admin-pro 一个集爬虫Scrapy+Scrapyd爬虫项目查看 和 爬虫任务定时调度的可视化管理工具，SpiderAdmin的升级版☆613Nov 10, 2024Updated last year
- Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…☆3,406Feb 19, 2025Updated last year
- ☆10Jun 29, 2021Updated 4 years ago
- This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.☆1,230Nov 7, 2023Updated 2 years ago
- scrapy-extras -- a collection of code samples and modules for the Scrapy framework.☆14Dec 14, 2020Updated 5 years ago
- Scrapy middleware to handle javascript pages using selenium☆20Jul 3, 2021Updated 4 years ago
- A website showing several companies' stocks and their market sentiments using Yahooquery and Marketaux API.☆13Jan 18, 2024Updated 2 years ago
- Svelte World! a reusable Globe component written in Svelte!☆14Apr 12, 2023Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Discussion Summarization is the process of condensing a text document which is a collection of discussion threads, using CBS (Cluster Bas…☆12Apr 10, 2014Updated 11 years ago
- Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls☆275Feb 26, 2025Updated last year
- A collection of pipelines for Scrapy☆16Mar 13, 2026Updated 2 weeks ago
- 🎭 Playwright integration for Scrapy☆1,381Jan 21, 2026Updated 2 months ago
- Simple Web UI for Scrapy spider management via Scrapyd☆50Jun 25, 2018Updated 7 years ago
- A web application designed to match mentors and students based on a series of survey, personality-related, questions.☆10Sep 11, 2020Updated 5 years ago
- Local Development of AWS Glue with Docker and Visual Studio Code☆14Nov 29, 2021Updated 4 years ago
- An R package for reading from and writing to a PostgreSQL database☆15Sep 5, 2019Updated 6 years ago
- wrapper for the yhat API☆16May 18, 2017Updated 8 years ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- Secure shell command execution MCP server for Claude AI. Enables controlled shell access within specified directories.☆17Aug 19, 2025Updated 7 months ago
- 防溯源利器之ztor代理（自定义秒级更换IP）☆13Feb 23, 2024Updated 2 years ago
- 💸爬取基金信息与用户评论并用于挖掘☆12Feb 24, 2018Updated 8 years ago
- Quick development template for flask-socketio projects with heavy computation task☆17Dec 15, 2020Updated 5 years ago
- 基金信息大全☆15Apr 6, 2025Updated 11 months ago
- Summarize your PRs with the power of GPT-3☆16Mar 3, 2023Updated 3 years ago
- A simple python script with zero dependencies that can be used to encrypt/decrypt secret credentials (API secret keys, HTTP passwords, et…☆15Feb 6, 2018Updated 8 years ago
- This is a collecton of CDK projects to show how to load data from streaming services into Amazon Redshift.☆13Sep 10, 2024Updated last year
- A Docker Compose to Illustrate using oauth2-proxy to add JWT header and protect services served through a trafeik proxy☆12Feb 3, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Web scraping Page Objects core library☆105Mar 10, 2026Updated 2 weeks ago
- The inline calendar component for Vue3☆14Jun 22, 2023Updated 2 years ago
- Neoconf plugin to automatically set project's virtual-environment python runtime.☆15Aug 2, 2023Updated 2 years ago
- 财经新闻分析☆15May 4, 2018Updated 7 years ago
- flask+bootstrap实现的web小应用，实现了全文检索（拼写检查及纠错、倒排索引、tf-idf文档排序） 和文章浏览（文章简介、阅读原文）☆16Dec 8, 2022Updated 3 years ago
- System of polynomial equations solver with quantum annealing☆13Oct 22, 2019Updated 6 years ago
- A service daemon to run Scrapy spiders☆3,088Mar 19, 2026Updated last week