🕷️ Scrapyd is an application for deploying and running Scrapy spiders.
☆87Sep 28, 2026Updated this week
Alternatives and similar repositories for docker-scrapyd
Users that are interested in docker-scrapyd are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Page Object pattern for Scrapy☆129Sep 16, 2026Updated 2 weeks ago
- Scrapy exporter for Big Data formats☆16Aug 29, 2026Updated last month
- spider-admin-pro 一个集爬虫Scrapy+Scrapyd爬虫项目查看 和 爬虫任务定时调度的可视化管理工具，SpiderAdmin的升级版☆614Jun 15, 2026Updated 3 months ago
- Golang REST API service using Fiber framework and GORM with PostgresSQL database by applying clean architecture and dependency injection …☆16Jun 25, 2023Updated 3 years ago
- Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…☆3,412Feb 19, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.☆1,224Nov 7, 2023Updated 2 years ago
- ☆11Nov 17, 2024Updated last year
- ☆10Jun 29, 2021Updated 5 years ago
- scrapy best practice☆38Sep 30, 2020Updated 6 years ago
- Scrapy middleware to handle javascript pages using selenium☆20Jul 3, 2021Updated 5 years ago
- Scrapy project template. Use it to quickly spin up a new web scraping project☆16Nov 18, 2024Updated last year
- Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls☆275Feb 26, 2025Updated last year
- Scrapy Extension for monitoring spiders execution.☆562Sep 25, 2026Updated last week
- Node.js video proxy server example☆14Nov 25, 2018Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 🎭 Playwright integration for Scrapy☆1,453Sep 7, 2026Updated 3 weeks ago
- Powershell deployment automation library (IIS, users, permissions, scheduled tasks...). Click the following link for instructions and a l…☆31Jun 6, 2010Updated 16 years ago
- ☆34Nov 1, 2024Updated last year
- Simple Web UI for Scrapy spider management via Scrapyd☆50Jun 25, 2018Updated 8 years ago
- The 2017 Workshop of Computational Communication Research☆10Sep 23, 2017Updated 9 years ago
- a (work-in-progress) grammatical WISYWIG text editor☆12Sep 13, 2018Updated 8 years ago
- 💿 Fancy Discogs-powered collection viewer.☆14Sep 28, 2023Updated 3 years ago
- A collection of pipelines for Scrapy☆16Sep 3, 2026Updated last month
- 防溯源利器之ztor代理（自定义秒级更换IP）☆12Feb 23, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Local Development of AWS Glue with Docker and Visual Studio Code☆14Nov 29, 2021Updated 4 years ago
- wrapper for the yhat API☆16May 18, 2017Updated 9 years ago
- 基金信息大全☆15Apr 6, 2025Updated last year
- Fast bottom up trend reversal detection algorithm.☆14Oct 1, 2020Updated 6 years ago
- An open-source NLP library: fast text cleaning and preprocessing☆23Nov 9, 2021Updated 4 years ago
- Returns the next buffer/object in a stream's readable queue☆22Jan 17, 2024Updated 2 years ago
- simd enabled column imprints☆11Feb 12, 2018Updated 8 years ago
- ☆10May 4, 2020Updated 6 years ago
- docker scrapyd scrapy boot2docker crawler - a spider Python application that can be "Dockerized".☆41Apr 20, 2015Updated 11 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Scrapy schema validation pipeline and Item builder using JSON Schema☆45Mar 26, 2021Updated 5 years ago
- 深圳大学本科实验报告LaTeX模板☆18Nov 11, 2020Updated 5 years ago
- Python 版 JustAuth，期待你的加入☆10Jun 11, 2021Updated 5 years ago
- Miscellaneous utilities for using Replicache with React☆26Jun 18, 2026Updated 3 months ago
- A minimal CLI tool that gives you quick voice typing in every Mac app.☆15Aug 22, 2025Updated last year
- Helper script to automatically synchronize Bash shell history and remember it forever☆17Jul 10, 2019Updated 7 years ago
- ☆29Apr 28, 2021Updated 5 years ago