🕷️ Scrapyd is an application for deploying and running Scrapy spiders.
☆87Aug 11, 2026Updated last week
Alternatives and similar repositories for docker-scrapyd
Users that are interested in docker-scrapyd are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Listaa raideja ja silleen☆16Nov 2, 2022Updated 3 years ago
- Docker image for Scrapy☆16Jul 24, 2023Updated 3 years ago
- Command line client for Scrapyd server☆772Feb 27, 2026Updated 5 months ago
- Scrapy project boilerplate done right☆48Feb 26, 2026Updated 5 months ago
- Scrapy exporter for Big Data formats☆16Mar 10, 2026Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Golang REST API service using Fiber framework and GORM with PostgresSQL database by applying clean architecture and dependency injection …☆16Jun 25, 2023Updated 3 years ago
- A svelte based alternative to powerpoint☆13Jul 23, 2022Updated 4 years ago
- Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…☆3,412Feb 19, 2025Updated last year
- This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.☆1,226Nov 7, 2023Updated 2 years ago
- ☆11Nov 17, 2024Updated last year
- A web application designed to match mentors and students based on a series of survey, personality-related, questions.☆10Sep 11, 2020Updated 5 years ago
- ☆12Oct 1, 2020Updated 5 years ago
- Scrapy middleware to handle javascript pages using selenium☆20Jul 3, 2021Updated 5 years ago
- Svelte World! a reusable Globe component written in Svelte!☆13Apr 12, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A package to run DuckDB queries from Apache Airflow.☆21Jun 17, 2024Updated 2 years ago
- Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls☆275Feb 26, 2025Updated last year
- ☆13Nov 25, 2023Updated 2 years ago
- Scrapy Extension for monitoring spiders execution.☆561Aug 10, 2026Updated last week
- 🕵 Given a user query this python module will returns a list of related searches you see on Google search results pages.☆11Sep 28, 2018Updated 7 years ago
- 🎭 Playwright integration for Scrapy☆1,440Jul 23, 2026Updated 3 weeks ago
- ☆34Nov 1, 2024Updated last year
- Simple Web UI for Scrapy spider management via Scrapyd☆50Jun 25, 2018Updated 8 years ago
- The 2017 Workshop of Computational Communication Research☆10Sep 23, 2017Updated 8 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- An unofficial listing of toilets rated by the Restroom Association (Singapore)☆11Jan 5, 2023Updated 3 years ago
- a (work-in-progress) grammatical WISYWIG text editor☆12Sep 13, 2018Updated 7 years ago
- A collection of pipelines for Scrapy☆16Updated this week
- A draggable, customizable, mobile-friendly menu that's simple and easy to use.☆16Dec 20, 2021Updated 4 years ago
- Proxy server for image optimization on Node.JS use (fastify, axios, sharp)☆16Feb 17, 2026Updated 6 months ago
- Research prototype for new register_template_loaders LLM plugin hook☆20Apr 7, 2025Updated last year
- 💸爬取基金信息与用户评论并用于挖掘☆12Feb 24, 2018Updated 8 years ago
- Get started setting up infrastructure as code on Google Cloud Platform☆11Jun 13, 2021Updated 5 years ago
- Quick development template for flask-socketio projects with heavy computation task☆17Dec 15, 2020Updated 5 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- 基金信息大全☆14Apr 6, 2025Updated last year
- flask+bootstrap实现的web小应用，实现了全文检索（拼写检查及纠错、倒排索引、tf-idf文档排序） 和文章浏览（文章简介、阅读原文）☆16Dec 8, 2022Updated 3 years ago
- Sample terraform code to create an EKS cluster with CNI custom networking alongside security group for pods☆14Aug 19, 2022Updated 3 years ago
- A Boilerplate for modern API's with Koa☆10Aug 24, 2017Updated 8 years ago
- 为爬虫引用创建container，包括的模块：scrapy, mongo, celery, rabbitmq☆37Mar 22, 2016Updated 10 years ago
- 财经新闻分析☆15May 4, 2018Updated 8 years ago
- Secure Databricks cluster with Data exfiltration Protection and Privatelink for Storage, KeyVault and EventHub using Bicep☆32Aug 13, 2021Updated 5 years ago