my8100/scrapyd-cluster-on-heroku external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

my8100/scrapyd-cluster-on-heroku

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/my8100/scrapyd-cluster-on-heroku)

Close

my8100 / scrapyd-cluster-on-herokuView on GitHubMore

• External links
• Readme badge

Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO

☆123Apr 4, 2020Updated 6 years ago

Alternatives and similar repositories for scrapyd-cluster-on-heroku

Users that are interested in scrapyd-cluster-on-heroku are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• my8100 / scrapydweb

  View on GitHub
  Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…
  ☆3,411Feb 19, 2025Updated last year
• dmclain / scrapy-heroku

  View on GitHub
  ☆67Sep 7, 2018Updated 8 years ago
• my8100 / files

  View on GitHub
  Docs and files for ScrapydWeb, Scrapyd, Scrapy, and other projects
  ☆420Mar 1, 2025Updated last year
• SomeBottle / BBlock

  View on GitHub
  🎵 Wow~you can really play! Square Music Player
  ☆11Updated this week
• hizdm / auto_comment

  View on GitHub
  开源博客评论灌水机器人....
  ☆11Nov 8, 2017Updated 8 years ago
• Managed hosting for WordPress and PHP on Cloudways • Ad
  Managed hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
• lss233 / 100bits

  View on GitHub
  A online multi-player draw board.
  ☆10Jan 4, 2023Updated 3 years ago
• Python3WebSpider / ScrapyPyppeteerDeprecated

  View on GitHub
  Scrapy Pyppeteer Demo
  ☆24Jul 13, 2018Updated 8 years ago
• jwlyn / jscrapy

  View on GitHub
  The world's leading data crawler platform!
  ☆15Nov 22, 2018Updated 7 years ago
• Howard-Song / txtToAudio

  View on GitHub
  Txt transfer to mp3,use baidu-api-sdk with nestjs
  ☆13Aug 1, 2018Updated 8 years ago
• scrapy-plugins / scrapy-pagestorage

  View on GitHub
  A scrapy extension to store requests and responses information in storage service
  ☆27Mar 11, 2022Updated 4 years ago
• pangxiaobin / proxy_ip_pool

  View on GitHub
  python编写的爬虫代理ip池
  ☆18Jun 21, 2019Updated 7 years ago
• istresearch / scrapy-cluster

  View on GitHub
  This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
  ☆1,222Nov 7, 2023Updated 2 years ago
• inmyfree / readability

  View on GitHub
  readability
  ☆24Jan 20, 2014Updated 12 years ago
• xrr2016 / top-videos

  View on GitHub
  ☆19Mar 24, 2019Updated 7 years ago
• Managed Kubernetes at scale on DigitalOcean • Ad
  DigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
• scrapinghub / spidermon

  View on GitHub
  Scrapy Extension for monitoring spiders execution.
  ☆562Sep 25, 2026Updated 2 weeks ago
• demoyhui / Spider

  View on GitHub
  Spider项目将会不断更新本人学习使用过的爬虫方法！！！
  ☆15Aug 27, 2017Updated 9 years ago
• scrapy / scrapyd-client

  View on GitHub
  Command line client for Scrapyd server
  ☆770Feb 27, 2026Updated 7 months ago
• Gerapy / Gerapy

  View on GitHub
  Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js
  ☆3,514Jul 4, 2026Updated 3 months ago
• Tiago-Lira / scrapyd-mongodb

  View on GitHub
  Library designed to replace the SQLite backend by a MongoDB backend on Scrapy queue management
  ☆17Sep 2, 2017Updated 9 years ago
• amio / docdock

  View on GitHub
  App launcher for devdocs.io.
  ☆11Mar 2, 2017Updated 9 years ago
• scrapy-plugins / scrapy-deltafetch

  View on GitHub
  Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls
  ☆275Feb 26, 2025Updated last year
• scrapinghub / scrapyrt

  View on GitHub
  HTTP API for Scrapy spiders
  ☆884Jun 29, 2026Updated 3 months ago
• scrapinghub / scmongo

  View on GitHub
  MongoDB extensions for Scrapy
  ☆44Oct 2, 2014Updated 12 years ago
• Bare Metal GPUs on DigitalOcean Gradient AI • Ad
  Purpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
• xayoung / react-native-design-captures

  View on GitHub
  ☆16Nov 20, 2016Updated 9 years ago
• scrapy / scrapyd

  View on GitHub
  A service daemon to run Scrapy spiders
  ☆3,098Oct 6, 2026Updated last week
• myml / webssh

  View on GitHub
  websocket to ssh
  ☆11May 14, 2019Updated 7 years ago
• cnbeining / bilibili-grab-silver

  View on GitHub
  Auto grab Bilibili's live silver
  ☆10Dec 8, 2015Updated 10 years ago
• gtbotsonar / analyse-plugin-lua

  View on GitHub
  bot analyze openresty plugins
  ☆12May 8, 2019Updated 7 years ago
• yeatesss / jingdong-league

  View on GitHub
  京东联盟
  ☆10Nov 3, 2020Updated 5 years ago
• mayankrastogi / cloud-simulation

  View on GitHub
  Simulation and analysis of cloud computing architectures and algorithms using CloudSim Plus
  ☆12Sep 9, 2019Updated 7 years ago
• zuobangbang / text-decoding

  View on GitHub
  use python to decode text
  ☆11Jun 17, 2019Updated 7 years ago
• TeddyNight / zhongxin_downloader

  View on GitHub
  爬虫
  ☆13Feb 7, 2020Updated 6 years ago
• Deploy on Railway without the complexity - Free Credits Offer • Ad
  Connect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
• zgq354 / esotalk-for-sae

  View on GitHub
  A branch of esotalk can run on SinaAppEngine.
  ☆14Dec 31, 2015Updated 10 years ago
• isakuraOo / blockchain-for-php

  View on GitHub
  基于 PHP 的区块链实现
  ☆10Mar 11, 2021Updated 5 years ago
• xunuoi / Eve

  View on GitHub
  Chat Robot .聊天机器人Eve - 部分代码
  ☆15Apr 30, 2020Updated 6 years ago
• jeremy-ww / avi

  View on GitHub
  The easiest way to upload images, Compatible with numerous cloud storage.
  ☆13Aug 10, 2018Updated 8 years ago
• xakep666 / asciinema-player

  View on GitHub
  A simple player for asciinema v2 (https://github.com/asciinema/asciinema) casts
  ☆20Nov 2, 2023Updated 2 years ago
• vladimir-ionita / bulk-email-forwarding

  View on GitHub
  📧 Python script to forward emails using Gmail.
  ☆11Apr 4, 2023Updated 3 years ago
• Python3WebSpider / CodeServer

  View on GitHub
  Code Server
  ☆12Jun 28, 2021Updated 5 years ago