dequinns/ScrapydArt external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

dequinns/ScrapydArt

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/dequinns/ScrapydArt)

Close

dequinns / ScrapydArtView on GitHubMore

• External links
• Readme badge

在scrapyd基础上新增权限验证、爬虫运行信息统计、界面重构、，并增加排序、筛选过滤等多个API

☆112Nov 6, 2018Updated 7 years ago

Alternatives and similar repositories for ScrapydArt

Users that are interested in ScrapydArt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• duo0301 / CrawlerMonitor

  View on GitHub
  爬虫监控及可视化 ( Prometheus and Grafana ) Building a crawler with distributed task queues (Celery) and fetching data with a reliable monitor sy…
  ☆44Dec 13, 2022Updated 3 years ago
• Gerapy / Gerapy

  View on GitHub
  Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js
  ☆3,495Oct 29, 2024Updated last year
• crawlaio / scrapy-redis-sentinel

  View on GitHub
  scrapy-redis-sentinel 基于 scrapy-redis 的基础上 新增 哨兵（sentinel）连接模式 以及 集群（cluster）连接模式。
  ☆30Mar 31, 2023Updated 3 years ago
• xiaxichen / zh_login

  View on GitHub
  知乎登录
  ☆22Mar 18, 2019Updated 7 years ago
• Germey / DragCaptcha

  View on GitHub
  Drag Captcha
  ☆20May 28, 2021Updated 4 years ago
• Serverless GPU API endpoints on Runpod - Bonus Credits • Ad
  Skip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
• xiaosimao / wx_code

  View on GitHub
  公众号文章代码
  ☆62Feb 14, 2019Updated 7 years ago
• MollyMmm / anyproxy_weixin

  View on GitHub
  使用anyproxy获取wx_gzh文章
  ☆11Apr 18, 2018Updated 8 years ago
• my8100 / scrapydweb

  View on GitHub
  Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…
  ☆3,401Feb 19, 2025Updated last year
• asyncins / qsmi

  View on GitHub
  Questions in Spider Man Interview 爬虫工程师面试常见问题
  ☆11Mar 9, 2019Updated 7 years ago
• gyqlr / weibo_spider

  View on GitHub
  微博爬虫，爬去微博语料，情感分析，user-agent池，充足IP，scrapy，mongodb
  ☆16Aug 23, 2018Updated 7 years ago
• da2vin / fetchman

  View on GitHub
  fetchman is a simple crawler system/简单好用的爬虫框架
  ☆78Jul 6, 2022Updated 3 years ago
• luzihang123 / scrapyd_pyppeteer

  View on GitHub
  可以用于scrapydweb的scrapyd节点，使用pyppeteer，在scrapy中异步使用
  ☆12Dec 8, 2022Updated 3 years ago
• side-project-club / ideas

  View on GitHub
  Find good problems to solve
  ☆11Dec 22, 2021Updated 4 years ago
• mtianyan / FunpySpiderSearchEngine

  View on GitHub
  Word2vec 千人千面 个性化搜索 + Scrapy2.3.0(爬取数据) + ElasticSearch7.9.1(存储数据并提供对外Restful API) + Django3.1.1 搜索
  ☆935Feb 8, 2023Updated 3 years ago
• AI Agents on DigitalOcean Gradient AI Platform • Ad
  Build production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
• Python3WebSpider / ScrapyPyppeteerDeprecated

  View on GitHub
  Scrapy Pyppeteer Demo
  ☆24Jul 13, 2018Updated 7 years ago
• swucim / iris_tableau_python

  View on GitHub
  leverage the power of python and tableau to build real-time ML data analysis based on Iris dataset.
  ☆11Sep 26, 2017Updated 8 years ago
• mouday / SpiderAdmin

  View on GitHub
  SpiderAdmin 一个集爬虫Scrapy+Scrapyd爬虫项目查看 和 爬虫任务定时调度的可视化管理工具
  ☆96Jan 27, 2021Updated 5 years ago
• freedom-wy / reverse_android

  View on GitHub
  安卓从开发到逆向
  ☆80Oct 6, 2019Updated 6 years ago
• LightTag / CAHLM

  View on GitHub
  Computer and Humans Learn Mutually (Fast way to label text)
  ☆11Jun 5, 2018Updated 7 years ago
• yangge11 / scrapy_pro

  View on GitHub
  关于5000+站点的scrapy爬虫开发，涉及一些技术架构搭建以及各种反爬方案，详见readme文件
  ☆30Dec 8, 2022Updated 3 years ago
• genkin-he / jdpay

  View on GitHub
  A unofficial jd_pay ruby gem.
  ☆12Aug 8, 2018Updated 7 years ago
• ioiogoo / scrapy-monitor

  View on GitHub
  scrapy-monitor，实现爬虫可视化，监控实时状态
  ☆109Dec 26, 2016Updated 9 years ago
• Germey / AdslProxy

  View on GitHub
  ☆17Jul 14, 2017Updated 8 years ago
• Managed hosting for WordPress and PHP on Cloudways • Ad
  Managed hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
• greyli / coscup2019-slide

  View on GitHub
  COSCUP 2019 演讲《如何在两年内从初学者成长为流行开源项目贡献者和技术书作者》幻灯片源码
  ☆21Sep 23, 2019Updated 6 years ago
• ConnectAI-E / Feishu-OpenAI-Base-Helper

  View on GitHub
  🎒 OpenAI驱动的飞书多维表格助手
  ☆16May 28, 2023Updated 2 years ago
• Running2snail / TaoBaoAutoLogin

  View on GitHub
  ☆21Feb 17, 2019Updated 7 years ago
• chenjiandongx / async-proxy-pool

  View on GitHub
  🔅 Python3 异步爬虫代理池
  ☆373Mar 14, 2019Updated 7 years ago
• Nanrou / novel_web

  View on GitHub
  小说网站
  ☆12Jul 22, 2020Updated 5 years ago
• asyncspider / spiderexam

  View on GitHub
  爬虫工程师面试试题
  ☆149Mar 9, 2019Updated 7 years ago
• jin10086 / copyheaders

  View on GitHub
  方便的从浏览器复制浏览器头
  ☆44May 31, 2020Updated 5 years ago
• scrapy / scrapyd

  View on GitHub
  A service daemon to run Scrapy spiders
  ☆3,087Apr 8, 2026Updated last week
• LiuRoy / spider_docker

  View on GitHub
  为爬虫引用创建container，包括的模块：scrapy, mongo, celery, rabbitmq
  ☆37Mar 22, 2016Updated 10 years ago
• Wordpress hosting with auto-scaling - Free Trial • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• wenguan0927 / WechatSpider

  View on GitHub
  微信公众号爬虫：服务端公众号文章数据采集
  ☆43Dec 16, 2022Updated 3 years ago
• Karmenzind / fp-server

  View on GitHub
  Free proxy server, continuously crawling and providing proxies, based on Tornado and Scrapy. 免费代理服务器，基于Tornado和Scrapy，在本地搭建属于自己的代理池
  ☆158May 25, 2023Updated 2 years ago
• LiuXingMing / Scrapy_Redis_Bloomfilter

  View on GitHub
  基于Redis的Bloomfilter去重，并将其扩展到Scrapy框架。
  ☆346Feb 26, 2023Updated 3 years ago
• djm / python-scrapyd-api

  View on GitHub
  A Python wrapper for working with Scrapyd's API.
  ☆269Jul 31, 2024Updated last year
• dongweiming / sanic-mako

  View on GitHub
  Mako support for sanic
  ☆17Mar 19, 2022Updated 4 years ago
• rmax / scrapy-redis

  View on GitHub
  Redis-based components for Scrapy.
  ☆5,629Apr 8, 2026Updated last week
• tleen / zippity-do-dah

  View on GitHub
  Zip code to city, state translator
  ☆12May 31, 2017Updated 8 years ago