A1014280203/Ugly-Distributed-Crawler external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

A1014280203/Ugly-Distributed-Crawler

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/A1014280203/Ugly-Distributed-Crawler)

Close

A1014280203 / Ugly-Distributed-CrawlerView on GitHubMore

• External links
• Readme badge

基于Redis实现的简单到爆的分布式爬虫

☆44Jul 31, 2017Updated 8 years ago

Alternatives and similar repositories for Ugly-Distributed-Crawler

Users that are interested in Ugly-Distributed-Crawler are comparing it to the libraries listed below

• codelint / testful

  View on GitHub
  nodejs test framework for restful(http) service
  ☆18Mar 21, 2022Updated 3 years ago
• RedQA / stf-selector

  View on GitHub
  stf rest api python wrapper with complex devices filter support
  ☆17Dec 29, 2016Updated 9 years ago
• J-F-Liu / toolbox

  View on GitHub
  GitBook - Programmer's Toolbox
  ☆11Feb 5, 2026Updated last month
• limboinf / flask-timing

  View on GitHub
  Timing job with flask, redis, beanstalkd
  ☆15Dec 16, 2015Updated 10 years ago
• raptorz / gcrawler

  View on GitHub
  A lightweight crawler framework using gevent.
  ☆11Sep 9, 2015Updated 10 years ago
• kenshinx / second-spider

  View on GitHub
  one more spider based on gevent requests pyquery
  ☆53Sep 14, 2014Updated 11 years ago
• baozhida / uiauto

  View on GitHub
  在docker搭建selenium grid集群环境（chrome+firefox）前提下，结合TestNG+ANT进行UI自动化测试。可使用jenkins持续集成。
  ☆13May 19, 2017Updated 8 years ago
• hellozhangran / happy-egg-server

  View on GitHub
  《重学Node.js》系列教程的辅助项目，学习、Demo、实践~
  ☆16Dec 7, 2022Updated 3 years ago
• songchengzhuang / MoviesWeb_plus

  View on GitHub
  电影网站、电影、Express(node)+Mongodb、升级版 简洁版请看Movies_web
  ☆17Jun 2, 2018Updated 7 years ago
• piglei / zkpython_example

  View on GitHub
  A simple example using zkpython
  ☆27Oct 29, 2013Updated 12 years ago
• rtfghd / AppTask

  View on GitHub
  技术服务生活 - 日常APP任务自动化
  ☆25May 22, 2018Updated 7 years ago
• hrosenhorn / gevent-memcache

  View on GitHub
  A port of memcache from the concurrence framework to gevent
  ☆38Sep 14, 2012Updated 13 years ago
• zhio / knn_font

  View on GitHub
  使用KNN做猫眼字体文件识别
  ☆26Oct 21, 2020Updated 5 years ago
• xzh0723 / Taobao

  View on GitHub
  破解淘宝h5页面的sign参数， 新增淘宝pyppeteer登录， 有效绕过自动化工具检测。
  ☆56Jun 7, 2019Updated 6 years ago
• utensil / behind-programming

  View on GitHub
  A book to gather and distill principles, patterns and templates behind programming.
  ☆23Feb 20, 2019Updated 7 years ago
• ShichaoMa / structure_spider

  View on GitHub
  组合多请求，抓取结构化数据，基于scrapy组件
  ☆29Dec 8, 2022Updated 3 years ago
• yangyangwithgnu / illustration_HTTP

  View on GitHub
  一本 HTTP 的漫画：《图解 HTTP》
  ☆30Oct 1, 2016Updated 9 years ago
• dragonflylxp / crawler

  View on GitHub
  python爬虫项目集合
  ☆28Jan 30, 2020Updated 6 years ago
• onetwo1 / du-app

  View on GitHub
  毒 app sign 签名 js 解密的 python 复写版本
  ☆27Sep 8, 2019Updated 6 years ago
• zrools / spider

  View on GitHub
  ☆112May 21, 2016Updated 9 years ago
• qcl643062 / spider

  View on GitHub
  ☆30Jul 25, 2016Updated 9 years ago
• darkhandz / XPS15-9550-BigSur

  View on GitHub
  DELL XPS15 9550 11.0 黑苹果 配置
  ☆10Dec 11, 2020Updated 5 years ago
• netxfly / dianying

  View on GitHub
  中国主流在线电影网站爬虫及搜索web代码
  ☆35Jun 9, 2014Updated 11 years ago
• h01 / ProxyScanner

  View on GitHub
  python HTTP代理扫描
  ☆125Nov 27, 2014Updated 11 years ago
• UaHaLiubolun / MusicSpider

  View on GitHub
  网易云音乐爬虫
  ☆10Apr 12, 2017Updated 8 years ago
• adamkramer / reg_export

  View on GitHub
  ☆12Dec 14, 2016Updated 9 years ago
• Estrella-Explore / YangJY-AcadMisconduct

  View on GitHub
  🚀 WHU 杨景媛学术不端事件的详细信息 | 🚀 WHU 楊景媛學術不端事件的詳細資料 | 🚀 Detailed Information on the WHU Yang Jingyuan Academic Misconduct Case
  ☆17Feb 28, 2026Updated last week
• shariqmalik / AdminGrabber

  View on GitHub
  ☆15Nov 23, 2022Updated 3 years ago
• scott0107000 / Tomato-Emoji

  View on GitHub
  托碼頭點陣字體表情包／托码头点阵字体表情包／Tomato Pixel Emoji
  ☆12Nov 19, 2025Updated 3 months ago
• Y-Matin / NewsSpider

  View on GitHub
  毕设：使用PYQT5 和 scrapy框架 结合readability正文提取算法，再用pyinstaller打包. 开发一个通用的爬虫系统
  ☆10Apr 5, 2020Updated 5 years ago
• axel10 / react-slide-animation-router

  View on GitHub
  The react router slides around the animation.Based on react-router 4 and react-transition-group
  ☆12Apr 25, 2019Updated 6 years ago
• jessetalk / k8s-course-samples

  View on GitHub
  ☆11Feb 3, 2020Updated 6 years ago
• laeciofreitas / design-patterns-lua

  View on GitHub
  Exemplo de alguns design patterns implementados com a linguagem Lua.
  ☆12Dec 30, 2010Updated 15 years ago
• Tr3jer / AutoHookSpider

  View on GitHub
  将自动爬虫的结果判断是否属于hooks，并不断抓取url爬啊爬。
  ☆30Jun 2, 2017Updated 8 years ago
• owncloud-archive / videos

  View on GitHub
  A simple videos app
  ☆10Jul 9, 2015Updated 10 years ago
• erwanjegouzo / Press2Flash

  View on GitHub
  Press2Flash is an AS3 based framework created to add Rich Media capabilities to your WordPress-powered website. Press2Flash also provide…
  ☆18Apr 19, 2014Updated 11 years ago
• LoveCppp / Http-Proxy-Scan

  View on GitHub
  Use Censys.io Scan Http Proxy
  ☆72Aug 28, 2017Updated 8 years ago
• qingyu1229 / XSExtractor

  View on GitHub
  提取新闻、博客等长文本网页的正文工具
  ☆42Feb 18, 2016Updated 10 years ago
• LiuXingMing / Scrapy_Redis_Bloomfilter

  View on GitHub
  基于Redis的Bloomfilter去重，并将其扩展到Scrapy框架。
  ☆346Feb 26, 2023Updated 3 years ago