Python3WebSpider/ScrapyUniversal external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

Python3WebSpider/ScrapyUniversal

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/Python3WebSpider/ScrapyUniversal)

Close

Python3WebSpider / ScrapyUniversalView on GitHubMore

• External links
• Readme badge

Scrapy Universal Spider

☆56Aug 26, 2017Updated 8 years ago

Alternatives and similar repositories for ScrapyUniversal

Users that are interested in ScrapyUniversal are comparing it to the libraries listed below

• Python3WebSpider / ScrapyTutorial

  View on GitHub
  Scrapy Tutorial
  ☆50Dec 12, 2021Updated 4 years ago
• Python3WebSpider / ScrapySplashTest

  View on GitHub
  Scrapy Splash on Taobao Product
  ☆32Aug 6, 2017Updated 8 years ago
• Python3WebSpider / Scrape

  View on GitHub
  Platform of Web Views to Scrape
  ☆11Jun 7, 2020Updated 5 years ago
• Python3WebSpider / CrackWeiboSlide

  View on GitHub
  Crack Weibo Slide Captcha
  ☆55Jul 21, 2018Updated 7 years ago
• jinuljt / wechat-web-auth

  View on GitHub
  对微信网页授权获取用户信息的封装
  ☆10Jul 30, 2015Updated 10 years ago
• qiyeboy / Django-CoolBlog

  View on GitHub
  基于Django开发的个人博客系统:CoolBlog
  ☆13May 26, 2018Updated 7 years ago
• Slyne / SimpleCaptchaRecognition

  View on GitHub
  ☆19Jun 19, 2017Updated 8 years ago
• qiyeboy / Scrapy_Redis_Bloomfilter

  View on GitHub
  基于Redis的Bloomfilter去重，并将其扩展到Scrapy框架。
  ☆12Nov 29, 2016Updated 9 years ago
• FeroxTL / pynginxconfig-new

  View on GitHub
  NginX configuration files parser and generator - unstable new version
  ☆13Nov 19, 2014Updated 11 years ago
• Germey / AdslProxy

  View on GitHub
  ☆17Jul 14, 2017Updated 8 years ago
• AaronJny / scrapy_redis_expiredupefilter

  View on GitHub
  scrapy-redis-expiredupefilter是基于scrapy-redis修改来的一款scrapy分布式爬虫框架，它支持为请求指纹设置生命周期，请求指纹生命周期结束后将在不影响其他指纹的情况下自动清除。
  ☆10Aug 6, 2019Updated 6 years ago
• Python3WebSpider / ScrapyPyppeteer

  View on GitHub
  Scrapy Pyppeteer Demo
  ☆12Jul 30, 2020Updated 5 years ago
• striver-ing / distributed-spider

  View on GitHub
  通用新闻类网站分布式爬虫
  ☆79Jul 17, 2018Updated 7 years ago
• CodingCat / xgboost4j-spark-scalability

  View on GitHub
  a benchmark to test scalability of xgboost4j-spark and relevant projects
  ☆22Dec 20, 2019Updated 6 years ago
• sjtu-iiot / graphx-algorithm

  View on GitHub
  Graph algorithms implemented in GraphX and Spark styles
  ☆15Apr 26, 2015Updated 10 years ago
• saucer-man / random-useragent

  View on GitHub
  generate random user-agent
  ☆12Jan 16, 2024Updated 2 years ago
• netor0x86 / python_spider_demo

  View on GitHub
  Python JavaScript 逆向 爬虫
  ☆10Jul 6, 2024Updated last year
• Python3WebSpider / CrackTouClick

  View on GitHub
  Crack Touch Click
  ☆28Jul 24, 2017Updated 8 years ago
• u-wlkjyy / siam-autolabel

  View on GitHub
  Gemini自标注与孪生网络驱动的九宫格验证码识别
  ☆15Aug 30, 2025Updated 6 months ago
• tenlee2012 / scrapy-kafka-redis

  View on GitHub
  Distributed crawling/scraping, Kafka And Redis based components for Scrapy
  ☆46Nov 13, 2020Updated 5 years ago
• 7starsea / vnpy3

  View on GitHub
  vnpy3
  ☆20Nov 9, 2018Updated 7 years ago
• Hector101 / vue2-brace-editor

  View on GitHub
  ☆14Oct 20, 2018Updated 7 years ago
• Germey / CrackCaptcha

  View on GitHub
  Crack Captcha Using TensorFlow
  ☆72Feb 21, 2018Updated 8 years ago
• crowod / GeetestV3

  View on GitHub
  Crack Geetest V3
  ☆12Dec 12, 2019Updated 6 years ago
• WSOL12 / Pumpfun-Sniper-Bot

  View on GitHub
  A fast and automated Solana PumpFun sniper bot that detects new token launches, monitors market conditions, and executes buy/sell trades …
  ☆16Feb 14, 2026Updated last month
• khpeek / scraper-compose

  View on GitHub
  Scrapy example project using Tor (through Privoxy) in a Docker Compose multi-container application
  ☆11Oct 28, 2017Updated 8 years ago
• Germey / Weibo

  View on GitHub
  Weibo Spider
  ☆48Apr 29, 2017Updated 8 years ago
• ershudai / study_spider

  View on GitHub
  my go over spider
  ☆17Jul 2, 2025Updated 8 months ago
• Python3WebSpider / CrackImageCaptcha

  View on GitHub
  Crack Image Code by Tesserocr
  ☆25Aug 22, 2020Updated 5 years ago
• wlkjyh / captchaocr

  View on GitHub
  基于ddddocr+flask实现的通用验证码识别接口
  ☆15Nov 5, 2022Updated 3 years ago
• RimoChan / rimo_storage

  View on GitHub
  莉沫酱存储！
  ☆11Dec 21, 2024Updated last year
• Python3WebSpider / CrackGeetest

  View on GitHub
  Crack Geetest
  ☆157Nov 9, 2018Updated 7 years ago
• ishiko732 / WordSearch

  View on GitHub
  对词典进行解析单词的含义,提供Anki的Fast Words Query插件词库
  ☆12Apr 1, 2021Updated 4 years ago
• TechVerse-Academy / Stanford-CS-Learning-Path

  View on GitHub
  Stanford Computer Science Curriculum in 2021
  ☆11Jun 21, 2021Updated 4 years ago
• Kirk-Wang / Hello-Gopher

  View on GitHub
  Go Programming Language 扫盲
  ☆12Sep 7, 2020Updated 5 years ago
• CurrencyCloud / currencycloud-python

  View on GitHub
  ☆12Jan 15, 2026Updated 2 months ago
• Martchus / nginx-accesskey

  View on GitHub
  Accesskey module for NGINX 1.12.0, initially written by Mykola Grechukh
  ☆24Apr 22, 2018Updated 7 years ago
• 13Blog / springboot-thymeleaf

  View on GitHub
  Springboot与Thymeleaf模板引擎整合
  ☆13Sep 27, 2017Updated 8 years ago
• jiang227947 / ziyi-project

  View on GitHub
  Node+Angular+Ts项目，包含第三方登录、仿Discord聊天室（暂停维护）、天气等Demo。NodeJs+Angular project with examples for chat rooms, weather, and more
  ☆11Jun 18, 2024Updated last year