Python3WebSpider/ScrapyUniversal external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

Python3WebSpider/ScrapyUniversal

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/Python3WebSpider/ScrapyUniversal)

Close

Python3WebSpider / ScrapyUniversalView on GitHubMore

• External links
• Readme badge

Scrapy Universal Spider

☆57Aug 26, 2017Updated 8 years ago

Alternatives and similar repositories for ScrapyUniversal

Users that are interested in ScrapyUniversal are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• Python3WebSpider / Images360

  View on GitHub
  Download Images From 360 Using Scrapy
  ☆44Jul 14, 2020Updated 6 years ago
• Python3WebSpider / ScrapyTutorial

  View on GitHub
  Scrapy Tutorial
  ☆50Dec 12, 2021Updated 4 years ago
• Python3WebSpider / ScrapySplashTest

  View on GitHub
  Scrapy Splash on Taobao Product
  ☆33Aug 6, 2017Updated 9 years ago
• Python3WebSpider / Weibo

  View on GitHub
  Weibo Spider Using Scrapy
  ☆138Jan 24, 2018Updated 8 years ago
• Python3WebSpider / Scrape

  View on GitHub
  Platform of Web Views to Scrape
  ☆11Jun 7, 2020Updated 6 years ago
• Proton VPN Special Offer - Get 70% off • Ad
  Special partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
• Python3WebSpider / CrackWeiboSlide

  View on GitHub
  Crack Weibo Slide Captcha
  ☆55Jul 21, 2018Updated 8 years ago
• Python3WebSpider / ScrapyPyppeteerDeprecated

  View on GitHub
  Scrapy Pyppeteer Demo
  ☆24Jul 13, 2018Updated 8 years ago
• Python3WebSpider / TaobaoProduct

  View on GitHub
  Taobao Product Spider by Selenium
  ☆201May 2, 2020Updated 6 years ago
• Python3WebSpider / ScrapySeleniumTest

  View on GitHub
  Scrapy Selenium on Taobao Product
  ☆85Aug 6, 2017Updated 9 years ago
• Slyne / SimpleCaptchaRecognition

  View on GitHub
  ☆19Jun 19, 2017Updated 9 years ago
• qiyeboy / Scrapy_Redis_Bloomfilter

  View on GitHub
  基于Redis的Bloomfilter去重，并将其扩展到Scrapy框架。
  ☆11Nov 29, 2016Updated 9 years ago
• striver-ing / distributed-spider

  View on GitHub
  通用新闻类网站分布式爬虫
  ☆79Jul 17, 2018Updated 8 years ago
• AaronJny / scrapy_redis_expiredupefilter

  View on GitHub
  scrapy-redis-expiredupefilter是基于scrapy-redis修改来的一款scrapy分布式爬虫框架，它支持为请求指纹设置生命周期，请求指纹生命周期结束后将在不影响其他指纹的情况下自动清除。
  ☆10Aug 6, 2019Updated 7 years ago
• Python3WebSpider / ScrapyPyppeteer

  View on GitHub
  Scrapy Pyppeteer Demo
  ☆12Jul 30, 2020Updated 6 years ago
• Deploy open-source AI quickly and easily - Special Bonus Offer • Ad
  Runpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
• Germey / AdslProxy

  View on GitHub
  ☆17Jul 14, 2017Updated 9 years ago
• Python3WebSpider / AdslProxy

  View on GitHub
  Adsl Proxy Pool
  ☆238Mar 31, 2023Updated 3 years ago
• saucer-man / random-useragent

  View on GitHub
  generate random user-agent
  ☆13Updated this week
• konglinghao75 / kuaishou

  View on GitHub
  爬取快手热门视频,每个视频评论,用户详情数据,用户所有个人作品
  ☆13Jun 24, 2019Updated 7 years ago
• Python3WebSpider / CrackTouClick

  View on GitHub
  Crack Touch Click
  ☆28Jul 24, 2017Updated 9 years ago
• tenlee2012 / scrapy-kafka-redis

  View on GitHub
  Distributed crawling/scraping, Kafka And Redis based components for Scrapy
  ☆46Nov 13, 2020Updated 5 years ago
• 7starsea / vnpy3

  View on GitHub
  vnpy3
  ☆20Nov 9, 2018Updated 7 years ago
• crowod / GeetestV3

  View on GitHub
  Crack Geetest V3
  ☆13Dec 12, 2019Updated 6 years ago
• xiaxichen / zh_login

  View on GitHub
  知乎登录
  ☆22Mar 18, 2019Updated 7 years ago
• 1-Click AI Models by DigitalOcean Gradient • Ad
  Deploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
• Germey / Weibo

  View on GitHub
  Weibo Spider
  ☆48Apr 29, 2017Updated 9 years ago
• RobithYusuf / mcp-camoufox

  View on GitHub
  MCP server for stealth browser automation via Camoufox — 79 tools, npx install, anti-bot stealth
  ☆18Jun 20, 2026Updated last month
• ershudai / study_spider

  View on GitHub
  my go over spider
  ☆17Jul 2, 2025Updated last year
• ftlabs / text-summarization-experiment

  View on GitHub
  Experiment on text summarization techniques and exploring Tensorflow.
  ☆15Apr 25, 2017Updated 9 years ago
• Python3WebSpider / CrackImageCaptcha

  View on GitHub
  Crack Image Code by Tesserocr
  ☆25Aug 22, 2020Updated 5 years ago
• zhuchen0310 / exspider

  View on GitHub
  Crawl cryptocurrency trading by WebSocket|基于WebSocket的数字货币行情系统
  ☆14Jul 5, 2022Updated 4 years ago
• Python3WebSpider / CrackGeetest

  View on GitHub
  Crack Geetest
  ☆157Nov 9, 2018Updated 7 years ago
• Trojain / sublime-package

  View on GitHub
  Sublime Text 3 简体中文汉化包使用方法
  ☆19Jul 30, 2021Updated 5 years ago
• 0x204 / Cloudflare-Turnstile-Solver-Extension

  View on GitHub
  The basic solver extension for people lazy who dont want click to cloudflare turnstile/captcha/checkbox
  ☆16Mar 10, 2026Updated 4 months ago
• Deploy open-source AI quickly and easily - Special Bonus Offer • Ad
  Runpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
• hankcs / hidden-markov-model

  View on GitHub
  First order HMM with Viterbi, Forward-Backward and Baum-Welch implementations
  ☆33Aug 8, 2016Updated 10 years ago
• wlkjyh / captchaocr

  View on GitHub
  基于ddddocr+flask实现的通用验证码识别接口
  ☆15Nov 5, 2022Updated 3 years ago
• dongrunhua / ScrapyUniversal

  View on GitHub
  基于Scrapy的通用爬虫框架
  ☆25Jan 9, 2019Updated 7 years ago
• imwalson / large-data-app-analysis

  View on GitHub
  大数据下的移动 APP 数据分析指南
  ☆13Jun 27, 2019Updated 7 years ago
• AlianeAmaral / curso-bootcamp-python-exercicios

  View on GitHub
  Estudos realizados com base no Bootcamp: Desenvolvedor Python da Faculdade XP Educação (IGTI) - Prof. Antônio Carlos Nazaré Júnior
  ☆13Apr 8, 2023Updated 3 years ago
• sitongye / BikeFitting

  View on GitHub
  Hobby Project aiming at create a bike fitting app with mediapipe and opencv
  ☆10May 21, 2021Updated 5 years ago
• Python3WebSpider / Weixin

  View on GitHub
  Sougou Weixin Spider Using Proxy
  ☆86May 30, 2021Updated 5 years ago