cuanboy/ScrapyProject external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

cuanboy/ScrapyProject

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/cuanboy/ScrapyProject)

Close

cuanboy / ScrapyProjectView on GitHubMore

• External links
• Readme badge

开始Scrapy实战如：存数据库、下载文件、爬京东、淘宝、Anti-Anti-Spider……

☆424Apr 22, 2018Updated 7 years ago

Alternatives and similar repositories for ScrapyProject

Users that are interested in ScrapyProject are comparing it to the libraries listed below

• cuanboy / scrapyTest

  View on GitHub
  SCRAPY爬虫实验，主要是一些简单的栗子，让你快速了解scrapy玩法！
  ☆135Jan 21, 2018Updated 8 years ago
• baabaaox / ScrapyDouban

  View on GitHub
  豆瓣电影/豆瓣读书 Scarpy 爬虫
  ☆785Dec 4, 2023Updated 2 years ago
• geekan / scrapy-examples

  View on GitHub
  Multifarious Scrapy examples. Spiders for alexa / amazon / douban / douyu / github / linkedin etc.
  ☆3,266Nov 3, 2023Updated 2 years ago
• lb2281075105 / Python-Spider

  View on GitHub
  豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github…
  ☆782Aug 27, 2022Updated 3 years ago
• tmliang / Taobao_Spider

  View on GitHub
  基于Scrapy的Python3分布式淘宝爬虫
  ☆192Mar 11, 2021Updated 4 years ago
• taizilongxu / scrapy_jingdong

  View on GitHub
  用scrapy写的京东爬虫
  ☆452Dec 5, 2014Updated 11 years ago
• lihansunbai / Fang_Scrapy

  View on GitHub
  这是一个作者毕业设计的爬虫，爬取58同城、赶集网、链家、安居客、我爱我家网站的房价交易数据。
  ☆329May 4, 2016Updated 9 years ago
• abcdlzy / webshell-manager

  View on GitHub
  ☆27Aug 19, 2015Updated 10 years ago
• LiuXingMing / SinaSpider

  View on GitHub
  新浪微博爬虫（Scrapy、Redis）
  ☆3,280Sep 5, 2018Updated 7 years ago
• Yonatan-D / OnlineSurvey

  View on GitHub
  📊 基于 Vue + Spring Boot 的在线问卷调查网站 (2020毕设)
  ☆12Jul 4, 2023Updated 2 years ago
• kong36088 / ZhihuSpider

  View on GitHub
  多线程知乎用户爬虫，基于python3
  ☆249May 29, 2023Updated 2 years ago
• Jack-Cherish / python-spider

  View on GitHub
  Python3网络爬虫实战：淘宝、京东、网易云、B站、12306、抖音、笔趣阁、漫画小说下载、音乐电影下载等
  ☆19,514Aug 19, 2024Updated last year
• my8100 / scrapydweb

  View on GitHub
  Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…
  ☆3,401Feb 19, 2025Updated last year
• goldfishh / JD-simulator

  View on GitHub
  模拟京东商城的两种登录请求、查询商品信息、修改购物车以及订单页面信息、提交订单、获取优惠券等服务
  ☆24Dec 16, 2018Updated 7 years ago
• marchtea / scrapy_doc_chs

  View on GitHub
  scrapy中文翻译文档
  ☆1,107Sep 12, 2019Updated 6 years ago
• rmax / scrapy-redis

  View on GitHub
  Redis-based components for Scrapy.
  ☆5,643Jul 6, 2024Updated last year
• yidao620c / core-scrapy

  View on GitHub
  python-scrapy demo
  ☆810Oct 1, 2020Updated 5 years ago
• lining0806 / PythonSpiderNotes

  View on GitHub
  Python入门网络爬虫之精华版
  ☆7,384Jun 21, 2021Updated 4 years ago
• huyongli / FlutterGank

  View on GitHub
  使用Flutter实现一个简单的Gank客户端
  ☆11Nov 2, 2018Updated 7 years ago
• ktjack2009 / jd_collect

  View on GitHub
  京东m站登录采集
  ☆10Oct 22, 2018Updated 7 years ago
• wkunzhi / Python3-Spider

  View on GitHub
  Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️
  ☆3,317Nov 3, 2023Updated 2 years ago
• zhangslob / Taobao_duoshou

  View on GitHub
  使用Scrapy采集淘宝数据，Flask展示
  ☆67Feb 24, 2018Updated 8 years ago
• DotNetAge / scrapy_plus

  View on GitHub
  scrapy 常用爬网必备工具包
  ☆25Feb 8, 2023Updated 3 years ago
• wqh0109663 / JobSpiders

  View on GitHub
  scrapy框架爬取51job(scrapy.Spider)，智联招聘(扒接口)，拉勾网(CrawlSpider)
  ☆200Aug 14, 2023Updated 2 years ago
• LUCY78765580 / Python-web-scraping

  View on GitHub
  python爬虫，包含大小项目
  ☆803Oct 24, 2019Updated 6 years ago
• kanghua309 / easytrader

  View on GitHub
  提供券银河/银河客户端/广发/湘财证券/雪球的基金、股票自动程序化交易以及自动打新，支持跟踪 joinquant /ricequant 模拟交易 和 实盘雪球组合, 量化交易组件
  ☆12Sep 14, 2017Updated 8 years ago
• justjavac / zh-django-best-practices

  View on GitHub
  Django 最佳实践 - 中文版
  ☆14Jun 19, 2013Updated 12 years ago
• ccmldl / pyJianYingPro

  View on GitHub
  轻量、灵活、易上手的Python剪映草稿生成及导出工具，构建全自动化视频剪辑/混剪流水线
  ☆17May 10, 2025Updated 9 months ago
• Kr1s77 / awesome-python-login-model

  View on GitHub
  😮python模拟登陆一些大型网站，还有一些简单的爬虫，希望对你们有所帮助❤️，如果喜欢记得给个star哦🌟
  ☆16,238Jul 26, 2022Updated 3 years ago
• yeafee / Android-Smooth-Emulator-for-Develop

  View on GitHub
  Introduce some smooth and free android emulator for develop. （开发神器 — 一些免费流畅的Android模拟器）
  ☆14Apr 30, 2015Updated 10 years ago
• AntonotnaWang / imagenet_and_pytorch_pretrained_model_id_mapping

  View on GitHub
  Showing the relationship between ImageNet ID and labels and pytorch pre-trained model output ID and labels
  ☆10Oct 11, 2020Updated 5 years ago
• Jacobbishopxy / cyberbrick

  View on GitHub
  BI frontend
  ☆12Jan 15, 2022Updated 4 years ago
• Kr1s77 / Python-crawler-tutorial-starts-from-zero

  View on GitHub
  python爬虫教程，带你从零到一，包含js逆向，selenium, tesseract OCR识别,mongodb的使用，以及scrapy框架
  ☆4,572Dec 2, 2020Updated 5 years ago
• luyishisi / Anti-Anti-Spider

  View on GitHub
  越来越多的网站具有反爬虫特性，有的用图片隐藏关键数据，有的使用反人类的验证码，建立反反爬虫的代码仓库，通过与不同特性的网站做斗争（无恶意）提高技术。（欢迎提交难以采集的网站）（因工作原因，项目暂停）
  ☆7,311Oct 17, 2021Updated 4 years ago
• pujinxiao / TaoBao

  View on GitHub
  scrapy淘宝天猫实战
  ☆27Mar 28, 2017Updated 8 years ago
• manashmandal / NewsCrawler

  View on GitHub
  News crawler
  ☆11Nov 22, 2022Updated 3 years ago
• chenjiandongx / bili-spider

  View on GitHub
  📺 B 站全站视频信息爬虫
  ☆681Feb 17, 2019Updated 7 years ago
• 15920036578 / Suning_Spider

  View on GitHub
  苏宁爬虫（大量注释，对刚入门爬虫者极度友好）
  ☆12Apr 7, 2019Updated 6 years ago
• chyroc / WechatSogou

  View on GitHub
  基于搜狗微信搜索的微信公众号爬虫接口
  ☆6,183Nov 15, 2023Updated 2 years ago