LUCY78765580/Python-web-scraping external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

LUCY78765580/Python-web-scraping

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/LUCY78765580/Python-web-scraping)

Close

LUCY78765580 / Python-web-scrapingView on GitHubMore

• External links
• Readme badge

python爬虫，包含大小项目

☆803Oct 24, 2019Updated 6 years ago

Alternatives and similar repositories for Python-web-scraping

Users that are interested in Python-web-scraping are comparing it to the libraries listed below

• yhangf / PythonCrawler

  View on GitHub
  用python编写的爬虫项目集合
  ☆1,761Apr 17, 2025Updated 10 months ago
• secondtonone1 / python-

  View on GitHub
  python自学项目
  ☆249Oct 30, 2022Updated 3 years ago
• MrLevo520 / Mini-Python-Project

  View on GitHub
  用Python做些有趣的项目
  ☆1,047Mar 1, 2019Updated 7 years ago
• NGUWQ / Python3Spider

  View on GitHub
  爬虫项目
  ☆70Oct 14, 2018Updated 7 years ago
• lining0806 / PythonSpiderNotes

  View on GitHub
  Python入门网络爬虫之精华版
  ☆7,384Jun 21, 2021Updated 4 years ago
• Liangchengdeye / Requests_Html_Spider

  View on GitHub
  requests升级版requests-html 爬虫编写及通用爬虫模块搭建
  ☆11Nov 21, 2018Updated 7 years ago
• Alfred1984 / interesting-python

  View on GitHub
  有趣的Python爬虫和Python数据分析小项目(Some interesting Python crawlers and data analysis projects)
  ☆4,972Jul 6, 2021Updated 4 years ago
• wistbean / learn_python3_spider

  View on GitHub
  python爬虫教程系列、从0到1学习python爬虫，包括浏览器抓包，手机APP抓包，如 fiddler、mitmproxy，各种爬虫涉及的模块的使用，如：requests、beautifulSoup、selenium、appium、scrapy等，以及IP代理，验证码识…
  ☆21,306Feb 3, 2026Updated 3 weeks ago
• airingursb / bilibili-video

  View on GitHub
  🍙 Bilibili 视频爬虫
  ☆325Jun 18, 2022Updated 3 years ago
• xingag / spider_python

  View on GitHub
  python爬虫
  ☆1,126Dec 31, 2023Updated 2 years ago
• chenjiandongx / mmjpg

  View on GitHub
  👩 美女写真套图爬虫（一）
  ☆546Jun 6, 2018Updated 7 years ago
• dangsh / hive

  View on GitHub
  lots of spider (很多爬虫）
  ☆116Nov 8, 2018Updated 7 years ago
• forezp / ZhihuSpiderMan

  View on GitHub
  Python爬虫系列
  ☆163Oct 24, 2018Updated 7 years ago
• srx-2000 / spider_collection

  View on GitHub
  python爬虫，目前库存：网易云音乐歌曲爬取，B站视频爬取，知乎问答爬取，壁纸爬取，xvideos视频爬取，有声书爬取，微博爬虫，安居客信息爬取+数据可视化，哔哩哔哩视频封面提取器，ip代理池封装，知乎百万级用户爬虫+数据分析，github用户爬虫
  ☆1,581Apr 23, 2024Updated last year
• Ehco1996 / Python-crawler

  View on GitHub
  从头开始 系统化的 学习如何写Python爬虫。 Python版本 3.6
  ☆1,919May 22, 2023Updated 2 years ago
• TM0831 / Spiders

  View on GitHub
  各种大小爬虫集合
  ☆238Jul 5, 2020Updated 5 years ago
• Jack-Cherish / python-spider

  View on GitHub
  Python3网络爬虫实战：淘宝、京东、网易云、B站、12306、抖音、笔趣阁、漫画小说下载、音乐电影下载等
  ☆19,514Aug 19, 2024Updated last year
• librauee / Reptile

  View on GitHub
  🏀 Python3 网络爬虫实战（部分含详细教程）猫眼 腾讯视频 豆瓣 研招网 微博 笔趣阁小说 百度热点 B站 CSDN 网易云阅读 阿里文学 百度股票 今日头条 微信公众号 网易云音乐 拉勾 有道 unsplash 实习僧 汽车之家 英雄联盟盒子 大众点评 链家 LP…
  ☆1,724Apr 19, 2021Updated 4 years ago
• Homeless-Xu / PythonSpider

  View on GitHub
  入门爬虫项目. 详细注释!!!!!
  ☆145Mar 27, 2017Updated 8 years ago
• lb2281075105 / Python-Spider

  View on GitHub
  豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github…
  ☆782Aug 27, 2022Updated 3 years ago
• Kr1s77 / Python-crawler-tutorial-starts-from-zero

  View on GitHub
  python爬虫教程，带你从零到一，包含js逆向，selenium, tesseract OCR识别,mongodb的使用，以及scrapy框架
  ☆4,572Dec 2, 2020Updated 5 years ago
• heyxiaohao / Python

  View on GitHub
  Python知识点归纳项目
  ☆290Oct 16, 2020Updated 5 years ago
• chenjiandongx / mzitu

  View on GitHub
  👧 美女写真套图爬虫（二）
  ☆1,188Jul 29, 2018Updated 7 years ago
• qiyeboy / SpiderBook

  View on GitHub
  <<python爬虫开发与项目实战>>书籍配套源码和说明
  ☆989Mar 22, 2019Updated 6 years ago
• panxl6 / douban-movie

  View on GitHub
  豆瓣电影爬虫
  ☆342May 22, 2023Updated 2 years ago
• wangy8961 / python3-concurrency-pics-02

  View on GitHub
  爬取 www.mzitu.com 全站图片，截至目前共5162个图集，16.5万多张美女图片，使用 asyncio 和 aiohttp 实现的异步版本只需要不到2小时就能爬取完成。按日期创建图集目录，保存更合理。控制台只显示下载的进度条，详细信息保存在日志文件中。支持异常处…
  ☆336Aug 27, 2019Updated 6 years ago
• Qutan / Spider

  View on GitHub
  社交数据爬虫
  ☆222Oct 11, 2016Updated 9 years ago
• facert / tumblr_spider

  View on GitHub
  汤不热 python 多线程爬虫
  ☆463Jul 22, 2020Updated 5 years ago
• injetlee / Python

  View on GitHub
  Python脚本。模拟登录知乎， 爬虫，操作excel，微信公众号，远程开机
  ☆10,531Oct 10, 2023Updated 2 years ago
• chenjiandongx / bili-spider

  View on GitHub
  📺 B 站全站视频信息爬虫
  ☆681Feb 17, 2019Updated 7 years ago
• jhao104 / proxy_pool

  View on GitHub
  Python ProxyPool for web spider
  ☆23,169Nov 20, 2025Updated 3 months ago
• LiuRoy / zhihu_spider

  View on GitHub
  知乎爬虫
  ☆1,261Aug 4, 2016Updated 9 years ago
• Northxw / Python3_WebSpider

  View on GitHub
  Python3 网络爬虫实践集合。涉及多类型验证码识别、多类型模拟登陆、多类型反反爬措施、APP数据抓取、Scrapy框架、分布式爬虫等。
  ☆555Apr 8, 2022Updated 3 years ago
• nanxung / QQ_zone

  View on GitHub
  QQ空间爬虫，一小时20万数据
  ☆87Nov 3, 2018Updated 7 years ago
• Kr1s77 / awesome-python-login-model

  View on GitHub
  😮python模拟登陆一些大型网站，还有一些简单的爬虫，希望对你们有所帮助❤️，如果喜欢记得给个star哦🌟
  ☆16,238Jul 26, 2022Updated 3 years ago
• shengqiangzhang / examples-of-web-crawlers

  View on GitHub
  一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、微信读书、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )
  ☆14,577Jun 28, 2025Updated 8 months ago
• cuanboy / ScrapyProject

  View on GitHub
  开始Scrapy实战如：存数据库、下载文件、爬京东、淘宝、Anti-Anti-Spider……
  ☆424Apr 22, 2018Updated 7 years ago
• bowenpay / wechat-spider

  View on GitHub
  微信公众号爬虫
  ☆3,302Aug 10, 2021Updated 4 years ago
• LiuXingMing / SinaSpider

  View on GitHub
  新浪微博爬虫（Scrapy、Redis）
  ☆3,280Sep 5, 2018Updated 7 years ago