starryrbs/awesome-scrapy external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

starryrbs/awesome-scrapy

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/starryrbs/awesome-scrapy)

Close

starryrbs / awesome-scrapyView on GitHubMore

• External links
• Readme badge

scrapy实战教程，分享scrapy爬虫的知识，针对各大网站做爬虫采集，并且以实例代码讲解。

☆10Jan 22, 2026Updated 8 months ago

Alternatives and similar repositories for awesome-scrapy

Users that are interested in awesome-scrapy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• zhoujianjian / kurry

  View on GitHub
  京东/淘宝/拼多多/条形码 爬虫
  ☆11Dec 10, 2022Updated 3 years ago
• liuhuanshuo / notes-python

  View on GitHub
  中文 Python 笔记
  ☆12Jan 15, 2018Updated 8 years ago
• owid / owid-importer

  View on GitHub
  A collection of Python bulk import scripts for various data sources
  ☆16Feb 28, 2022Updated 4 years ago
• imokya / object-detect

  View on GitHub
  微信物体检测小程序
  ☆13Jun 4, 2020Updated 6 years ago
• jackwener / IT-common-disease

  View on GitHub
  程序员职业病
  ☆12Apr 26, 2020Updated 6 years ago
• Managed Kubernetes at scale on DigitalOcean • Ad
  DigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
• xiaobaoonline / aspnetcore-in-action

  View on GitHub
  ☆13Dec 7, 2020Updated 5 years ago
• gitktd / awesome-list-tgktd

  View on GitHub
  网站资源分享-welcome to recommend the website
  ☆12Feb 25, 2023Updated 3 years ago
• tuya / tuya-panel-kit-docs

  View on GitHub
  Docs site for tuya-panel-kit
  ☆13Oct 11, 2026Updated last week
• AndyLinGo / AutoForceAI

  View on GitHub
  AutoForceAI (思渡AI) is an open source digital employees platform (数字员工平台) that deeply integrates LLM, RPA, GEO, Knowledge Base (RAG), and …
  ☆26Jun 13, 2026Updated 4 months ago
• siegrainwong / .NET-Core-with-Docker

  View on GitHub
  《基于 docker-compose 实践 .NET Core 的现代化架构》系列文章的代码
  ☆14Jul 21, 2019Updated 7 years ago
• GuangchuangYu / course_bioinfo_training

  View on GitHub
  ☆11Oct 1, 2019Updated 7 years ago
• sjhfx / Rweibo

  View on GitHub
  An interface to the Weibo open platform
  ☆13Mar 23, 2020Updated 6 years ago
• zhanglilong23 / Asp.NetCore.Demo

  View on GitHub
  记录学习.net core 的一些用法; 包含使用Log4Net 和 使用消息中间件拦截请求和返回消息并加密。
  ☆13Jan 29, 2021Updated 5 years ago
• scriptgeeker / Todo-List

  View on GitHub
  网页版四象限任务清单
  ☆12Mar 17, 2023Updated 3 years ago
• Deploy open-source AI quickly and easily - Special Bonus Offer • Ad
  Runpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
• pwwang / python-import-system

  View on GitHub
  Python import system diagram
  ☆16Dec 12, 2020Updated 5 years ago
• JingwenTian / awesome-shell

  View on GitHub
  整理一些工作中常用的shell命令和脚本
  ☆16Dec 4, 2017Updated 8 years ago
• zypher-game / z4

  View on GitHub
  Z4: multiplayer real-time decentralized game framework (zk powered)
  ☆18Nov 27, 2024Updated last year
• lpb243310820 / MicroservicesDemo

  View on GitHub
  Abp+Ocelot+Consul+Identityserver+Redis+Polly
  ☆14Jan 6, 2023Updated 3 years ago
• zhiduoke / gapi

  View on GitHub
  An HTTP framework for transcoding HTTP API to GRPC
  ☆12Dec 6, 2021Updated 4 years ago
• clopso / tweetext

  View on GitHub
  Find ALL old tweets with the Wayback Machine (Including from disabled accounts)
  ☆15Jul 12, 2023Updated 3 years ago
• Randy-whiteSugar / LagouSpider_Scrapy

  View on GitHub
  使用Scrapy编写的拉勾网爬虫，添加了代理IP池、增量爬取机制
  ☆11May 22, 2023Updated 3 years ago
• Antonoko / Chinese-font-for-playdate

  View on GitHub
  Create Chinese font or other font asset for Playdate
  ☆16May 3, 2025Updated last year
• mstem / archive.org-getter

  View on GitHub
  Ruby script to download bulk results from Archive.org's TV News database of closed captions
  ☆14Mar 20, 2013Updated 13 years ago
• Virtual machines for every use case on DigitalOcean • Ad
  Get dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
• codexu / wxt-love-juejin

  View on GitHub
  《下一代浏览器插件开发框架 WXT 入门指南》示例
  ☆13Jan 30, 2024Updated 2 years ago
• imyxuan / Netease

  View on GitHub
  网易云音乐爬虫
  ☆21Jan 12, 2018Updated 8 years ago
• MrRace / KGQA

  View on GitHub
  基于知识图谱的人物关系可视化及问答系统
  ☆10Aug 24, 2018Updated 8 years ago
• saisaket / BigDataAnalytics

  View on GitHub
  Analyzing crime reported in the U.S. using data derived from commoncrawl, New York Times api and twitter data.
  ☆18Aug 28, 2019Updated 7 years ago
• ZMqaq7 / comfyui-workflow2

  View on GitHub
  comfyui工作流，提供deepseek、AI绘画、AI换脸、老照片修复、AI写真、AI设计、AI动漫、flux等comfyui工作
  ☆16Jul 31, 2025Updated last year
• monto-fe / code-review

  View on GitHub
  基于DeepSeek等大模型开发的Code Review服务（适用于Gitlab）
  ☆33Feb 11, 2026Updated 8 months ago
• katreparitosh / Discourse-Analytics-of-Political-Speech-Transcripts

  View on GitHub
  Political Discourse Analysis (PDA) of Political Speech Transcripts using Natural Language Processing (NLP)
  ☆17Apr 28, 2021Updated 5 years ago
• gisfromscratch / gdelt-notebooks

  View on GitHub
  Sample notebooks for using the Global Database of Events, Language and Tone (GDELT).
  ☆19Nov 8, 2020Updated 5 years ago
• Dml-2021 / amazon-spider

  View on GitHub
  amazon crawler、亚马逊分布式爬虫系统，已在生产环境中稳定运行两年，支撑每天5千万+爬取量，包含亚马逊前台所有数据的爬取，如亚马逊商品爬虫、亚马逊关键词爬虫（可指定邮编爬取）、亚马逊关键词广告爬虫、亚马逊5大榜单爬虫、亚马逊评论爬虫、亚马逊类目爬虫、亚马逊商户爬…
  ☆15Sep 21, 2023Updated 3 years ago
• Proton VPN Special Offer - Get 70% off • Ad
  Special partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
• wangfangye / kg-hongloumeng

  View on GitHub
  红楼梦数据集知识图谱
  ☆16Oct 13, 2020Updated 6 years ago
• aliez-ren / blogit

  View on GitHub
  Markdown + GitHub -> Blog
  ☆12Dec 16, 2023Updated 2 years ago
• helixcn / spaa

  View on GitHub
  Miscellaneous functions for analysis of species association and niche overlap
  ☆13Apr 22, 2022Updated 4 years ago
• lcpu-club / blog-collect

  View on GitHub
  收集所有同学博客～
  ☆22Sep 2, 2024Updated 2 years ago
• hrbrmstr / elpresidente

  View on GitHub
  🇺🇸 Search and Extract Corpus Elements from 'The American Presidency Project'
  ☆20Apr 23, 2018Updated 8 years ago
• SukkaW / SukkaW

  View on GitHub
  My GitHub Profile
  ☆15Aug 29, 2026Updated last month
• cxycsx03 / JSReverse

  View on GitHub
  JS逆向，JS逆向进阶，JS逆向爬虫，JS逆向百例，JS逆向破解，JS逆向补环境，JS解密逆向实战，JS逆向系列教程，JS逆向Hook，滑块验证码
  ☆26Feb 8, 2024Updated 2 years ago