Alternatives and similar repositories for -Scrapy-

Users that are interested in -Scrapy- are comparing it to the libraries listed below

• Mocha-Pudding / Scrapy-Redis_Demos

  View on GitHub
  Python分布式爬虫学习笔记，各种Demo同步
  ☆12Aug 21, 2019Updated 6 years ago
• wangy8961 / download-large-files

  View on GitHub
  介绍如何流式下载大文件，并实现断点续传功能。根据顺序下载大文件的字节和乱序下载大文件的各个分段，分别进行了多线程或协程并发，还实现了多个大文件并发下载
  ☆17Aug 27, 2019Updated 6 years ago
• HegemonyTao / crawlProject

  View on GitHub
  今日头条 、淘宝 、微博 、斗鱼 、抖音 、哔哩哔哩 、有道翻译、steam网站以及网易云音乐爬取
  ☆61Apr 17, 2020Updated 5 years ago
• yueyue10 / PythonPro

  View on GitHub
  python多个项目集合：python基础知识、爬取github数据并保存到数据库、下载抖音视频、保存日志到数据库等功能
  ☆33Dec 8, 2022Updated 3 years ago
• wangy8961 / python3-concurrency-aqi

  View on GitHub
  并发爬取全国城市空气质量日报数据，数据来源： http://datacenter.mep.gov.cn
  ☆10Sep 1, 2018Updated 7 years ago
• zhoujinjian / awesome-python-cn

  View on GitHub
  Python资源大全中文版，包括：Web框架、网络爬虫、模板引擎、数据库、数据可视化、图片处理等，由伯乐在线持续更新。
  ☆13Mar 14, 2017Updated 8 years ago
• activelylazy / SeleniumGuide

  View on GitHub
  A guide to using selenium
  ☆14Oct 13, 2020Updated 5 years ago
• mahartma / robotframework-mongodblibrary

  View on GitHub
  Keywordlibrary for MongoDB
  ☆15Oct 14, 2015Updated 10 years ago
• Rockyzsu / ScrapyBook

  View on GitHub
  精通Scrapy网络爬虫
  ☆30Aug 16, 2018Updated 7 years ago
• neocharlesprojects / tradeagents

  View on GitHub
  TradeAgents is an AI-powered framework for simulating market interactions, integrating economic principles with intelligent agent design.
  ☆40Feb 3, 2025Updated last year
• PacktPublishing / Deep-Reinforcement-with-PyTorch-and-TensorFlow

  View on GitHub
  Published by Packt
  ☆11Jan 18, 2021Updated 5 years ago
• Blues1998 / Streamlit-hello-app

  View on GitHub
  Sample repository for my awesome Youtube viewers.
  ☆10Jun 3, 2020Updated 5 years ago
• Pita / CatchGame

  View on GitHub
  A simple game based on node.js
  ☆30Mar 23, 2015Updated 10 years ago
• cystanford / pachong

  View on GitHub
  Python爬虫实例
  ☆11Feb 25, 2019Updated 6 years ago
• PacktPublishing / Mastering-Apache-Storm

  View on GitHub
  Mastering Apache Storm, published by Packt
  ☆11Oct 30, 2023Updated 2 years ago
• Obsir / ZhihuUserSpider

  View on GitHub
  基于Scrapy框架的知乎用户爬虫
  ☆10Feb 26, 2021Updated 4 years ago
• Randy-whiteSugar / LagouSpider_Scrapy

  View on GitHub
  使用Scrapy编写的拉勾网爬虫，添加了代理IP池、增量爬取机制
  ☆11May 22, 2023Updated 2 years ago
• gyzong1 / JfrogChina

  View on GitHub
  ☆10Jul 1, 2022Updated 3 years ago
• wsqy / fluent-python-notes

  View on GitHub
  流畅的python笔记
  ☆11Dec 15, 2017Updated 8 years ago
• Walker088 / tradePy

  View on GitHub
  Project for auto trading in Taiwan Stock Price Index Futures
  ☆13Aug 20, 2018Updated 7 years ago
• mantisbt-plugins / Reminder

  View on GitHub
  This plugin can be used to send periodic email reminders to bug reporters, managers, and assignees.
  ☆12Jan 13, 2025Updated last year
• qitaos / robotframework-QTLibrary

  View on GitHub
  This is a test Library.
  ☆12Nov 3, 2017Updated 8 years ago
• jeffzi / pandas-select

  View on GitHub
  Supercharged pandas indexing
  ☆11Mar 28, 2021Updated 4 years ago
• PacktPublishing / Practical-DevOps-Second-Edition

  View on GitHub
  Practical DevOps Second Edition, published by Packt
  ☆13Jan 30, 2023Updated 3 years ago
• jenkinsci / accurev-plugin

  View on GitHub
  Jenkins accurev plugin
  ☆16Aug 26, 2024Updated last year
• mikeku1116 / news-scraper

  View on GitHub
  ☆10Feb 28, 2021Updated 4 years ago
• tlyu0419 / 100Day-ML-Marathon

  View on GitHub
  ☆14Sep 1, 2019Updated 6 years ago
• zwdnet / investment

  View on GitHub
  量化投资探索指数基金定投的策略
  ☆11Oct 21, 2017Updated 8 years ago
• jenkinsci / doxygen-plugin

  View on GitHub
  Jenkins doxygen plugin
  ☆18Dec 21, 2022Updated 3 years ago
• NoahY / q2a-poll

  View on GitHub
  Adds polls to Question2Answer
  ☆16Sep 25, 2018Updated 7 years ago
• netor0x86 / python_spider_demo

  View on GitHub
  Python JavaScript 逆向 爬虫
  ☆10Jul 6, 2024Updated last year
• s4int / robotframework-KafkaLibrary

  View on GitHub
  ☆12Dec 3, 2019Updated 6 years ago
• SonarSource / sonar-scm-svn

  View on GitHub
  SonarQube Plugin for SVN
  ☆11Apr 28, 2021Updated 4 years ago
• dzqann / BaiduIndex

  View on GitHub
  百度指数爬虫
  ☆11May 17, 2020Updated 5 years ago
• oclint / oclint-docs

  View on GitHub
  OCLint project's documentation
  ☆18Dec 31, 2022Updated 3 years ago
• waf / anki-thai

  View on GitHub
  Build an Thai Vocab Anki deck from a JSON file
  ☆10Jul 9, 2022Updated 3 years ago
• cucumber-attic / gherkin-syntax-highlighters

  View on GitHub
  Syntax highlighters for Gherkin source
  ☆23Oct 14, 2012Updated 13 years ago
• robotframework / IntroSlides

  View on GitHub
  Robot Framework Introduction slide set
  ☆15May 25, 2016Updated 9 years ago
• TomLiu / zhihudailyAPI

  View on GitHub
  ☆14Sep 14, 2014Updated 11 years ago