Alternatives and similar repositories for scrapybook

Users that are interested in scrapybook are comparing it to the libraries listed below

• scrapy-plugins / scrapy-zyte-smartproxy
  Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy
  ☆364Updated 4 months ago
• djm / python-scrapyd-api
  A Python wrapper for working with Scrapyd's API.
  ☆272Updated last year
• BruceDone / scrapy_demo
  all kinds of scrapy demo
  ☆165Updated 2 years ago
• scrapy / scrapyd-client
  Command line client for Scrapyd server
  ☆778Updated 2 months ago
• flisky / scrapy-phantomjs-downloader
  PhantomJS Downloader for Scrapy, Yeah!
  ☆94Updated 10 years ago
• alecxe / scrapy-fake-useragent
  Random User-Agent middleware based on fake-useragent
  ☆696Updated last year
• aivarsk / scrapy-proxies
  Random proxy middleware for Scrapy
  ☆1,670Updated 5 years ago
• scrapy-plugins / scrapy-djangoitem
  Scrapy extension to write scraped items using Django models
  ☆502Updated last year
• scrapy-plugins / scrapy-deltafetch
  Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls
  ☆273Updated 5 months ago
• scrapinghub / scrapy-training
  Scrapy Training companion code
  ☆174Updated 6 years ago
• LiuXingMing / Scrapy_Redis_Bloomfilter
  基于Redis的Bloomfilter去重，并将其扩展到Scrapy框架。
  ☆347Updated 2 years ago
• scrapy-plugins / scrapy-jsonrpc
  Scrapy extension to control spiders using JSON-RPC
  ☆300Updated 5 years ago
• kohn / HttpProxyMiddleware
  A middleware for scrapy. Used to change HTTP proxy from time to time.
  ☆324Updated 7 years ago
• yidao620c / core-scrapy
  python-scrapy demo
  ☆813Updated 4 years ago
• cnu / scrapy-random-useragent
  Scrapy Middleware to set a random User-Agent for every Request.
  ☆202Updated 5 years ago
• scrapy / quotesbot
  This is a sample Scrapy project for educational purposes
  ☆1,336Updated last year
• scalingexcellence / scrapybook-2nd-edition
  Scrapy Book 2nd Edition Code http://scrapybook.com/
  ☆49Updated 3 years ago
• voliveirajr / seleniumcrawler
  An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
  ☆127Updated 6 years ago
• liyaopinner / BloomFilter_imooc
  ☆69Updated 7 years ago
• Germey / CookiesPool
  CookiesPool Based on Redis
  ☆152Updated 7 years ago
• liuslnlp / ProxyPool
  跨语言IP代理池，Python实现。
  ☆354Updated 7 years ago
• Python3WebSpider / ScrapyRedisBloomFilter
  Scrapy Redis Bloom Filter
  ☆176Updated 4 years ago
• scrapinghub / testspiders
  Useful test spiders for Scrapy
  ☆185Updated 5 years ago
• zhangslob / Web-crawler-engineer-for-Python
  Web-crawler-engineer-for-Python
  ☆43Updated 7 years ago
• scrapinghub / scrapyrt
  HTTP API for Scrapy spiders
  ☆864Updated last week
• geekan / scrapy-examples
  Multifarious Scrapy examples. Spiders for alexa / amazon / douban / douyu / github / linkedin etc.
  ☆3,248Updated last year
• sebdah / scrapy-mongodb
  MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the item…
  ☆356Updated 4 years ago
• Python3WebSpider / ScrapySplashTest
  Scrapy Splash on Taobao Product
  ☆31Updated 8 years ago
• istresearch / scrapy-cluster
  This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
  ☆1,214Updated last year
• clemfromspace / scrapy-selenium
  Scrapy middleware to handle javascript pages using selenium
  ☆948Updated last year