Alternatives and similar repositories for scrapybook

Users that are interested in scrapybook are comparing it to the libraries listed below

• scrapy / scrapyd-client
  Command line client for Scrapyd server
  ☆772Updated 2 weeks ago
• scrapy-plugins / scrapy-zyte-smartproxy
  Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy
  ☆362Updated 2 months ago
• scalingexcellence / scrapybook-2nd-edition
  Scrapy Book 2nd Edition Code http://scrapybook.com/
  ☆49Updated 3 years ago
• aivarsk / scrapy-proxies
  Random proxy middleware for Scrapy
  ☆1,669Updated 5 years ago
• djm / python-scrapyd-api
  A Python wrapper for working with Scrapyd's API.
  ☆271Updated 10 months ago
• alecxe / scrapy-fake-useragent
  Random User-Agent middleware based on fake-useragent
  ☆694Updated last year
• scrapy-plugins / scrapy-jsonrpc
  Scrapy extension to control spiders using JSON-RPC
  ☆300Updated 5 years ago
• BruceDone / scrapy_demo
  all kinds of scrapy demo
  ☆164Updated 2 years ago
• cnu / scrapy-random-useragent
  Scrapy Middleware to set a random User-Agent for every Request.
  ☆202Updated 5 years ago
• LiuXingMing / Scrapy_Redis_Bloomfilter
  基于Redis的Bloomfilter去重，并将其扩展到Scrapy框架。
  ☆346Updated 2 years ago
• flisky / scrapy-phantomjs-downloader
  PhantomJS Downloader for Scrapy, Yeah!
  ☆94Updated 10 years ago
• scrapinghub / testspiders
  Useful test spiders for Scrapy
  ☆185Updated 5 years ago
• Python3WebSpider / ScrapyRedisBloomFilter
  Scrapy Redis Bloom Filter
  ☆175Updated 3 years ago
• liyaopinner / BloomFilter_imooc
  ☆69Updated 7 years ago
• scrapy / quotesbot
  This is a sample Scrapy project for educational purposes
  ☆1,322Updated last year
• scrapy-plugins / scrapy-deltafetch
  Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls
  ☆273Updated 3 months ago
• scrapy-plugins / scrapy-splash
  Scrapy+Splash for JavaScript integration
  ☆3,207Updated 3 months ago
• istresearch / scrapy-cluster
  This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
  ☆1,208Updated last year
• clemfromspace / scrapy-selenium
  Scrapy middleware to handle javascript pages using selenium
  ☆944Updated 10 months ago
• voliveirajr / seleniumcrawler
  An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
  ☆127Updated 6 years ago
• Python3WebSpider / ScrapySeleniumTest
  Scrapy Selenium on Taobao Product
  ☆84Updated 7 years ago
• scrapinghub / scrapy-training
  Scrapy Training companion code
  ☆174Updated 6 years ago
• TeamHG-Memex / arachnado
  Web Crawling UI and HTTP API, based on Scrapy and Tornado
  ☆162Updated 2 years ago
• sebdah / scrapy-mongodb
  MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the item…
  ☆356Updated 4 years ago
• kohn / HttpProxyMiddleware
  A middleware for scrapy. Used to change HTTP proxy from time to time.
  ☆325Updated 7 years ago
• yidao620c / core-scrapy
  python-scrapy demo
  ☆811Updated 4 years ago
• Germey / CookiesPool
  CookiesPool Based on Redis
  ☆152Updated 7 years ago
• Gerapy / GerapyPyppeteer
  Downloader Middleware to support Pyppeteer in Scrapy & Gerapy
  ☆135Updated 3 years ago
• scrapinghub / frontera
  A scalable frontier for web crawlers
  ☆1,309Updated last week
• da2vin / Sasila
  一个灵活、友好的爬虫框架
  ☆296Updated 2 years ago