Alternatives and similar repositories for scrapybook

Users that are interested in scrapybook are comparing it to the libraries listed below

• scrapy-plugins / scrapy-zyte-smartproxy
  Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy
  ☆365Updated 6 months ago
• djm / python-scrapyd-api
  A Python wrapper for working with Scrapyd's API.
  ☆271Updated last year
• BruceDone / scrapy_demo
  all kinds of scrapy demo
  ☆164Updated 2 years ago
• flisky / scrapy-phantomjs-downloader
  PhantomJS Downloader for Scrapy, Yeah!
  ☆94Updated 11 years ago
• scrapy / scrapyd-client
  Command line client for Scrapyd server
  ☆774Updated last month
• scalingexcellence / scrapybook-2nd-edition
  Scrapy Book 2nd Edition Code http://scrapybook.com/
  ☆48Updated 3 years ago
• scrapinghub / scrapy-training
  Scrapy Training companion code
  ☆173Updated 6 years ago
• LiuXingMing / Scrapy_Redis_Bloomfilter
  基于Redis的Bloomfilter去重，并将其扩展到Scrapy框架。
  ☆347Updated 2 years ago
• scrapy-plugins / scrapy-djangoitem
  Scrapy extension to write scraped items using Django models
  ☆503Updated last year
• kohn / HttpProxyMiddleware
  A middleware for scrapy. Used to change HTTP proxy from time to time.
  ☆323Updated 7 years ago
• scrapy / quotesbot
  This is a sample Scrapy project for educational purposes
  ☆1,339Updated last year
• scrapy-plugins / scrapy-deltafetch
  Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls
  ☆274Updated 7 months ago
• scrapy-plugins / scrapy-jsonrpc
  Scrapy extension to control spiders using JSON-RPC
  ☆300Updated 6 years ago
• alecxe / scrapy-fake-useragent
  Random User-Agent middleware based on fake-useragent
  ☆693Updated 2 years ago
• aivarsk / scrapy-proxies
  Random proxy middleware for Scrapy
  ☆1,669Updated 6 years ago
• voliveirajr / seleniumcrawler
  An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
  ☆128Updated 6 years ago
• sebdah / scrapy-mongodb
  MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the item…
  ☆358Updated 4 years ago
• cnu / scrapy-random-useragent
  Scrapy Middleware to set a random User-Agent for every Request.
  ☆201Updated 6 years ago
• liyaopinner / BloomFilter_imooc
  ☆69Updated 7 years ago
• yidao620c / core-scrapy
  python-scrapy demo
  ☆810Updated 5 years ago
• Germey / CookiesPool
  CookiesPool Based on Redis
  ☆152Updated 7 years ago
• holgerd77 / django-dynamic-scraper
  Creating Scrapy scrapers via the Django admin interface
  ☆1,159Updated 3 years ago
• scrapinghub / testspiders
  Useful test spiders for Scrapy
  ☆185Updated 5 years ago
• LiuXingMing / LinkedinSpider
  Linkedin爬虫，根据公司名字抓取员工的linkedin信息
  ☆165Updated 8 years ago
• istresearch / scrapy-cluster
  This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
  ☆1,215Updated last year
• Python3WebSpider / ScrapyRedisBloomFilter
  Scrapy Redis Bloom Filter
  ☆176Updated 4 years ago
• liuslnlp / ProxyPool
  跨语言IP代理池，Python实现。
  ☆354Updated 7 years ago
• Andrew-liu / scrapy_example
  This repository store some example to learn scrapy better
  ☆177Updated 4 years ago
• scrapy / dirbot
  Scrapy project to scrape public web directories (educational) [DEPRECATED]
  ☆1,630Updated 7 years ago
• rmax / dirbot-mysql
  Scrapy project based on dirbot to show how to use Twisted's adbapi to store the scraped data in MySQL.
  ☆118Updated 11 years ago