Alternatives and similar repositories for scrapy-elasticsearch

Users that are interested in scrapy-elasticsearch are comparing it to the libraries listed below

• jayzeng / scrapy-elasticsearch
  A scrapy pipeline which send items to Elastic Search server
  ☆325Updated 3 years ago
• scrapinghub / scrapylib
  Collection of Scrapy utilities (extensions, middlewares, pipelines, etc)
  ☆32Updated 7 years ago
• sebdah / scrapy-mongodb
  MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the item…
  ☆356Updated 4 years ago
• TeamHG-Memex / arachnado
  Web Crawling UI and HTTP API, based on Scrapy and Tornado
  ☆161Updated 2 years ago
• voliveirajr / seleniumcrawler
  An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
  ☆127Updated 6 years ago
• scrapinghub / testspiders
  Useful test spiders for Scrapy
  ☆185Updated 5 years ago
• brandicted / scrapy-webdriver
  ☆143Updated 9 years ago
• roycehaynes / scrapy-rabbitmq
  A RabbitMQ Scheduler for Scrapy
  ☆87Updated 2 years ago
• scrapinghub / scmongo
  MongoDB extensions for Scrapy
  ☆44Updated 10 years ago
• scrapy / loginform
  Fill HTML login forms automatically
  ☆274Updated last year
• feiskyer / scrapy-examples
  Some scrapy and web.py exmaples
  ☆79Updated 8 years ago
• cnu / scrapy-random-useragent
  Scrapy Middleware to set a random User-Agent for every Request.
  ☆202Updated 5 years ago
• jmg / crawley
  Pythonic Crawling / Scraping Framework based on Non Blocking I/O operations.
  ☆190Updated 2 years ago
• julien-duponchelle / scrapy-graphite
  Output scrapy statistics to graphite/carbon
  ☆54Updated 12 years ago
• TeamHG-Memex / scrapy-dockerhub
  [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.
  ☆11Updated 10 years ago
• scrapy-plugins / scrapy-jsonrpc
  Scrapy extension to control spiders using JSON-RPC
  ☆300Updated 5 years ago
• realpython / stack-spider
  ☆167Updated 6 years ago
• chiangf / Flask-Elasticsearch
  Flask extension that provides simple integration with Elasticsearch
  ☆135Updated 8 years ago
• scrapinghub / aile
  Automatic Item List Extraction
  ☆87Updated 9 years ago
• rmax / dirbot-mysql
  Scrapy project based on dirbot to show how to use Twisted's adbapi to store the scraped data in MySQL.
  ☆117Updated 11 years ago
• svetlyak40wt / scrapy-useragents
  A middleware to use random user agent in Scrapy crawler.
  ☆33Updated 12 years ago
• dfdeshom / scrapy-kafka
  Kafka-based components for Scrapy
  ☆79Updated 7 years ago
• scrapinghub / python-simhash
  An efficient simhash implementation for python
  ☆125Updated 5 years ago
• redapple / parslepy
  Python implementation of the Parsley language for extracting structured data from web pages
  ☆92Updated 7 years ago
• scrapinghub / aduana
  Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even whe…
  ☆55Updated last year
• scrapinghub / mdr
  A python library detect and extract listing data from HTML page.
  ☆108Updated 8 years ago
• iammai / docker-scrapy-crawler
  docker scrapyd scrapy boot2docker crawler - a spider Python application that can be "Dockerized".
  ☆42Updated 10 years ago
• lopuhin / scrapy-pyppeteer
  Use pyppeteer from a Scrapy spider
  ☆59Updated 5 years ago
• corywalker / selenium-crawler
  Sometimes sites make crawling hard. Selenium-crawler uses selenium automation to fix that.
  ☆125Updated 12 years ago
• TeamHG-Memex / autologin-middleware
  Scrapy middleware for the autologin
  ☆36Updated 7 years ago