Alternatives and similar repositories for scrapy-twitter

Users that are interested in scrapy-twitter are comparing it to the libraries listed below

• TeamHG-Memex / deep-deep
  Adaptive crawler which uses Reinforcement Learning methods
  ☆169Updated 7 years ago
• openeventdata / scraper
  Scrapes sites. Gets news. Eventually events.
  ☆87Updated 9 years ago
• bianjiang / tweetf0rm
  A twitter crawler in Python
  ☆305Updated 7 years ago
• vu3jej / scrapy-corenlp
  ☆59Updated 3 years ago
• scrapinghub / aile
  Automatic Item List Extraction
  ☆87Updated 9 years ago
• diffbot / diffbot-python-client
  Python Diffbot API Client
  ☆124Updated 2 years ago
• Webhose / article-date-extractor
  Automatically extracts and normalizes an online article or blog post publication date
  ☆117Updated 2 years ago
• scrapinghub / mdr
  A python library detect and extract listing data from HTML page.
  ☆108Updated 8 years ago
• scrapinghub / webstruct
  NER toolkit for HTML data
  ☆259Updated last year
• julien-duponchelle / scrapy-elasticsearch
  A scrapy pipeline which send items to Elastic Search server
  ☆98Updated 7 years ago
• TeamHG-Memex / undercrawler
  A generic crawler
  ☆78Updated 7 years ago
• junekihong / linkedInScraper
  Scrapes public information off of LinkedIn
  ☆111Updated 9 years ago
• corywalker / selenium-crawler
  Sometimes sites make crawling hard. Selenium-crawler uses selenium automation to fix that.
  ☆125Updated 12 years ago
• TeamHG-Memex / scrapy-dockerhub
  [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.
  ☆11Updated 10 years ago
• scku / Quora-Crawler
  Python crawler for quora.com
  ☆83Updated 11 years ago
• tpeng / googlesearch
  Scrape the Google search result with Scrapy.
  ☆99Updated 5 years ago
• sebdah / scrapy-mongodb
  MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the item…
  ☆357Updated 4 years ago
• scrapinghub / aduana
  Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even whe…
  ☆55Updated last year
• scrapinghub / python-scrapinghub
  A client interface for Scrapinghub's API
  ☆204Updated 6 months ago
• TeamHG-Memex / autologin-middleware
  Scrapy middleware for the autologin
  ☆36Updated 7 years ago
• Parsely / serpextract
  Easy extraction of keywords and engines from search engine results pages (SERPs).
  ☆90Updated 3 years ago
• tomkdickinson / Twitter-Search-API-Python
  A Twitter search client mining tweets using their advanced search implemtation.
  ☆90Updated 6 years ago
• JohnCoogan / twitter-graph-visualization
  Analysis of the Twitter Social graph using Python, NetworkX, and D3.js
  ☆60Updated 12 years ago
• jayzeng / scrapy-elasticsearch
  A scrapy pipeline which send items to Elastic Search server
  ☆325Updated 3 years ago
• scrapy-plugins / scrapy-deltafetch
  Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls
  ☆273Updated 6 months ago
• scrapinghub / autopager
  Detect and classify pagination links
  ☆15Updated 4 years ago
• brandicted / scrapy-webdriver
  ☆143Updated 9 years ago
• cnu / scrapy-random-useragent
  Scrapy Middleware to set a random User-Agent for every Request.
  ☆202Updated 6 years ago
• jxltom / scrapymon
  Simple Web UI for Scrapy spider management via Scrapyd
  ☆51Updated 7 years ago
• cantabular / scraperwiki-python
  ScraperWiki Python library for scraping and saving data
  ☆158Updated 2 years ago