Alternatives and similar repositories for selenium-crawler:

Users that are interested in selenium-crawler are comparing it to the libraries listed below

• scrapinghub / crawlera-tools
  Crawlera tools
  ☆26Updated 9 years ago
• feiskyer / scrapy-examples
  Some scrapy and web.py exmaples
  ☆79Updated 7 years ago
• voliveirajr / seleniumcrawler
  An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
  ☆127Updated 6 years ago
• rmax / scrapy-boilerplate
  Small set of utilities to simplify writing Scrapy spiders.
  ☆49Updated 9 years ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• brandicted / scrapy-webdriver
  ☆143Updated 9 years ago
• tonywangcn / scaleable-crawler-with-docker-cluster
  a scaleable and efficient crawelr with docker cluster , crawl million pages in 2 hours with a single machine
  ☆97Updated 11 months ago
• redapple / parslepy
  Python implementation of the Parsley language for extracting structured data from web pages
  ☆92Updated 7 years ago
• rohithpr / py-web-search
  A Python module to fetch and parse results from different search engines.
  ☆77Updated 6 years ago
• realpython / stack-spider
  ☆167Updated 6 years ago
• Diastro / Zeek
  Python distributed web scrapper and dynamic crawler
  ☆141Updated 7 years ago
• jxltom / scrapymon
  Simple Web UI for Scrapy spider management via Scrapyd
  ☆51Updated 6 years ago
• scrapinghub / scmongo
  MongoDB extensions for Scrapy
  ☆44Updated 10 years ago
• OlivierBlanvillain / crawler
  Blog crawler for the blogforever project.
  ☆22Updated 11 years ago
• duydo / scrapy-crunchbase
  Using Scrapy to get company profiles from http://crunchbase.com
  ☆31Updated 11 years ago
• rmax / scrapydo
  Crochet-based blocking API for Scrapy.
  ☆46Updated 8 years ago
• scrapinghub / scrapylib
  Collection of Scrapy utilities (extensions, middlewares, pipelines, etc)
  ☆32Updated 7 years ago
• AlchemyAPI / alchemyapi_python
  A sdk for AlchemyAPI using Python - Please note that this legacy AlchemyAPI SDK is no longer supported by IBM. Please use the Watson SDKs…
  ☆98Updated 8 years ago
• vivekanand1101 / twitter-sentiment-analysis
  Command line tool for Sentiment analysis of tweets - done for data mining sem project
  ☆11Updated 8 years ago
• benjaminestes / pyscape-client
  A library to interface with the Linkscape API.
  ☆40Updated 6 years ago
• TeamHG-Memex / scrapy-dockerhub
  [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.
  ☆11Updated 9 years ago
• mjhea0 / Scrapy-Samples
  Scrapy examples crawling Craigslist
  ☆199Updated 8 years ago
• scrapinghub / mdr
  A python library detect and extract listing data from HTML page.
  ☆108Updated 7 years ago
• junekihong / linkedInScraper
  Scrapes public information off of LinkedIn
  ☆110Updated 9 years ago
• NAMD / pypln.backend
  Pipeline for distributed Natural Language Processing, made in Python
  ☆65Updated 8 years ago
• eventuallyc0nsistent / scrapy-programmatically
  Running scrapy spider programmatically.
  ☆47Updated 8 years ago
• toumorokoshi / nlgen
  Natural Language Generator for Python
  ☆27Updated 7 years ago
• cnu / scrapy-random-useragent
  Scrapy Middleware to set a random User-Agent for every Request.
  ☆202Updated 5 years ago
• scrapy-plugins / scrapy-streaming
  ☆18Updated 8 years ago
• kremso / dmoz-parser
  Dmoz RDF parser
  ☆28Updated 8 years ago