realpython / stack-spider

Related projects ⓘ

Alternatives and complementary repositories for stack-spider

• voliveirajr / seleniumcrawler
  An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
  ☆127Updated 5 years ago
• feiskyer / scrapy-examples
  Some scrapy and web.py exmaples
  ☆77Updated 7 years ago
• rmax / dirbot-mysql
  Scrapy project based on dirbot to show how to use Twisted's adbapi to store the scraped data in MySQL.
  ☆117Updated 11 years ago
• eventuallyc0nsistent / scrapy-programmatically
  Running scrapy spider programmatically.
  ☆47Updated 8 years ago
• renxing / quora-python
  Quora clone write in Python + Tornado + MongoDB
  ☆106Updated 3 years ago
• tpeng / weibosearch
  A distributed Sina Weibo Search spider base on Scrapy and Redis.
  ☆143Updated 11 years ago
• geogas / scrapy-flask-imdb-python
  Python project scraping imdb and web application implemented using Flask.
  ☆53Updated 9 years ago
• blha303 / question
  A Flask web server for quickly asking someone a question
  ☆82Updated 9 years ago
• corywalker / selenium-crawler
  Sometimes sites make crawling hard. Selenium-crawler uses selenium automation to fix that.
  ☆125Updated 11 years ago
• rozza / flask-tumblelog
  A mongoengine flask tumblelog
  ☆167Updated 8 years ago
• immzz / zhihu-scrapy
  A scrapy zhihu crawler
  ☆76Updated 6 years ago
• yoyzhou / weibo_scrapy
  WEIBO_SCRAPY is a Multi-Threading SINA WEIBO data extraction Framework in Python.
  ☆154Updated 7 years ago
• maxliaops / scrapy-itzhaopin
  ☆95Updated 10 years ago
• chensoul / scrapy-zhihu-github
  scrapy examples for crawling zhihu and github
  ☆222Updated last year
• mjhea0 / Scrapy-Samples
  Scrapy examples crawling Craigslist
  ☆199Updated 8 years ago
• younghz / scrapy-redis
  Redis-based components for scrapy that allows distributed crawling
  ☆46Updated 10 years ago
• stummjr / HackerNewsDailyDigest
  A toy project with Scrapy + Django + Celery to run on Heroku
  ☆13Updated 9 years ago
• eventuallyc0nsistent / arachne
  A flask API for running your scrapy spiders
  ☆128Updated 6 years ago
• pelick / VerticleSearchEngine
  Academic Search Engine using Scrapy, MongoDB, Lucene/Solr, Tika, Struts2, Jquery, Bootstrap, D3, CAS
  ☆98Updated 11 years ago
• AmbientLighter / rpn-fas
  Parser for open government data
  ☆30Updated 6 years ago
• wuchong / scrapy-dynamic-configurable
  A dynamic configurable news crawler based Scrapy
  ☆164Updated 7 years ago
• douban / brownant
  Brownant is a web data extracting framework.
  ☆159Updated 7 years ago
• RobinDavid / Pytesser
  Python wrapper for the tesseract OCR engine. The module is based on OpenCV
  ☆177Updated 7 years ago
• Andrew-liu / scrapy_example
  This repository store some example to learn scrapy better
  ☆176Updated 4 years ago
• laoqiu / pypress-tornado
  pypress rework by tornado
  ☆222Updated 11 years ago
• limboy / chat
  a live chat built with python(flask + gevent + apscheduler) + redis
  ☆321Updated 2 years ago
• scrapinghub / testspiders
  Useful test spiders for Scrapy
  ☆183Updated 4 years ago