kiorky / spynner

Related projects ⓘ

Alternatives and complementary repositories for spynner

• brandicted / scrapy-webdriver
  ☆143Updated 8 years ago
• scrapinghub / testspiders
  Useful test spiders for Scrapy
  ☆183Updated 4 years ago
• scrapy-plugins / scrapy-jsonrpc
  Scrapy extension to control spiders using JSON-RPC
  ☆296Updated 5 years ago
• sebdah / scrapy-mongodb
  MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the item…
  ☆357Updated 3 years ago
• scrapinghub / scrapylib
  Collection of Scrapy utilities (extensions, middlewares, pipelines, etc)
  ☆31Updated 6 years ago
• orf / cyborg
  Python web scraping framework
  ☆316Updated 7 years ago
• ssteuteville / scrapyz
  "Scrape Easy" - an extension of the Scrapy framework.
  ☆188Updated 8 years ago
• jeanphix / Ghost.py
  Webkit based scriptable web browser for python.
  ☆2,764Updated 8 months ago
• niklasb / dryscrape
  [not actively maintained] A lightweight Python library that uses Webkit to enable easy scraping of dynamic, Javascript-heavy web pages
  ☆533Updated 7 years ago
• doloopwhile / PyExecJS
  Run JavaScript code from Python (EOL: https://gist.github.com/doloopwhile/8c6ec7dd4703e8a44e559411cb2ea221)
  ☆708Updated 4 years ago
• niwinz / phantompy
  Phantompy is a headless WebKit engine with powerful pythonic api build on top of Qt5 Webkit
  ☆613Updated 7 years ago
• cnu / scrapy-random-useragent
  Scrapy Middleware to set a random User-Agent for every Request.
  ☆201Updated 5 years ago
• axiak / pybloomfiltermmap
  Fast Python Bloom Filter using Mmap
  ☆741Updated 5 years ago
• davisp / python-spidermonkey
  Python/JavaScript bridge module, making use of Mozilla's spidermonkey JavaScript implementation.
  ☆305Updated 7 years ago
• tomekwojcik / envelopes
  Mailing for human beings
  ☆590Updated 5 years ago
• shinux / PyTime
  PyTime is an easy-use Python module which aims to operate date/time/datetime by string.
  ☆159Updated 2 years ago
• appliedsec / pygeoip
  DEPRECATED: Pure Python API for Maxmind's binary GeoIP databases
  ☆482Updated 6 years ago
• senko / tornado-proxy
  Asyncronous HTTP proxy with tunnelling (CONNECT) support
  ☆337Updated last year
• rmax / dirbot-mysql
  Scrapy project based on dirbot to show how to use Twisted's adbapi to store the scraped data in MySQL.
  ☆117Updated 11 years ago
• scrapy / scrapely
  A pure-python HTML screen-scraping library
  ☆1,863Updated 2 years ago
• scrapy-plugins / scrapy-deltafetch
  Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls
  ☆267Updated 3 years ago
• brokenseal / PyV8-OS-X
  Compiled PyV8 for Mac OS X
  ☆103Updated 12 years ago
• jjlee / mechanize
  Stateful programmatic web browsing in Python, after Andy Lester's Perl module WWW::Mechanize .
  ☆618Updated 7 years ago
• scrapy / w3lib
  Python library of web-related functions
  ☆392Updated last month
• seomoz / pyreBloom
  Fast Redis Bloom Filters in Python
  ☆289Updated 5 years ago
• TeamHG-Memex / arachnado
  Web Crawling UI and HTTP API, based on Scrapy and Tornado
  ☆161Updated 2 years ago
• iiSeymour / chromote
  Simple wrapper to drive Google Chrome from Python
  ☆317Updated 3 years ago
• mher / tornado-celery
  Non-blocking Celery client for Tornado
  ☆567Updated 7 years ago
• autopilot-rs / autopy-legacy
  DEPRECATED: Replaced by https://github.com/autopilot-rs/autopy
  ☆841Updated 6 years ago
• scrapy / cssselect
  CSS Selectors for Python
  ☆291Updated last month