seomoz / pyreBloom

Related projects: ⓘ

• scrapy / queuelib
  Collection of persistent (disk-based) and non-persistent (memory-based) queues for Python
  ☆266Updated 4 months ago
• brandicted / scrapy-webdriver
  ☆144Updated 8 years ago
• xupeng / bloomfilter-redis
  Python bloom filter using redis as a shared backend.
  ☆19Updated 7 years ago
• axiak / pybloomfiltermmap
  Fast Python Bloom Filter using Mmap
  ☆739Updated 4 years ago
• elastic / elasticsearch-py-async
  Backend for elasticsearch-py based on python's asyncio module.
  ☆280Updated 2 years ago
• julien-duponchelle / scrapy-graphite
  Output scrapy statistics to graphite/carbon
  ☆54Updated 11 years ago
• ybrs / pydisque
  disque python client
  ☆80Updated 5 years ago
• joseph-fox / python-bloomfilter
  Scalable Bloom Filter implemented in Python
  ☆163Updated last year
• scrapinghub / scrapylib
  Collection of Scrapy utilities (extensions, middlewares, pipelines, etc)
  ☆31Updated 6 years ago
• dfdeshom / scrapy-kafka
  Kafka-based components for Scrapy
  ☆79Updated 6 years ago
• stucchio / Python-LRU-cache
  An in-memory LRU cache for python
  ☆155Updated 3 years ago
• llonchj / scrapy-sentry
  Sentry component for Scrapy
  ☆86Updated last year
• scrapy / w3lib
  Python library of web-related functions
  ☆388Updated 3 months ago
• flisky / scrapy-phantomjs-downloader
  PhantomJS Downloader for Scrapy, Yeah!
  ☆94Updated 10 years ago
• scrapinghub / testspiders
  Useful test spiders for Scrapy
  ☆184Updated 4 years ago
• stephenmcd / hot-redis
  Rich Python data types for Redis
  ☆290Updated 5 months ago
• flier / pyfasthash
  Python Non-cryptographic Hash Library
  ☆280Updated last year
• cnu / scrapy-random-useragent
  Scrapy Middleware to set a random User-Agent for every Request.
  ☆202Updated 5 years ago
• scrapy-plugins / scrapy-jsonrpc
  Scrapy extension to control spiders using JSON-RPC
  ☆295Updated 5 years ago
• eventuallyc0nsistent / arachne
  A flask API for running your scrapy spiders
  ☆128Updated 6 years ago
• ajdavis / motor-blog
  Blog based on Tornado, MongoDB, and Motor. To be used with MarsEdit.
  ☆148Updated 7 years ago
• scrapy-plugins / scrapy-deltafetch
  Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls
  ☆264Updated 2 years ago
• mher / tornado-celery
  Non-blocking Celery client for Tornado
  ☆567Updated 7 years ago
• scrapinghub / aile
  Automatic Item List Extraction
  ☆87Updated 8 years ago
• rbaier / python-urltools
  ☆78Updated this week
• TeamHG-Memex / arachnado
  Web Crawling UI and HTTP API, based on Scrapy and Tornado
  ☆161Updated last year
• scrapinghub / python-simhash
  An efficient simhash implementation for python
  ☆124Updated 4 years ago
• jlhutch / pylru
  A least recently used (LRU) cache for Python
  ☆220Updated 2 months ago
• jonathanslenders / asyncio-redis
  Redis client for Python asyncio (PEP 3156)
  ☆552Updated 4 years ago
• stephan-hof / pyrocksdb
  Python bindings for RocksDB
  ☆150Updated 3 years ago