scrapy / queuelib

Related projects ⓘ

Alternatives and complementary repositories for queuelib

• celery / billiard
  Multiprocessing Pool Extensions
  ☆419Updated 2 months ago
• twisted / treq
  Python requests like API built on top of Twisted's HTTP client.
  ☆588Updated last month
• scrapy / w3lib
  Python library of web-related functions
  ☆392Updated last month
• itamarst / crochet
  Crochet: use Twisted anywhere!
  ☆236Updated 2 months ago
• elastic / elasticsearch-py-async
  Backend for elasticsearch-py based on python's asyncio module.
  ☆280Updated 2 years ago
• seomoz / pyreBloom
  Fast Redis Bloom Filters in Python
  ☆289Updated 5 years ago
• stephenmcd / hot-redis
  Rich Python data types for Redis
  ☆290Updated 7 months ago
• aio-libs / aioelasticsearch
  aioelasticsearch-py wrapper for asyncio
  ☆138Updated last year
• llonchj / scrapy-sentry
  Sentry component for Scrapy
  ☆86Updated last year
• codeinthehole / purl
  A simple, immutable URL class with a clean API for interrogation and manipulation.
  ☆294Updated last year
• siddhantgoel / tornado-sqlalchemy
  SQLAlchemy support for Tornado
  ☆125Updated 5 months ago
• josiahcarlson / rom
  Redis object mapper for Python
  ☆360Updated 4 months ago
• brandicted / scrapy-webdriver
  ☆143Updated 8 years ago
• yahoo / redislite
  Redis in a python module.
  ☆583Updated 3 months ago
• jonathanslenders / asyncio-redis
  Redis client for Python asyncio (PEP 3156)
  ☆553Updated 4 years ago
• rmax / scrapy-inline-requests
  A decorator to write coroutine-like spider callbacks.
  ☆110Updated last year
• pallets-eco / flask-rq
  RQ (Redis Queue) integration for Flask applications
  ☆217Updated 3 months ago
• geventhttpclient / geventhttpclient
  A high performance, concurrent http client library for python with gevent
  ☆549Updated 6 months ago
• scrapy / cssselect
  CSS Selectors for Python
  ☆291Updated last month
• cr0hn / aiotasks
  A Celery like task manager that distributes Asyncio coroutines
  ☆439Updated 4 years ago
• SPSCommerce / redlock-py
  Redis distributed locks in Python
  ☆572Updated 3 years ago
• dfdeshom / scrapy-kafka
  Kafka-based components for Scrapy
  ☆79Updated 6 years ago
• coleifer / walrus
  Lightweight Python utilities for working with Redis
  ☆1,155Updated last month
• pricingassistant / mrq
  Mr. Queue - A distributed worker task queue in Python using Redis & gevent
  ☆877Updated last year
• theelous3 / asks
  Async requests-like httplib for python.
  ☆508Updated 2 years ago
• IlyaSkriblovsky / txredisapi
  non-blocking redis client for python twisted
  ☆235Updated last year
• guyskk / curequests
  Curio + Requests: Async HTTP for Humans
  ☆242Updated 4 years ago
• scrapy-plugins / scrapy-magicfields
  Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.
  ☆56Updated 2 years ago
• py-sherlock / sherlock
  Easy distributed locks for Python with a choice of backends.
  ☆375Updated last year
• MagicStack / vmbench
  Network Server Performance Benchmarking Toolbench
  ☆185Updated 6 years ago