scrapy / queuelib
Collection of persistent (disk-based) and non-persistent (memory-based) queues for Python
☆277Updated last month
Alternatives and similar repositories for queuelib:
Users that are interested in queuelib are comparing it to the libraries listed below
- Python library of web-related functions☆405Updated last month
- A simple, immutable URL class with a clean API for interrogation and manipulation.☆293Updated last year
- Python requests like API built on top of Twisted's HTTP client.☆592Updated 2 months ago
- CSS Selectors for Python☆297Updated last week
- aioelasticsearch-py wrapper for asyncio☆137Updated 2 years ago
- Curio + Requests: Async HTTP for Humans☆241Updated 5 years ago
- Backend for elasticsearch-py based on python's asyncio module.☆279Updated 3 years ago
- Multiprocessing Pool Extensions☆424Updated 3 weeks ago
- WSGI middleware for sessions and caching☆535Updated last month
- Distributed locks with Redis and Python☆208Updated 4 years ago
- 🎭 Twisted Deferred Thread backend for Requests.☆417Updated 6 years ago
- Crochet: use Twisted anywhere!☆237Updated 8 months ago
- A Celery like task manager that distributes Asyncio coroutines☆435Updated 4 years ago
- Rich Python data types for Redis☆291Updated last year
- A simple, fast, extensible python library for data validation.☆222Updated 9 months ago
- Easy distributed locks for Python with a choice of backends.☆377Updated last year
- Asyncio strategy for SQLAlchemy.☆298Updated 3 years ago
- Redis client for Python asyncio (PEP 3156)☆552Updated 4 years ago
- Backport of the concurrent.futures package to Python 2.6 and 2.7☆232Updated 2 years ago
- Friendly Python Dates☆189Updated 5 years ago
- A decorator to write coroutine-like spider callbacks.☆109Updated 2 years ago
- A simple distributed queue designed for handling one-off tasks with large sets of tasks☆444Updated 9 years ago
- Redis object mapper for Python☆358Updated 3 weeks ago
- Sentry component for Scrapy☆86Updated last year
- Interfaces for Python☆335Updated 2 months ago
- Mr. Queue - A distributed worker task queue in Python using Redis & gevent☆885Updated last year
- A fast and memory efficient LRU cache for Python☆275Updated 3 weeks ago
- Extracts the top level domain (TLD) from the URL given.☆182Updated last year
- SQLAlchemy support for Tornado☆123Updated 10 months ago
- Python Non-cryptographic Hash Library☆284Updated last year