robdmc / consecution
A pipeline abstraction for Python
☆169Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for consecution
- Lightweight data validation and adaptation Python library.☆262Updated last year
- Nested Object Models in Python with dictionary, YAML, and JSON transformation support☆201Updated last year
- A python library to manipulate and transform indexable data (lists, arrays, ...)☆48Updated 7 months ago
- Concurrent appendable key-value storage☆106Updated 4 months ago
- Amazon S3 filesystem for PyFilesystem2☆154Updated 4 months ago
- Library providing syntactic sugar for creating variant forms of a canonical function☆73Updated 6 years ago
- Python dependency graph for parallel and/or async execution☆15Updated 5 years ago
- Caching based on computation time and storage space☆137Updated 3 years ago
- Distributed process pool for Python☆110Updated 2 years ago
- distributed task queue for asyncio☆90Updated 7 years ago
- Airflow plugin to transfer arbitrary files between operators☆78Updated 6 years ago
- A lightweight Python module for creating and running ordered graphs of computations.☆85Updated last year
- Useful Mutable Mappings☆69Updated last year
- Minimalist dependency injection library for Python that embraces type annotations syntax☆54Updated 6 years ago
- Ridiculously simple flow controller for building complex pipelines☆263Updated last year
- A simple distributed queue designed for handling one-off tasks with large sets of tasks☆446Updated 9 years ago
- persistent caching to memory, disk, or database☆261Updated 3 weeks ago
- Set of basic Python collections backed by Redis☆117Updated 7 months ago
- Carefully crafted library to operate with continuous streams of data in a reactive style with publish/subscribe, asyncio support and brok…☆74Updated 10 months ago
- A light-weight wrapper library around Spotify's Luigi workflow library to make writing scientific workflows more fluent, flexible and mod…☆334Updated last year
- SQL on dataframes - pandas and dask☆64Updated 6 years ago
- 145+ extra higher-level functional tools beyond standard library's `itertools`, `functools`, etc. and popular third-party libraries like …☆161Updated 3 years ago
- Simple python workflow engine based on asyncio and a DAG structure.☆60Updated 7 years ago
- Fluent data pipelines for python and your shell☆193Updated 2 months ago
- Persistent caching for python functions☆85Updated last year
- Plugin for pytest to run IPython notebook cells as unit tests☆99Updated 5 years ago
- Python memoization across program runs.☆111Updated 6 years ago
- Small utility library for coroutine-driven asynchronous generic programming in Python☆202Updated 8 months ago
- Auto-generate Python APIs from JSON schema specifications☆80Updated 5 years ago
- Language defining a data description protocol☆183Updated last year