AmineDiro / daskqueueLinks
Distributed persistent Task Queue running on Dask
☆38Updated 2 years ago
Alternatives and similar repositories for daskqueue
Users that are interested in daskqueue are comparing it to the libraries listed below
Sorting:
- Arrow, pydantic style☆84Updated 2 years ago
- A library to use `modal` as a backend for `joblib`.☆29Updated 6 months ago
- Coming soon☆61Updated last year
- Unified Distributed Execution☆55Updated 9 months ago
- A cli for spinning up and managing Ray clusters for the Daft Query Engine.☆13Updated 5 months ago
- Synchronicity lets you interoperate with asynchronous Python APIs.☆121Updated this week
- 🐾 PdpCLI is a pandas DataFrame processing CLI tool which enables you to build a pandas pipeline from a configuration file.☆15Updated last year
- DSL for HTML that targets marimo and more!☆46Updated last month
- Python stream processing for analytics☆40Updated last month
- The DBT of ML, as Aligned describes data dependencies in ML systems, and reduce technical data debt☆60Updated last week
- Python binding for DataFusion☆59Updated 3 years ago
- A Polars plugin for encrypting and decrypting data using AES-GSM-CIV algorithm in Rust☆10Updated 6 months ago
- Slipstream provides a data-flow model to simplify development of stateful streaming applications.☆38Updated 3 months ago
- Python bindings and arrow integration for the rust object_store crate.☆63Updated 11 months ago
- Declarative layer for your database.☆37Updated 2 years ago
- Cloud-agnostic Python API☆60Updated last year
- The open-source Useful SDK. One python decorator in the Useful library allows for full observability of Python functions within an ETL.☆19Updated last year
- Magniv Core - A Python-decorator based job orchestration platform. Avoid responsibility handoffs by abstracting infra and DevOps.☆79Updated last year
- An easy to use rpc framework for enabling fast inter-process, inter-container, or inter-host communication☆66Updated 2 years ago
- Dask integration for Snowflake☆30Updated last week
- Automated, schema-based JSON unpacking to Polars objects☆13Updated last year
- pandas data creation by data classes☆53Updated 7 months ago
- Have UV deal with all your Jupyter deps.☆27Updated 10 months ago
- Function dependencies resolution and execution☆70Updated 5 years ago
- A high-performance data streaming system using DuckDB and Apache Arrow Flight.☆86Updated 5 months ago
- Simple Workflow Framework - Hamilton + Task Queue (RQ or APScheduler) = FlowerPower☆22Updated 2 weeks ago
- Fast approximate joins on string columns for polars dataframes.☆13Updated 9 months ago
- Feature engineering library that helps you keep track of feature dependencies, documentation and schema☆28Updated 3 years ago
- 🦖 A SQL-on-everything Query Engine you can execute over multiple databases and file formats. Query your data, where it lives.☆105Updated this week
- Toolkit for graph-relational data across space and time☆116Updated 10 months ago