AmineDiro / daskqueueLinks
Distributed persistent Task Queue running on Dask
☆38Updated 2 years ago
Alternatives and similar repositories for daskqueue
Users that are interested in daskqueue are comparing it to the libraries listed below
Sorting:
- Arrow, pydantic style☆85Updated 3 years ago
- Function dependencies resolution and execution☆71Updated 5 years ago
- The DBT of ML, as Aligned describes data dependencies in ML systems, and reduce technical data debt☆60Updated last month
- A library to use `modal` as a backend for `joblib`.☆32Updated last year
- Flat files, flat land.☆26Updated this week
- A proof-of-concept repo that attempts to use Apache Superset with a custom ADBC to Arrow Flight SQL SQLAlchemy driver.☆25Updated 2 years ago
- Python binding for DataFusion☆59Updated 3 years ago
- IbisML is a library for building scalable ML pipelines using Ibis.☆120Updated 6 months ago
- Synchronicity lets you interoperate with asynchronous Python APIs.☆134Updated last month
- DSL for HTML that targets marimo and more!☆72Updated 7 months ago
- Vinum is a SQL processor for Python, designed for data analysis workflows and in-memory analytics.☆65Updated 4 years ago
- A high-performance data streaming system using DuckDB and Apache Arrow Flight.☆95Updated 11 months ago
- A place to provide Coiled feedback☆29Updated 11 months ago
- Unified Distributed Execution☆57Updated last year
- A cli for spinning up and managing Ray clusters for the Daft Query Engine.☆15Updated 11 months ago
- Coming soon☆62Updated 2 years ago
- Slipstream provides a data-flow model to simplify development of stateful streaming applications.☆38Updated 4 months ago
- Dask integration for Snowflake☆30Updated 6 months ago
- Magniv Core - A Python-decorator based job orchestration platform. Avoid responsibility handoffs by abstracting infra and DevOps.☆81Updated last year
- Python bindings and arrow integration for the rust object_store crate.☆65Updated last year
- ☆89Updated last year
- Cache the intermediate results of queries on timeseries data in DataFusion.☆19Updated last year
- Your go-to for easy access to a plethora of compression algorithms, all neatly bundled in one simple installation.☆121Updated 4 months ago
- Convert monolithic Jupyter notebooks 📙 into maintainable Ploomber pipelines. 📊☆79Updated last year
- Declarative layer for your database.☆37Updated 2 years ago
- Incremental View Maintenance for Python backends☆21Updated 2 years ago
- Python stream processing for analytics☆41Updated this week
- SQL interface to Pandas☆52Updated 4 years ago
- Fast, resilient and reproducible data analysis with cached SQL queries☆30Updated 2 years ago
- Tools for making Prefect work better for typical data science workflows☆18Updated 3 years ago