AmineDiro / daskqueueLinks
Distributed persistent Task Queue running on Dask
☆38Updated 2 years ago
Alternatives and similar repositories for daskqueue
Users that are interested in daskqueue are comparing it to the libraries listed below
Sorting:
- Arrow, pydantic style☆84Updated 2 years ago
- Synchronicity lets you interoperate with asynchronous Python APIs.☆122Updated 3 weeks ago
- Declarative layer for your database.☆37Updated 2 years ago
- A cli for spinning up and managing Ray clusters for the Daft Query Engine.☆13Updated 6 months ago
- Magniv Core - A Python-decorator based job orchestration platform. Avoid responsibility handoffs by abstracting infra and DevOps.☆79Updated last year
- Flat files, flat land.☆26Updated last week
- Prefect integrations for working with Docker☆43Updated last year
- Coming soon☆61Updated last year
- Run pytest on markdown code fence blocks☆72Updated 4 months ago
- A high-performance data streaming system using DuckDB and Apache Arrow Flight.☆86Updated 6 months ago
- asyncio bridge to the duckdb library☆46Updated 2 years ago
- Python extensions for PRQL☆101Updated last week
- The DBT of ML, as Aligned describes data dependencies in ML systems, and reduce technical data debt☆60Updated this week
- Dask integration for Snowflake☆30Updated 2 weeks ago
- Python port of Scramjet framework☆35Updated last year
- 🦖 A SQL-on-everything Query Engine you can execute over multiple databases and file formats. Query your data, where it lives.☆106Updated 2 weeks ago
- A library to use `modal` as a backend for `joblib`.☆29Updated 7 months ago
- Simple Workflow Framework - Hamilton + Task Queue (RQ or APScheduler) = FlowerPower☆22Updated this week
- A DAG Scheduler library written in pure python☆90Updated 5 months ago
- SQL interface to Pandas☆52Updated 3 years ago
- Python binding for DataFusion☆59Updated 3 years ago
- Cloud-agnostic Python API☆60Updated last year
- Slipstream provides a data-flow model to simplify development of stateful streaming applications.☆38Updated 3 weeks ago
- Python bindings and arrow integration for the rust object_store crate.☆63Updated last year
- MongoDB integrations for Apache Arrow. Export MongoDB documents to numpy array, parquet files, and pandas dataframes in one line of code.☆111Updated this week
- key/value store for Python based on Cloudflare workers☆33Updated 2 months ago
- Vinum is a SQL processor for Python, designed for data analysis workflows and in-memory analytics.☆65Updated 4 years ago
- Python stream processing for analytics☆40Updated last month
- The open-source Useful SDK. One python decorator in the Useful library allows for full observability of Python functions within an ETL.☆19Updated last year
- A proof-of-concept repo that attempts to use Apache Superset with a custom ADBC to Arrow Flight SQL SQLAlchemy driver.☆25Updated last year