AmineDiro / daskqueueLinks
Distributed persistent Task Queue running on Dask
☆38Updated 2 years ago
Alternatives and similar repositories for daskqueue
Users that are interested in daskqueue are comparing it to the libraries listed below
Sorting:
- Arrow, pydantic style☆85Updated 3 years ago
- Python binding for DataFusion☆59Updated 3 years ago
- The DBT of ML, as Aligned describes data dependencies in ML systems, and reduce technical data debt☆60Updated last week
- Unified Distributed Execution☆57Updated last year
- A cli for spinning up and managing Ray clusters for the Daft Query Engine.☆15Updated 11 months ago
- MongoDB integrations for Apache Arrow. Export MongoDB documents to numpy array, parquet files, and pandas dataframes in one line of code.☆113Updated 2 weeks ago
- A library to use `modal` as a backend for `joblib`.☆32Updated 11 months ago
- Function dependencies resolution and execution☆71Updated 5 years ago
- Synchronicity lets you interoperate with asynchronous Python APIs.☆133Updated 2 weeks ago
- Vinum is a SQL processor for Python, designed for data analysis workflows and in-memory analytics.☆65Updated 4 years ago
- Coming soon☆62Updated 2 years ago
- asyncio bridge to the duckdb library☆47Updated 2 years ago
- Prefect integrations for working with Docker☆42Updated last year
- Declarative layer for your database.☆37Updated 2 years ago
- Dask integration for Snowflake☆30Updated 5 months ago
- A proof-of-concept repo that attempts to use Apache Superset with a custom ADBC to Arrow Flight SQL SQLAlchemy driver.☆25Updated 2 years ago
- Magniv Core - A Python-decorator based job orchestration platform. Avoid responsibility handoffs by abstracting infra and DevOps.☆81Updated last year
- Flat files, flat land.☆26Updated this week
- IbisML is a library for building scalable ML pipelines using Ibis.☆120Updated 5 months ago
- Python bindings and arrow integration for the rust object_store crate.☆64Updated last year
- Fast, resilient and reproducible data analysis with cached SQL queries☆30Updated 2 years ago
- A high-performance data streaming system using DuckDB and Apache Arrow Flight.☆95Updated 10 months ago
- Incremental View Maintenance for Python backends☆21Updated 2 years ago
- Run pytest on markdown code fence blocks☆76Updated 9 months ago
- Convert monolithic Jupyter notebooks 📙 into maintainable Ploomber pipelines. 📊☆79Updated last year
- An Python object protocol for projects to interchange data frame-like data without forcing pandas.DataFrame as the intermediary☆15Updated 5 years ago
- SQL interface to Pandas☆52Updated 4 years ago
- DSL for HTML that targets marimo and more!☆70Updated 6 months ago
- Automated Jupyter notebook testing. 📙☆41Updated last year
- ☆23Updated last year