AmineDiro / daskqueue
Distributed Task Queue based Dask
☆38Updated last year
Alternatives and similar repositories for daskqueue:
Users that are interested in daskqueue are comparing it to the libraries listed below
- Declarative layer for your database.☆37Updated 2 years ago
- ☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.☆45Updated last month
- Simple Workflow Framework - Hamilton + APScheduler = FlowerPower☆16Updated this week
- asyncio bridge to the duckdb library☆40Updated 2 years ago
- scraping and querying documents for LLMs☆18Updated 3 months ago
- Magniv Core - A Python-decorator based job orchestration platform. Avoid responsibility handoffs by abstracting infra and DevOps.☆78Updated 9 months ago
- Slipstream provides a data-flow model to simplify development of stateful streaming applications.☆31Updated this week
- A high-performance data streaming system using DuckDB and Apache Arrow Flight.☆76Updated last month
- A collection of self-contained fsspec-based filesystems☆16Updated this week
- Cache the intermediate results of queries on timeseries data in DataFusion.☆19Updated 5 months ago
- Prefect integrations for working with Docker☆43Updated 11 months ago
- Arrow, pydantic style☆82Updated 2 years ago
- Versatile Metrics Collection for Python☆19Updated last year
- ☆89Updated 2 months ago
- Flat files, flat land.☆26Updated this week
- A helm chart for Prefect☆14Updated 4 years ago
- ☆38Updated this week
- A collection of python utility functions☆11Updated 9 months ago
- Cluster tools for running Dask on Databricks☆13Updated 10 months ago
- Prefect integrations interacting with Jupyter.☆20Updated 11 months ago
- Prefect integrations for working with OpenAI.☆34Updated 11 months ago
- Fast Pluggable System☆54Updated 2 weeks ago
- Vinum is a SQL processor for Python, designed for data analysis workflows and in-memory analytics.☆65Updated 3 years ago
- Filter faster, analyze smarter – because your DataFrames deserve it!☆19Updated 6 months ago
- A library to use `modal` as a backend for `joblib`.☆28Updated 3 months ago
- The DBT of ML, as Aligned describes data dependencies in ML systems, and reduce technical data debt☆57Updated 3 weeks ago
- Cloud-agnostic Python API☆60Updated 10 months ago
- Python binding for DataFusion☆59Updated 2 years ago
- Python extensions for PRQL☆99Updated this week
- A proof-of-concept repo that attempts to use Apache Superset with a custom ADBC to Arrow Flight SQL SQLAlchemy driver.☆24Updated last year