AmineDiro / daskqueueLinks
Distributed persistent Task Queue running on Dask
☆38Updated 2 years ago
Alternatives and similar repositories for daskqueue
Users that are interested in daskqueue are comparing it to the libraries listed below
Sorting:
- Declarative layer for your database.☆37Updated 2 years ago
- Slipstream provides a data-flow model to simplify development of stateful streaming applications.☆38Updated 2 months ago
- Arrow, pydantic style☆84Updated 2 years ago
- Simple Workflow Framework - Hamilton + Task Queue (RQ or APScheduler) = FlowerPower☆21Updated 3 weeks ago
- Filter faster, analyze smarter – because your DataFrames deserve it!☆20Updated 9 months ago
- Magniv Core - A Python-decorator based job orchestration platform. Avoid responsibility handoffs by abstracting infra and DevOps.☆79Updated 11 months ago
- scraping and querying documents for LLMs☆22Updated last month
- Prefect integrations for working with Docker☆43Updated last year
- key/value store for Python based on Cloudflare workers☆31Updated 3 weeks ago
- Vinum is a SQL processor for Python, designed for data analysis workflows and in-memory analytics.☆65Updated 4 years ago
- The DBT of ML, as Aligned describes data dependencies in ML systems, and reduce technical data debt☆60Updated 3 weeks ago
- ☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.☆45Updated 4 months ago
- Versatile Metrics Collection for Python☆19Updated last year
- 🦖 A SQL-on-everything Query Engine you can execute over multiple databases and file formats. Query your data, where it lives.☆104Updated this week
- ☆29Updated last year
- Cloud-agnostic Python API☆60Updated last year
- WhyProfiler is a CPU profiler for Jupyter notebook that not only identifies hotspots but can suggest faster alternatives.☆44Updated 3 years ago
- A data pipeline orchestration library for rapid iterative development with automatic cache invalidation allowing users to focus writing t…☆32Updated last week
- A typed string templating library using Pydantic☆30Updated last year
- Python stream processing for analytics☆40Updated last week
- 🐾 PdpCLI is a pandas DataFrame processing CLI tool which enables you to build a pandas pipeline from a configuration file.☆15Updated last year
- A Python wheel containing PostgreSQL☆78Updated 3 years ago
- asyncio bridge to the duckdb library☆43Updated 2 years ago
- Synchronicity lets you interoperate with asynchronous Python APIs.☆119Updated last week
- A high-performance data streaming system using DuckDB and Apache Arrow Flight.☆83Updated 4 months ago
- A DAG Scheduler library written in pure python☆90Updated 3 months ago
- An easy to use rpc framework for enabling fast inter-process, inter-container, or inter-host communication☆66Updated 2 years ago
- Library of Prefect tasks and utilities.☆9Updated 9 months ago
- Kubetools is a tool and processes for developing and deploying microservices to Kubernetes.☆14Updated 6 months ago
- Operator overloading for fast anonymous functions.☆50Updated 3 weeks ago