AmineDiro / daskqueue
Distributed persistent Task Queue running on Dask
☆38Updated 2 years ago
Alternatives and similar repositories for daskqueue:
Users that are interested in daskqueue are comparing it to the libraries listed below
- Declarative layer for your database.☆37Updated 2 years ago
- Slipstream provides a data-flow model to simplify development of stateful streaming applications.☆36Updated 2 weeks ago
- asyncio bridge to the duckdb library☆41Updated 2 years ago
- Arrow, pydantic style☆82Updated 2 years ago
- Versatile Metrics Collection for Python☆19Updated last year
- Cache the intermediate results of queries on timeseries data in DataFusion.☆19Updated 6 months ago
- A collection of self-contained fsspec-based filesystems☆16Updated this week
- Have UV deal with all your Jupyter deps.☆24Updated 8 months ago
- A library to use `modal` as a backend for `joblib`.☆28Updated 3 months ago
- Simple Workflow Framework - Hamilton + APScheduler = FlowerPower☆17Updated last week
- Make Polars DataFrames Generic Types☆15Updated 2 weeks ago
- Flat files, flat land.☆26Updated this week
- Your go-to for easy access to a plethora of compression algorithms, all neatly bundled in one simple installation.☆107Updated 2 weeks ago
- Python binding for DataFusion☆59Updated 2 years ago
- Journeys between the two worlds of Python 🐍 and Rust 🦀☆40Updated this week
- A proof-of-concept repo that attempts to use Apache Superset with a custom ADBC to Arrow Flight SQL SQLAlchemy driver.☆24Updated last year
- Automated, schema-based JSON unpacking to Polars objects☆13Updated last year
- Coming soon☆61Updated last year
- Caching and distributed locks in your applications with just one or two lines. Easy to learn. Fast to code.☆35Updated this week
- Fast and flexible Python JSON parsing (and manipulation!) built on the excellent yyjson project.☆29Updated last week
- Runtime typing introspection tools☆40Updated 3 weeks ago
- A cli for spinning up and managing Ray clusters for the Daft Query Engine.☆11Updated 2 months ago
- ☆89Updated 3 months ago
- Extend typing package functionalities☆59Updated last year
- Deploying a simple FastAPI app to Fly.io >> https://fly-fastapi.fly.dev/docs <<☆14Updated last year
- scraping and querying documents for LLMs☆20Updated last week
- The DBT of ML, as Aligned describes data dependencies in ML systems, and reduce technical data debt☆58Updated this week
- A high-performance data streaming system using DuckDB and Apache Arrow Flight.☆77Updated 2 months ago
- Python bindings and arrow integration for the rust object_store crate.☆64Updated 9 months ago
- A Delta Lake reader for Dask☆49Updated 7 months ago