larribas / daggerLinks
Define sophisticated data pipelines with Python and run them on different distributed systems (such as Argo Workflows).
☆17Updated last year
Alternatives and similar repositories for dagger
Users that are interested in dagger are comparing it to the libraries listed below
Sorting:
- Robust data transformation tool using SQL☆22Updated 3 years ago
- ☆22Updated last year
- A cli for spinning up and managing Ray clusters for the Daft Query Engine.☆14Updated 10 months ago
- Your go-to for easy access to a plethora of compression algorithms, all neatly bundled in one simple installation.☆122Updated 2 months ago
- Arrow, pydantic style☆84Updated 3 years ago
- A fast bloom filter implemented by Rust for Python! 10x faster than pybloom!☆107Updated 3 months ago
- A Minimalistic Rust Implementation of Delta Sharing Server.☆95Updated 9 months ago
- Python binding for DataFusion☆59Updated 3 years ago
- Delta reader for the Ray open-source toolkit for building ML applications☆45Updated last year
- A collection of self-contained fsspec-based filesystems☆18Updated this week
- Stateful Dataflows tutorials and examples.☆40Updated 5 months ago
- OpenTelemetry Extensions for Python☆13Updated last year
- A Delta Lake reader for Dask☆53Updated 4 months ago
- Apache Arrow Ballista Python bindings☆38Updated last year
- 🦖 A SQL-on-everything Query Engine you can execute over multiple databases and file formats. Query your data, where it lives.☆110Updated last week
- Blazing-fast JSON Schema inference engine built in Rust☆86Updated last year
- Official Python client SDK for Iggy.rs message streaming.☆27Updated 5 months ago
- A Python library to run analytics workloads with the performance of Rust, the flexibility of Python and O(1) cost in moving data between …☆61Updated 4 years ago
- A robust (🐢) and fast (🐇) MLOps tool for managing data and pipelines in Rust (🦀)☆65Updated last week
- Python bindings and arrow integration for the rust object_store crate.☆64Updated last year
- Coming soon☆63Updated 2 years ago
- Cache the intermediate results of queries on timeseries data in DataFusion.☆19Updated last year
- Scalable Kubernetes-native implementation of the Open Data Fabric protocol for global collaborative data processing☆22Updated last week
- Session-based recommender system: Serenade☆82Updated last year
- ☆64Updated last week
- A port of the Rust regex library to python for super speed linear matching.☆19Updated 2 years ago
- Ray integration for Dagster☆62Updated this week
- Apache Arrow Development Experiments☆25Updated last month
- A multi-tenant server for securely deploying and managing Dask clusters.☆143Updated 2 weeks ago
- Rust DataFusion Server☆25Updated last week