larribas / daggerLinks
Define sophisticated data pipelines with Python and run them on different distributed systems (such as Argo Workflows).
☆17Updated last year
Alternatives and similar repositories for dagger
Users that are interested in dagger are comparing it to the libraries listed below
Sorting:
- ☆21Updated last year
- Robust data transformation tool using SQL☆22Updated 2 years ago
- A cli for spinning up and managing Ray clusters for the Daft Query Engine.☆13Updated 7 months ago
- Arrow, pydantic style☆85Updated 2 years ago
- A collection of self-contained fsspec-based filesystems☆18Updated last week
- Delta reader for the Ray open-source toolkit for building ML applications☆46Updated last year
- Apache Arrow Development Experiments☆24Updated 3 months ago
- Your go-to for easy access to a plethora of compression algorithms, all neatly bundled in one simple installation.☆119Updated 2 weeks ago
- 🦖 A SQL-on-everything Query Engine you can execute over multiple databases and file formats. Query your data, where it lives.☆108Updated this week
- Official Python client SDK for Iggy.rs message streaming.☆27Updated 3 months ago
- Python binding for DataFusion☆59Updated 3 years ago
- Stateful Dataflows tutorials and examples.☆39Updated 3 months ago
- A Minimalistic Rust Implementation of Delta Sharing Server.☆93Updated 6 months ago
- OpenTelemetry Extensions for Python☆12Updated 11 months ago
- Rust DataFusion Server☆22Updated this week
- ☆53Updated last week
- A Python library to run analytics workloads with the performance of Rust, the flexibility of Python and O(1) cost in moving data between …☆61Updated 4 years ago
- Beneath is a serverless real-time data platform ⚡️☆84Updated 3 years ago
- Scalable Kubernetes-native implementation of the Open Data Fabric protocol for global collaborative data processing☆21Updated 2 weeks ago
- Apache Arrow Ballista Python bindings☆37Updated last year
- Cache the intermediate results of queries on timeseries data in DataFusion.☆19Updated 11 months ago
- Logging bridge from pyo3 native extension to python☆76Updated last week
- Open protocol for decentralized exchange and transformation of data☆141Updated this week
- Coming soon☆62Updated last year
- ☆23Updated 3 years ago
- A robust (🐢) and fast (🐇) MLOps tool for managing data and pipelines in Rust (🦀)☆63Updated last month
- Minimal, exact vector search with metadata filtering. Think "Polars for vector search."☆30Updated last month
- Python bindings and arrow integration for the rust object_store crate.☆64Updated last year
- A fast bloom filter implemented by Rust for Python! 10x faster than pybloom!☆104Updated last month
- A Delta Lake reader for Dask☆53Updated 2 months ago