larribas / daggerLinks
Define sophisticated data pipelines with Python and run them on different distributed systems (such as Argo Workflows).
☆17Updated last year
Alternatives and similar repositories for dagger
Users that are interested in dagger are comparing it to the libraries listed below
Sorting:
- Robust data transformation tool using SQL☆22Updated 2 years ago
- ☆21Updated last year
- Official Python client SDK for Iggy.rs message streaming.☆27Updated 4 months ago
- 🦖 A SQL-on-everything Query Engine you can execute over multiple databases and file formats. Query your data, where it lives.☆109Updated this week
- Arrow, pydantic style☆85Updated 2 years ago
- A cli for spinning up and managing Ray clusters for the Daft Query Engine.☆14Updated 8 months ago
- Stateful Dataflows tutorials and examples.☆40Updated 4 months ago
- Your go-to for easy access to a plethora of compression algorithms, all neatly bundled in one simple installation.☆121Updated last month
- A Minimalistic Rust Implementation of Delta Sharing Server.☆95Updated 7 months ago
- A fast bloom filter implemented by Rust for Python! 10x faster than pybloom!☆105Updated 2 months ago
- Python binding for DataFusion☆59Updated 3 years ago
- A Python library to run analytics workloads with the performance of Rust, the flexibility of Python and O(1) cost in moving data between …☆61Updated 4 years ago
- Apache Arrow Ballista Python bindings☆37Updated last year
- Apache Arrow Development Experiments☆24Updated this week
- Session-based recommender system: Serenade☆82Updated last year
- Scalable Kubernetes-native implementation of the Open Data Fabric protocol for global collaborative data processing☆22Updated last week
- OpenTelemetry Extensions for Python☆12Updated last year
- Python bindings and arrow integration for the rust object_store crate.☆64Updated last year
- Example of using the Apache Arrow C Data Interface between Python and Rust☆24Updated last year
- Apache Arrow and Polars compatible, Rust-first columnar data library for real-time and systems workloads☆20Updated last week
- Minimal, exact vector search with metadata filtering. Think "Polars for vector search."☆32Updated last week
- Cache the intermediate results of queries on timeseries data in DataFusion.☆19Updated last year
- Fill Apache Arrow record batches from an ODBC data source in Rust.☆74Updated 2 weeks ago
- A robust (🐢) and fast (🐇) MLOps tool for managing data and pipelines in Rust (🦀)☆63Updated last month
- A Delta Lake reader for Dask☆53Updated 3 months ago
- ☆58Updated this week
- Fluvio DuckDB Integration☆20Updated 2 years ago
- Open protocol for decentralized exchange and transformation of data☆142Updated last week
- Rust DataFusion Server☆23Updated last week
- Delta reader for the Ray open-source toolkit for building ML applications☆45Updated last year