larribas / daggerLinks
Define sophisticated data pipelines with Python and run them on different distributed systems (such as Argo Workflows).
☆17Updated last year
Alternatives and similar repositories for dagger
Users that are interested in dagger are comparing it to the libraries listed below
Sorting:
- A cli for spinning up and managing Ray clusters for the Daft Query Engine.☆15Updated 11 months ago
- ☆22Updated last year
- 🦖 A SQL-on-everything Query Engine you can execute over multiple databases and file formats. Query your data, where it lives.☆110Updated last week
- Sample code to accompany blog post showcasing Arrow Flight SQL running on DuckDB☆36Updated 3 years ago
- Apache Arrow Ballista Python bindings☆41Updated last year
- A Minimalistic Rust Implementation of Delta Sharing Server.☆96Updated 10 months ago
- Stateful Dataflows tutorials and examples.☆40Updated last month
- A Delta Lake reader for Dask☆53Updated 6 months ago
- Real-time data processing/feature engineering in Rust, Python and SQL. Tailored for modern AI/ML systems.☆75Updated last week
- ☆17Updated 3 years ago
- Official Python client SDK for Iggy.rs message streaming.☆27Updated 7 months ago
- A robust (🐢) and fast (🐇) MLOps tool for managing data and pipelines in Rust (🦀)☆69Updated 2 weeks ago
- A proof-of-concept repo that attempts to use Apache Superset with a custom ADBC to Arrow Flight SQL SQLAlchemy driver.☆25Updated 2 years ago
- Python data types for the Apache Kafka® Protocol.☆25Updated last week
- Robust data transformation tool using SQL☆22Updated 3 years ago
- Open, Multi-modal Catalog for Data & AI, written in Rust☆86Updated last year
- Arrow, pydantic style☆85Updated 3 years ago
- Python bindings and arrow integration for the rust object_store crate.☆65Updated last year
- Apache Arrow Development Experiments☆25Updated 3 months ago
- A collection of self-contained fsspec-based filesystems☆18Updated last week
- WASM bindings for DataFusion☆31Updated 9 months ago
- ☆117Updated 2 weeks ago
- A leightweight UI for Lakekeeper☆16Updated this week
- Restate SDK for Python☆54Updated 3 weeks ago
- Your go-to for easy access to a plethora of compression algorithms, all neatly bundled in one simple installation.☆121Updated 4 months ago
- A minimal key-value store interface for binary data (maintained fork of simplekv).☆17Updated this week
- Python binding for DataFusion☆59Updated 3 years ago
- Scalable Kubernetes-native implementation of the Open Data Fabric protocol for global collaborative data processing☆22Updated last week
- A minimal Python library for Apache Arrow, connecting to the Rust Arrow crate☆246Updated 3 weeks ago
- Delta reader for the Ray open-source toolkit for building ML applications☆45Updated 2 years ago