larribas / dagger
Define sophisticated data pipelines with Python and run them on different distributed systems (such as Argo Workflows).
☆15Updated 7 months ago
Alternatives and similar repositories for dagger:
Users that are interested in dagger are comparing it to the libraries listed below
- ☆21Updated 8 months ago
- 🦀 Online statistics in Rust☆60Updated last year
- Cache the intermediate results of queries on timeseries data in DataFusion.☆17Updated 2 months ago
- Apache Arrow Development Experiments☆14Updated last month
- Arrow, pydantic style☆84Updated 2 years ago
- Coming soon☆59Updated last year
- Robust data transformation tool using SQL☆20Updated 2 years ago
- The Ultimate BI tool☆7Updated 7 months ago
- Framework to build data pipelines declaratively☆48Updated this week
- ☆12Updated this week
- A library for deserializing a variety of file formats directly into numpy arrays☆30Updated last year
- A robust (🐢) and fast (🐇) MLOps tool for managing data and pipelines in Rust (🦀)☆42Updated last week
- Fill Apache Arrow record batches from an ODBC data source in Rust.☆58Updated last week
- Proof Of Concept for python package management without virtualenvs☆28Updated 8 months ago
- DVC GitHub action☆31Updated last month
- Python bindings and arrow integration for the rust object_store crate.☆61Updated 5 months ago
- ☆15Updated last month
- A DuckDB extension to evaluate the Rhai scripting language as part of SQL.☆14Updated last week
- A minimal Python library for Apache Arrow, connecting to the Rust arrow crate☆114Updated this week
- Apache Arrow Ballista Python bindings☆35Updated 11 months ago
- Minimal plugin loading package for polars with optional typegen☆12Updated 2 months ago
- A small, personal PaaS☆13Updated 8 months ago
- A port of the Rust regex library to python for super speed linear matching.☆18Updated last year
- ☆11Updated last year
- Polars plugin for stable hashing functionality☆59Updated last month
- Apache Arrow database client for many databases.☆41Updated this week
- Kedro plugin that extends support for partitioned data processing in Kedro☆10Updated 5 months ago
- Integration of Pydantic with Kedro.☆11Updated 5 months ago
- Your go-to for easy access to a plethora of compression algorithms, all neatly bundled in one simple installation.☆96Updated this week
- Example of using the Apache Arrow C Data Interface between Python and Rust☆22Updated 11 months ago