larribas / daggerLinks
Define sophisticated data pipelines with Python and run them on different distributed systems (such as Argo Workflows).
☆17Updated last year
Alternatives and similar repositories for dagger
Users that are interested in dagger are comparing it to the libraries listed below
Sorting:
- Robust data transformation tool using SQL☆22Updated 3 years ago
- ☆22Updated last year
- Your go-to for easy access to a plethora of compression algorithms, all neatly bundled in one simple installation.☆122Updated 3 months ago
- A robust (🐢) and fast (🐇) MLOps tool for managing data and pipelines in Rust (🦀)☆65Updated last week
- Arrow, pydantic style☆85Updated 3 years ago
- A fast bloom filter implemented by Rust for Python! 10x faster than pybloom!☆107Updated 3 months ago
- A cli for spinning up and managing Ray clusters for the Daft Query Engine.☆14Updated 10 months ago
- 🦖 A SQL-on-everything Query Engine you can execute over multiple databases and file formats. Query your data, where it lives.☆110Updated last week
- Apache Arrow Development Experiments☆25Updated last month
- Apache Arrow Ballista Python bindings☆38Updated last year
- Delta reader for the Ray open-source toolkit for building ML applications☆45Updated last year
- Python binding for DataFusion☆59Updated 3 years ago
- A collection of self-contained fsspec-based filesystems☆18Updated last week
- Sample code to accompany blog post showcasing Arrow Flight SQL running on DuckDB☆36Updated 3 years ago
- Official Python client SDK for Iggy.rs message streaming.☆27Updated 6 months ago
- Fill Apache Arrow record batches from an ODBC data source in Rust.☆75Updated last month
- A Python library to run analytics workloads with the performance of Rust, the flexibility of Python and O(1) cost in moving data between …☆61Updated 4 years ago
- Python bindings and arrow integration for the rust object_store crate.☆64Updated last year
- Embeddable Aggregate Management System for Streams and Queries.☆105Updated last month
- ☆64Updated 2 weeks ago
- A Minimalistic Rust Implementation of Delta Sharing Server.☆95Updated 9 months ago
- Stateful Dataflows tutorials and examples.☆40Updated 5 months ago
- Framework to build data pipelines declaratively☆93Updated 3 weeks ago
- Batteries included CLI, TUI, and server implementations for DataFusion.☆184Updated last month
- Open, Multi-modal Catalog for Data & AI, written in Rust☆85Updated last year
- Fast S3 in Python using Rust☆46Updated 3 years ago
- Blazing-fast JSON Schema inference engine built in Rust☆86Updated last year
- general functions for your data .pipe()-lines.☆17Updated 2 years ago
- Minimal, exact vector search with metadata filtering. Think "Polars for vector search."☆33Updated last month
- Fluvio DuckDB Integration☆20Updated 2 years ago