delta-io / delta-rs
A native Rust library for Delta Lake, with bindings into Python
☆2,308Updated this week
Related projects ⓘ
Alternatives and complementary repositories for delta-rs
- Apache DataFusion Ballista Distributed Query Engine☆1,531Updated this week
- Apache DataFusion SQL Query Engine☆6,251Updated this week
- Official Rust implementation of Apache Arrow☆2,587Updated this week
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,199Updated this week
- Efficient data transformation and modeling framework that is backwards compatible with dbt.☆1,785Updated this week
- Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…☆3,929Updated this week
- Apache DataFusion Comet Spark Accelerator☆816Updated this week
- Fastest library to load data from DB to DataFrames in Rust and Python☆1,995Updated this week
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆366Updated last week
- Open, Multi-modal Catalog for Data & AI☆2,385Updated this week
- Apache Iceberg☆642Updated this week
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,031Updated this week
- dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)☆916Updated this week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,003Updated last month
- Apache PyIceberg☆461Updated this week
- Transmute-free Rust library to work with the Arrow format☆1,064Updated 8 months ago
- An open protocol for secure data sharing☆769Updated this week
- Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.☆1,280Updated this week
- Distributed data engine for Python/SQL designed for the cloud, powered by Rust☆2,306Updated this week
- Distributed stream processing engine in Rust☆3,770Updated this week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆7,578Updated this week
- An Open Standard for lineage metadata collection☆1,758Updated this week
- Making data lake work for time series☆1,136Updated 2 months ago
- Python Stream Processing☆1,543Updated this week
- The Cloud Operational Data Store: use SQL to transform, deliver, and act on fast-changing data.☆5,790Updated this week
- Apache DataFusion Python Bindings☆373Updated this week
- Database connectivity API standard and libraries for Apache Arrow☆382Updated this week
- A composable and fully extensible C++ execution engine library for data management systems.☆3,503Updated this week
- Apache Polaris, the interoperable, open source catalog for Apache Iceberg☆1,129Updated this week
- Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to wr…☆1,833Updated this week