delta-io / delta-rs
A native Rust library for Delta Lake, with bindings into Python
☆2,570Updated this week
Alternatives and similar repositories for delta-rs:
Users that are interested in delta-rs are comparing it to the libraries listed below
- Apache DataFusion Ballista Distributed Query Engine☆1,666Updated this week
- Apache DataFusion SQL Query Engine☆6,783Updated this week
- Distributed data engine for Python/SQL designed for the cloud, powered by Rust☆2,548Updated this week
- Official Rust implementation of Apache Arrow☆2,764Updated this week
- Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…☆4,191Updated this week
- Apache Iceberg☆825Updated this week
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,252Updated this week
- Apache DataFusion Comet Spark Accelerator☆890Updated this week
- Transmute-free Rust library to work with the Arrow format☆1,061Updated 11 months ago
- Distributed stream processing engine in Rust☆3,968Updated this week
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,132Updated this week
- Efficient data transformation and modeling framework that is backwards compatible with dbt.☆2,087Updated this week
- Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.☆1,400Updated this week
- Apache PyIceberg☆602Updated this week
- Lakekeeper: A Rust native Iceberg REST Catalog☆451Updated this week
- An open protocol for secure data sharing☆807Updated this week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,040Updated 5 months ago
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆390Updated 3 weeks ago
- Python Stream Processing☆1,643Updated this week
- Open, Multi-modal Catalog for Data & AI☆2,665Updated this week
- Apache Polaris, the interoperable, open source catalog for Apache Iceberg☆1,346Updated this week
- Apache DataFusion Python Bindings☆414Updated this week
- GlareDB: An analytics DBMS for distributed data☆770Updated this week
- LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive (AI) workloads.☆634Updated this week
- dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)☆994Updated this week
- A native Delta implementation for integration with any query engine☆188Updated this week
- Real-time Data Integration and Transformation: use SQL to transform, deliver, and act on fast-changing data.☆5,882Updated this week
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,123Updated this week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆7,822Updated this week
- DuckDB-powered Postgres for high performance apps & analytics.☆1,997Updated this week