delta-io / delta-rsLinks
A native Rust library for Delta Lake, with bindings into Python
☆2,850Updated this week
Alternatives and similar repositories for delta-rs
Users that are interested in delta-rs are comparing it to the libraries listed below
Sorting:
- Apache DataFusion Ballista Distributed Query Engine☆1,787Updated last week
- Distributed query engine providing simple and reliable data processing for any modality and scale☆3,064Updated this week
- Apache DataFusion SQL Query Engine☆7,436Updated this week
- Apache Iceberg☆1,008Updated this week
- Official Rust implementation of Apache Arrow☆3,020Updated this week
- Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…☆4,984Updated this week
- Open, Multi-modal Catalog for Data & AI☆2,983Updated 3 weeks ago
- Apache PyIceberg☆799Updated this week
- Apache DataFusion Comet Spark Accelerator☆988Updated this week
- Scalable and efficient data transformation framework - backwards compatible with dbt.☆2,456Updated this week
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,249Updated last week
- Lakekeeper is an Apache-Licensed, secure, fast and easy to use Apache Iceberg REST Catalog written in Rust.☆768Updated this week
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,347Updated this week
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆408Updated 2 months ago
- LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive AI workloads.☆824Updated this week
- An open protocol for secure data sharing☆848Updated 3 weeks ago
- Apache Polaris, the interoperable, open source catalog for Apache Iceberg☆1,580Updated this week
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,355Updated 2 weeks ago
- Distributed stream processing engine in Rust☆4,406Updated 2 weeks ago
- dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)☆1,108Updated last week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,093Updated 3 months ago
- DuckLake is an integrated data lake and catalog format☆1,756Updated last week
- Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.☆1,493Updated this week
- Python Stream Processing☆1,774Updated 3 months ago
- An Open Standard for lineage metadata collection☆2,013Updated this week
- Transmute-free Rust library to work with the Arrow format☆1,061Updated last year
- Apache DataFusion Python Bindings☆464Updated this week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,125Updated last week
- Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to wr…☆2,125Updated last week
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,136Updated this week