delta-io / delta-rsLinks
A native Rust library for Delta Lake, with bindings into Python
☆3,058Updated last week
Alternatives and similar repositories for delta-rs
Users that are interested in delta-rs are comparing it to the libraries listed below
Sorting:
- Apache DataFusion Ballista Distributed Query Engine☆1,923Updated last week
- Apache DataFusion SQL Query Engine☆8,163Updated this week
- PyIceberg☆965Updated this week
- Apache Iceberg☆1,172Updated this week
- Official Rust implementation of Apache Arrow☆3,279Updated this week
- Apache DataFusion Comet Spark Accelerator☆1,086Updated this week
- LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive AI workloads.☆1,092Updated this week
- Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data ve…☆5,835Updated this week
- High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale☆5,020Updated this week
- Lakekeeper is an Apache-Licensed, secure, fast and easy to use Apache Iceberg REST Catalog written in Rust.☆1,096Updated this week
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,381Updated this week
- Open, Multi-modal Catalog for Data & AI☆3,221Updated this week
- DuckLake is an integrated data lake and catalog format☆2,345Updated this week
- The Auron accelerator for distributed computing framework (e.g., Spark) leverages native vectorized execution to accelerate query process…☆1,662Updated this week
- Apache Polaris, the interoperable, open source catalog for Apache Iceberg☆1,770Updated this week
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,441Updated last week
- Scalable and efficient data transformation framework - backwards compatible with dbt.☆2,817Updated this week
- Python Stream Processing☆1,916Updated 8 months ago
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,512Updated this week
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆424Updated 7 months ago
- Distributed stream processing engine in Rust☆4,714Updated last week
- An extensible, state of the art columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Li…☆2,383Updated this week
- Transmute-free Rust library to work with the Arrow format☆1,069Updated last year
- An open protocol for secure data sharing☆907Updated this week
- Apache DataFusion Python Bindings☆536Updated this week
- dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)☆1,203Updated this week
- A native Delta implementation for integration with any query engine☆304Updated this week
- An Open Standard for lineage metadata collection☆2,228Updated this week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,128Updated 2 weeks ago
- GlareDB: A light and fast SQL database for analytics☆985Updated last month