ray-project / deltacatLinks
A portable Pythonic Data Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to your ML and analytics workloads.
☆222Updated last week
Alternatives and similar repositories for deltacat
Users that are interested in deltacat are comparing it to the libraries listed below
Sorting:
- Distributed SQL Query Engine in Python using Ray☆243Updated 8 months ago
- Apache DataFusion Ray☆202Updated 2 months ago
- Ibis Substrait Compiler☆103Updated this week
- An example Flight SQL Server implementation - with DuckDB and SQLite back-ends.☆255Updated 8 months ago
- ☆286Updated this week
- Ray-based Apache Beam runner☆42Updated last year
- The Control Plane for Apache Iceberg☆128Updated this week
- New file format for storage of large columnar datasets.☆560Updated this week
- Apache DataFusion Python Bindings☆460Updated this week
- RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.☆339Updated 2 months ago
- Apache Iceberg C++☆87Updated this week
- BtrBlocks: Efficient Columnar Compression for Data Lakes (SIGMOD 2023 Paper)☆245Updated 2 months ago
- Distributed SQL Engine in Python using Dask☆405Updated 9 months ago
- A native Delta implementation for integration with any query engine☆234Updated last week
- ☆42Updated last month
- Lance Namespace Specification is an open specification on top of the storage-based Lance data format to standardize access to a collectio…☆20Updated 3 weeks ago
- Database connectivity API standard and libraries for Apache Arrow☆458Updated this week
- DuckDB extension for Delta Lake☆192Updated last week
- CLI tool to bulk migrate the tables from one catalog another without a data copy☆79Updated 2 months ago
- Point-in-Time optimizations for Apache Spark☆30Updated last year
- LST-Bench is a framework that allows users to run benchmarks specifically designed for evaluating Log-Structured Tables (LSTs) such as De…☆77Updated 2 weeks ago
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆225Updated last week
- ☆105Updated last year
- Pythonic Iceberg REST Catalog☆1Updated last week
- Apache Arrow Flight SQL adapter for PostgreSQL☆90Updated 3 months ago
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆200Updated this week
- Open, Multi-modal Catalog for Data & AI, written in Rust☆80Updated 8 months ago
- declarative, multi-engine data framework☆288Updated this week
- A BYOC option for Snowflake workloads☆77Updated this week
- Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).☆19Updated 4 months ago