ray-project / deltacatLinks
A portable Pythonic Data Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to your ML and analytics workloads.
☆235Updated 3 weeks ago
Alternatives and similar repositories for deltacat
Users that are interested in deltacat are comparing it to the libraries listed below
Sorting:
- Distributed SQL Query Engine in Python using Ray☆244Updated 10 months ago
- Ibis Substrait Compiler☆104Updated this week
- An example Flight SQL Server implementation - with DuckDB and SQLite back-ends.☆267Updated 11 months ago
- ☆302Updated this week
- Distributed SQL Engine in Python using Dask☆407Updated 11 months ago
- Apache DataFusion Ray☆217Updated 2 weeks ago
- Apache DataFusion Python Bindings☆490Updated this week
- ☆48Updated last month
- New file format for storage of large columnar datasets.☆589Updated this week
- Apache DataFusion Benchmarks☆20Updated 4 months ago
- A BYOC option for Snowflake workloads☆88Updated this week
- Database connectivity API standard and libraries for Apache Arrow☆477Updated this week
- Open, Multi-modal Catalog for Data & AI, written in Rust☆81Updated 10 months ago
- Point-in-Time optimizations for Apache Spark☆30Updated last year
- Ray-based Apache Beam runner☆41Updated last year
- RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.☆344Updated last month
- ☆70Updated 7 months ago
- CLI tool to bulk migrate the tables from one catalog another without a data copy☆80Updated 4 months ago
- Serverless HTAP cloud data platform powered by Arrow × DuckDB × Iceberg☆330Updated 2 years ago
- Delta reader for the Ray open-source toolkit for building ML applications☆46Updated last year
- A native Delta implementation for integration with any query engine☆249Updated this week
- Open Control Plane for Tables in Data Lakehouse☆366Updated last week
- Catalog, compose, and ship ML—Python simplicity, SQL scale.☆394Updated this week
- Template for DuckDB extensions to help you develop, test and deploy a custom extension☆215Updated last month
- A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL☆42Updated 11 months ago
- A purely experimental DuckDB Deltalake extension☆95Updated 2 weeks ago
- Proof-of-concept extension combining the delta extension with Unity Catalog☆89Updated last month
- Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!☆233Updated 7 months ago
- The Control Plane for Apache Iceberg.☆335Updated 2 weeks ago
- The Amazon S3 Tables catalog is a client library that bridges control plane operations provided by S3 Tables to engines like Apache Spark…☆137Updated last week