ray-project / deltacat
A portable Pythonic Data Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to your ML and analytics workloads.
☆206Updated last week
Alternatives and similar repositories for deltacat:
Users that are interested in deltacat are comparing it to the libraries listed below
- Ibis Substrait Compiler☆102Updated this week
- Distributed SQL Query Engine in Python using Ray☆243Updated 7 months ago
- ☆261Updated this week
- An example Flight SQL Server implementation - with DuckDB and SQLite back-ends.☆249Updated 7 months ago
- Apache DataFusion Python Bindings☆448Updated this week
- Apache DataFusion Ray☆188Updated last month
- Ray-based Apache Beam runner☆42Updated last year
- A native Delta implementation for integration with any query engine☆226Updated this week
- Distributed SQL Engine in Python using Dask☆404Updated 8 months ago
- Snowflake bring-your-own-cloud option. Run Snowflake as a microservice on your own compute☆57Updated this week
- ☆40Updated 3 weeks ago
- RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.☆332Updated 2 weeks ago
- deferred computational framework for multi-engine pipelines☆243Updated this week
- Serverless HTAP cloud data platform powered by Arrow × DuckDB × Iceberg☆328Updated 2 years ago
- Open, Multi-modal Catalog for Data & AI, written in Rust☆79Updated 7 months ago
- Database connectivity API standard and libraries for Apache Arrow☆433Updated this week
- A purely experimental DuckDB Deltalake extension☆95Updated 3 weeks ago
- CLI tool to bulk migrate the tables from one catalog another without a data copy☆77Updated 3 weeks ago
- New file format for storage of large columnar datasets.☆538Updated this week
- The Amazon S3 Tables catalog is a client library that bridges control plane operations provided by S3 Tables to engines like Apache Spark…☆114Updated 2 months ago
- BtrBlocks: Efficient Columnar Compression for Data Lakes (SIGMOD 2023 Paper)☆241Updated 3 weeks ago
- A library that provides useful extensions to Apache Spark and PySpark.☆223Updated last month
- Delta reader for the Ray open-source toolkit for building ML applications☆45Updated last year
- A playground for running duckdb as a stateless query engine over a data lake☆198Updated last year
- Point-in-Time optimizations for Apache Spark☆29Updated last year
- Turning PySpark Into a Universal DataFrame API☆390Updated this week
- LST-Bench is a framework that allows users to run benchmarks specifically designed for evaluating Log-Structured Tables (LSTs) such as De…☆75Updated last week
- Rayvens makes it possible for data scientists to access hundreds of data services within Ray with little effort.☆50Updated 2 years ago
- ☆105Updated last year
- Open Control Plane for Tables in Data Lakehouse☆345Updated this week