ray-project / deltacat
A portable Pythonic Data Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to your ML and analytics workloads.
☆195Updated this week
Alternatives and similar repositories for deltacat:
Users that are interested in deltacat are comparing it to the libraries listed below
- Distributed SQL Query Engine in Python using Ray☆244Updated 5 months ago
- Ibis Substrait Compiler☆100Updated this week
- Apache DataFusion Ray☆169Updated last week
- Ray-based Apache Beam runner☆43Updated last year
- Distributed SQL Engine in Python using Dask☆401Updated 6 months ago
- ☆231Updated this week
- Apache DataFusion Python Bindings☆423Updated this week
- An example Flight SQL Server implementation - with DuckDB and SQLite back-ends.☆235Updated 5 months ago
- Ray provider for Apache Airflow☆47Updated last year
- Point-in-Time optimizations for Apache Spark☆29Updated last year
- RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.☆328Updated last week
- The Amazon S3 Tables catalog is a client library that bridges control plane operations provided by S3 Tables to engines like Apache Spark…☆104Updated last month
- BtrBlocks: Efficient Columnar Compression for Data Lakes (SIGMOD 2023 Paper)☆236Updated 10 months ago
- ☆68Updated 2 months ago
- The native Rust implementation for Apache Hudi, with Python API bindings.☆200Updated this week
- Open, Multi-modal Catalog for Data & AI, written in Rust☆78Updated 5 months ago
- New file format for storage of large columnar datasets.☆492Updated this week
- CLI tool to bulk migrate the tables from one catalog another without a data copy☆76Updated 3 weeks ago
- A native Delta implementation for integration with any query engine☆206Updated this week
- Database connectivity API standard and libraries for Apache Arrow☆419Updated this week
- Delta reader for the Ray open-source toolkit for building ML applications☆45Updated last year
- ☆105Updated last year
- ☆27Updated 3 months ago
- DuckDB extension for Delta Lake☆171Updated this week
- Apache DataFusion Benchmarks☆17Updated 4 months ago
- A playground for running duckdb as a stateless query engine over a data lake☆190Updated last year
- Apache DataFusion Comet Spark Accelerator☆918Updated this week
- A Minimalistic Rust Implementation of Delta Sharing Server.☆88Updated this week
- Serverless HTAP cloud data platform powered by Arrow × DuckDB × Iceberg☆323Updated last year
- Rust implementation of Apache Iceberg with integration for Datafusion☆152Updated last week