ray-project / deltacatLinks
A portable Pythonic Data Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to your ML and analytics workloads.
☆218Updated this week
Alternatives and similar repositories for deltacat
Users that are interested in deltacat are comparing it to the libraries listed below
Sorting:
- Distributed SQL Query Engine in Python using Ray☆243Updated 8 months ago
- Apache DataFusion Ray☆194Updated 2 months ago
- Ibis Substrait Compiler☆102Updated this week
- ☆278Updated last week
- An example Flight SQL Server implementation - with DuckDB and SQLite back-ends.☆250Updated 8 months ago
- Ray-based Apache Beam runner☆42Updated last year
- Apache DataFusion Python Bindings☆455Updated last week
- RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.☆337Updated last month
- Apache DataFusion Benchmarks☆18Updated last month
- A BYOC option for Snowflake workloads☆68Updated this week
- Point-in-Time optimizations for Apache Spark☆30Updated last year
- A native Delta implementation for integration with any query engine☆233Updated this week
- DuckDB extension for Delta Lake☆188Updated last week
- New file format for storage of large columnar datasets.☆556Updated this week
- CLI tool to bulk migrate the tables from one catalog another without a data copy☆77Updated last month
- ☆42Updated last month
- Database connectivity API standard and libraries for Apache Arrow☆450Updated last week
- A purely experimental DuckDB Deltalake extension☆95Updated last week
- Apache Iceberg C++☆81Updated this week
- BtrBlocks: Efficient Columnar Compression for Data Lakes (SIGMOD 2023 Paper)☆243Updated last month
- The Amazon S3 Tables catalog is a client library that bridges control plane operations provided by S3 Tables to engines like Apache Spark…☆123Updated last week
- Serverless HTAP cloud data platform powered by Arrow × DuckDB × Iceberg☆330Updated 2 years ago
- Distributed SQL Engine in Python using Dask☆405Updated 9 months ago
- ☆70Updated 5 months ago
- Open, Multi-modal Catalog for Data & AI, written in Rust☆78Updated 8 months ago
- ☆105Updated last year
- A playground for running duckdb as a stateless query engine over a data lake☆201Updated last year
- Ray provider for Apache Airflow☆48Updated last year
- Lance Namespace Specification is an open specification on top of the storage-based Lance data format to standardize access to a collectio…☆14Updated last week
- The native Rust implementation for Apache Hudi, with Python API bindings.☆220Updated this week