ray-project / deltacat
A portable Pythonic Data Catalog API powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to your big data workloads.
☆165Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for deltacat
- Ibis Substrait Compiler☆95Updated this week
- Distributed SQL Query Engine in Python using Ray☆239Updated last month
- ☆159Updated last month
- An example Flight SQL Server implementation - with DuckDB and SQLite back-ends.☆205Updated last month
- Ray-based Apache Beam runner☆42Updated last year
- A native Delta implementation for integration with any query engine☆144Updated this week
- RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.☆315Updated 3 months ago
- Template for DuckDB extensions to help you develop, test and deploy a custom extension☆148Updated last week
- ☆104Updated last year
- Apache DataFusion Ray☆116Updated this week
- Point-in-Time optimizations for Apache Spark☆29Updated 10 months ago
- A purely experimental DuckDB Deltalake extension☆94Updated 2 weeks ago
- Apache DataFusion Python Bindings☆375Updated this week
- Serverless HTAP cloud data platform powered by Arrow × DuckDB × Iceberg☆306Updated last year
- ☆28Updated this week
- CLI tool to bulk migrate the tables from one catalog another without a data copy☆61Updated this week
- Database connectivity API standard and libraries for Apache Arrow☆384Updated this week
- Distributed SQL Engine in Python using Dask☆397Updated 2 months ago
- Open, Multi-modal Catalog for Data & AI, written in Rust☆74Updated last month
- Delta reader for the Ray open-source toolkit for building ML applications☆43Updated 9 months ago
- Apache Arrow Flight SQL adapter for PostgreSQL☆70Updated 2 months ago
- DuckDB extension for Delta Lake☆136Updated last week
- ☆67Updated 2 weeks ago
- Pythonic Iceberg REST Catalog☆67Updated 2 months ago
- Tracking Ray Enhancement Proposals☆49Updated last week
- Rayvens makes it possible for data scientists to access hundreds of data services within Ray with little effort.☆45Updated last year
- Apache PyIceberg☆473Updated this week
- BtrBlocks: Efficient Columnar Compression for Data Lakes (SIGMOD 2023 Paper)☆228Updated 6 months ago
- A Minimalistic Rust Implementation of Delta Sharing Server.☆81Updated 3 months ago