delta-incubator / deltatorch
☆58Updated last year
Alternatives and similar repositories for deltatorch:
Users that are interested in deltatorch are comparing it to the libraries listed below
- Delta reader for the Ray open-source toolkit for building ML applications☆45Updated last year
- Unity Catalog UI☆40Updated 7 months ago
- Delta Acceptance Testing☆20Updated 9 months ago
- Shed light on your data layout in order to monitor the health of your Lakehouse tables and identify when data maintenance operations shou…☆10Updated last year
- A Delta Lake reader for Dask☆49Updated 7 months ago
- Read Delta tables without any Spark☆47Updated last year
- Kedro Plugin to support running workflows on Kubeflow Pipelines☆53Updated 8 months ago
- A Table format agnostic data sharing framework☆38Updated last year
- A write-audit-publish implementation on a data lake without the JVM☆46Updated 8 months ago
- Dask integration for Snowflake☆30Updated 5 months ago
- Delta Lake helper methods. No Spark dependency.☆23Updated 7 months ago
- Fake Pandas / PySpark DataFrame creator☆46Updated last year
- A Python Library to support running data quality rules while the spark job is running⚡☆186Updated this week
- Point-in-Time optimizations for Apache Spark☆29Updated last year
- ✨ A Pydantic to PySpark schema library☆85Updated this week
- A platform and cloud-based service for data sharing based on the Delta Sharing protocol.☆21Updated 10 months ago
- JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.☆10Updated last year
- Open, Multi-modal Catalog for Data & AI, written in Rust☆79Updated 7 months ago
- IbisML is a library for building scalable ML pipelines using Ibis.☆108Updated 4 months ago
- ☆105Updated last year
- Pythonic Programming Framework to orchestrate jobs in Databricks Workflow☆215Updated last week
- A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.☆23Updated last year
- Machine Learning Projects with Flytekit☆36Updated last year
- PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows☆43Updated 9 months ago
- Projects developed by Domino's R&D team☆76Updated 3 years ago
- Deploy production-grade Metaflow cloud infrastructure on AWS☆67Updated last week
- Delta lake and filesystem helper methods☆51Updated last year
- PySpark schema generator☆42Updated 2 years ago
- Ingesting data with Pulumi, AWS lambdas and Snowflake in a scalable, fully replayable manner☆71Updated 3 years ago
- A Minimalistic Rust Implementation of Delta Sharing Server.☆89Updated last month