delta-incubator / deltatorchLinks
☆58Updated last year
Alternatives and similar repositories for deltatorch
Users that are interested in deltatorch are comparing it to the libraries listed below
Sorting:
- Delta reader for the Ray open-source toolkit for building ML applications☆46Updated last year
- A Delta Lake reader for Dask☆49Updated 8 months ago
- Unity Catalog UI☆40Updated 8 months ago
- Delta Acceptance Testing☆20Updated 10 months ago
- Shed light on your data layout in order to monitor the health of your Lakehouse tables and identify when data maintenance operations shou…☆10Updated last year
- A write-audit-publish implementation on a data lake without the JVM☆46Updated 9 months ago
- Pythonic Programming Framework to orchestrate jobs in Databricks Workflow☆216Updated 3 weeks ago
- A Python Library to support running data quality rules while the spark job is running⚡☆188Updated this week
- IbisML is a library for building scalable ML pipelines using Ibis.☆109Updated 5 months ago
- Scaling Python Machine Learning☆46Updated last year
- Fake Pandas / PySpark DataFrame creator☆47Updated last year
- Read Delta tables without any Spark☆47Updated last year
- Ray-based Apache Beam runner☆42Updated last year
- Machine Learning Projects with Flytekit☆36Updated 2 years ago
- A Table format agnostic data sharing framework☆38Updated last year
- Kedro Plugin to support running workflows on Kubeflow Pipelines☆54Updated 8 months ago
- Open, Multi-modal Catalog for Data & AI, written in Rust☆78Updated 8 months ago
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆113Updated last year
- A Minimalistic Rust Implementation of Delta Sharing Server.☆91Updated 2 months ago
- 🚀 Stream inferences of real-time ML models in production to any data lake (Experimental)☆81Updated 2 years ago
- Example repo to kickstart integration with mlflow pipelines.☆76Updated 2 years ago
- JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.☆10Updated 2 years ago
- Supporting materials/code examples for my course in data engineering for machine learning.☆38Updated 2 years ago
- Deploy production-grade Metaflow cloud infrastructure on AWS☆65Updated last month
- real-time data + ML pipeline☆54Updated this week
- Dask integration for Snowflake☆30Updated 6 months ago
- A repo for all spark examples using Rapids Accelerator including ETL, ML/DL, etc.☆153Updated 2 weeks ago
- PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows☆43Updated 10 months ago
- A platform and cloud-based service for data sharing based on the Delta Sharing protocol.☆21Updated 11 months ago
- Ingesting data with Pulumi, AWS lambdas and Snowflake in a scalable, fully replayable manner☆71Updated 3 years ago