delta-incubator / deltatorchLinks
☆58Updated last year
Alternatives and similar repositories for deltatorch
Users that are interested in deltatorch are comparing it to the libraries listed below
Sorting:
- Delta reader for the Ray open-source toolkit for building ML applications☆46Updated last year
- Shed light on your data layout in order to monitor the health of your Lakehouse tables and identify when data maintenance operations shou…☆10Updated 2 years ago
- Fake Pandas / PySpark DataFrame creator☆48Updated last year
- Delta Acceptance Testing☆20Updated last month
- Kedro Plugin to support running workflows on Kubeflow Pipelines☆55Updated 3 months ago
- A Delta Lake reader for Dask☆53Updated 2 months ago
- Dask integration for Snowflake☆30Updated 2 months ago
- A write-audit-publish implementation on a data lake without the JVM☆46Updated last year
- Read Delta tables without any Spark☆47Updated last year
- Machine Learning Projects with Flytekit☆37Updated 2 years ago
- Unity Catalog UI☆43Updated last year
- Pandas helper functions☆31Updated 2 years ago
- IbisML is a library for building scalable ML pipelines using Ibis.☆116Updated 2 months ago
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆114Updated last year
- Projects developed by Domino's R&D team☆77Updated 3 years ago
- A platform and cloud-based service for data sharing based on the Delta Sharing protocol.☆21Updated last year
- A repo for all spark examples using Rapids Accelerator including ETL, ML/DL, etc.☆160Updated last week
- A Python Library to support running data quality rules while the spark job is running⚡☆188Updated this week
- 🚀 Stream inferences of real-time ML models in production to any data lake (Experimental)☆81Updated 3 years ago
- Pythonic Programming Framework to orchestrate jobs in Databricks Workflow☆219Updated 2 months ago
- Tools for MLflow☆38Updated last year
- Ray-based Apache Beam runner☆41Updated 2 years ago
- real-time data + ML pipeline☆54Updated 2 weeks ago
- JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.☆10Updated 2 years ago
- A portable Pythonic Data Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to …☆242Updated this week
- Chassis turns machine learning models into portable container images that can run just about anywhere.☆86Updated last year
- ☆190Updated last month
- A work-in-progress book on Dask☆12Updated 2 years ago
- ✨ A Pydantic to PySpark schema library☆105Updated last week
- Serverless Python with Ray☆58Updated 2 years ago