delta-incubator / deltatorchLinks
☆59Updated 2 years ago
Alternatives and similar repositories for deltatorch
Users that are interested in deltatorch are comparing it to the libraries listed below
Sorting:
- Delta reader for the Ray open-source toolkit for building ML applications☆45Updated last year
- Kedro Plugin to support running workflows on Kubeflow Pipelines☆56Updated 6 months ago
- Machine Learning Projects with Flytekit☆36Updated 2 years ago
- IbisML is a library for building scalable ML pipelines using Ibis.☆119Updated 5 months ago
- Ray-based Apache Beam runner☆42Updated 2 years ago
- Dask integration for Snowflake☆30Updated 5 months ago
- Fake Pandas / PySpark DataFrame creator☆48Updated last year
- 🚀 Stream inferences of real-time ML models in production to any data lake (Experimental)☆81Updated 3 years ago
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆114Updated 2 months ago
- A write-audit-publish implementation on a data lake without the JVM☆45Updated last year
- Shed light on your data layout in order to monitor the health of your Lakehouse tables and identify when data maintenance operations shou…☆10Updated 2 years ago
- Unity Catalog UI☆43Updated last year
- Serverless Python with Ray☆59Updated 3 years ago
- Read Delta tables without any Spark☆47Updated last year
- Supporting materials/code examples for my course in data engineering for machine learning.☆39Updated 3 years ago
- Pythonic Programming Framework to orchestrate jobs in Databricks Workflow☆222Updated last month
- Pandas helper functions☆31Updated 2 years ago
- Scaling Python Machine Learning☆52Updated 2 years ago
- Chassis turns machine learning models into portable container images that can run just about anywhere.☆86Updated last year
- A portable Multimodal Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to you…☆263Updated 2 weeks ago
- Apache Liminals goal is to operationalise the machine learning process, allowing data scientists to quickly transition from a successful …☆145Updated last year
- Python library to run ML/data pipelines on stateless compute infrastructure (that may be ephemeral or serverless). Please see the documen…☆18Updated 2 years ago
- A Delta Lake reader for Dask☆53Updated 5 months ago
- A Python Library to support running data quality rules while the spark job is running⚡☆193Updated last week
- Projects developed by Domino's R&D team☆77Updated 3 years ago
- Flyte Documentation 📖☆84Updated 9 months ago
- Deploy production-grade Metaflow cloud infrastructure on AWS☆70Updated 3 weeks ago
- Distributed XGBoost on Ray☆152Updated last year
- Ingesting data with Pulumi, AWS lambdas and Snowflake in a scalable, fully replayable manner☆71Updated 3 years ago
- Joining the modern data stack with the modern ML stack☆201Updated 2 years ago