scalingpythonml / scaling-python-with-daskLinks
A work-in-progress book on Dask
☆12Updated 2 years ago
Alternatives and similar repositories for scaling-python-with-dask
Users that are interested in scaling-python-with-dask are comparing it to the libraries listed below
Sorting:
- Serverless Python with Ray☆58Updated 2 years ago
- ☆58Updated last year
- Record matching and entity resolution at scale in Spark☆35Updated last year
- Introduction to Ray Core Design Patterns and APIs.☆72Updated last year
- Inspect ML Pipelines in Python in the form of a DAG☆70Updated last year
- Lambda Learner is a library for iterative incremental training of a class of supervised machine learning models.☆42Updated 2 years ago
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆114Updated last year
- The Internals of PySpark☆26Updated 9 months ago
- Fake Pandas / PySpark DataFrame creator☆48Updated last year
- Read Delta tables without any Spark☆47Updated last year
- Example for simple Apache Arrow Flight service with Apache Spark and TensorFlow clients☆37Updated 4 years ago
- A write-audit-publish implementation on a data lake without the JVM☆46Updated last year
- 🐍 Material for PyData Global 2021 Presentation: Effective Testing for Machine Learning Projects☆82Updated 3 years ago
- 🚕 Self-contained demo using Redpanda, Materialize, River, Redis, and Streamlit to predict taxi trip durations☆45Updated 2 years ago
- big data technologies comparisons for cleaning, manipulating and generally wrangling data in purpose of analysis and machine learning.☆65Updated 5 years ago
- Ibis Substrait Compiler☆105Updated last week
- real-time data + ML pipeline☆54Updated 2 weeks ago
- IbisML is a library for building scalable ML pipelines using Ibis.☆116Updated 2 months ago
- Distribution transparent Machine Learning experiments on Apache Spark☆91Updated last year
- ☆22Updated last month
- Delta reader for the Ray open-source toolkit for building ML applications☆46Updated last year
- ☆107Updated 2 weeks ago
- Scaling Python Machine Learning☆50Updated 2 years ago
- Python binding for DataFusion☆59Updated 3 years ago
- A PaaS End-to-End ML Setup with Metaflow, Serverless and SageMaker.☆37Updated 4 years ago
- A library that brings useful functions from various modern database management systems to Apache Spark☆60Updated 2 years ago
- Unified Distributed Execution☆56Updated 11 months ago
- A unified wrapper for various ML frameworks - to have one uniform scikit-learn format for predict and predict_proba functions.☆47Updated 8 months ago
- The open-source Useful SDK. One python decorator in the Useful library allows for full observability of Python functions within an ETL.☆19Updated last year
- A series of workshop modules introducing Feast feature store.☆19Updated 3 years ago