scalingpythonml / scaling-python-with-daskLinks
A work-in-progress book on Dask
☆12Updated 2 years ago
Alternatives and similar repositories for scaling-python-with-dask
Users that are interested in scaling-python-with-dask are comparing it to the libraries listed below
Sorting:
- ☆58Updated last year
- Introduction to Ray Core Design Patterns and APIs.☆73Updated last year
- Example for simple Apache Arrow Flight service with Apache Spark and TensorFlow clients☆37Updated 4 years ago
- real-time data + ML pipeline☆54Updated 3 weeks ago
- 🐍 Material for PyData Global 2021 Presentation: Effective Testing for Machine Learning Projects☆82Updated 3 years ago
- Record matching and entity resolution at scale in Spark☆35Updated last year
- Serverless Python with Ray☆58Updated 3 years ago
- Scaling Python Machine Learning☆50Updated 2 years ago
- Lambda Learner is a library for iterative incremental training of a class of supervised machine learning models.☆42Updated 2 years ago
- Distribution transparent Machine Learning experiments on Apache Spark☆91Updated last year
- Ibis Substrait Compiler☆105Updated last week
- The Internals of PySpark☆26Updated 9 months ago
- A series of workshop modules introducing Feast feature store.☆19Updated 3 years ago
- Abstractions for feature engineering on large graphs of tabular data.☆22Updated last month
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆114Updated last year
- ForML - A development framework and MLOps platform for the lifecycle management of data science projects☆106Updated 2 years ago
- A curated list of example code to collect data from Web APIs using DataPrep.Connector.☆36Updated 2 years ago
- A repo for all spark examples using Rapids Accelerator including ETL, ML/DL, etc.☆163Updated last month
- Distributed XGBoost on Ray☆150Updated last year
- A software engineering framework to jump start your machine learning projects☆37Updated last year
- Delta reader for the Ray open-source toolkit for building ML applications☆45Updated last year
- Materials for my 2021 NYU class on NLP and ML Systems (Master of Engineering).☆96Updated 2 years ago
- 🚕 Self-contained demo using Redpanda, Materialize, River, Redis, and Streamlit to predict taxi trip durations☆45Updated 2 years ago
- A write-audit-publish implementation on a data lake without the JVM☆46Updated last year
- End to End example integrating MLFlow and Seldon Core☆52Updated 4 years ago
- IbisML is a library for building scalable ML pipelines using Ibis.☆117Updated 2 months ago
- Ray-based Apache Beam runner☆41Updated 2 years ago
- Fake Pandas / PySpark DataFrame creator☆48Updated last year
- Projects developed by Domino's R&D team☆77Updated 3 years ago
- Inspect ML Pipelines in Python in the form of a DAG☆70Updated last year