scalingpythonml / scaling-python-with-daskLinks
A work-in-progress book on Dask
☆12Updated 2 years ago
Alternatives and similar repositories for scaling-python-with-dask
Users that are interested in scaling-python-with-dask are comparing it to the libraries listed below
Sorting:
- Lambda Learner is a library for iterative incremental training of a class of supervised machine learning models.☆41Updated 2 years ago
- ☆58Updated last year
- Serverless Python with Ray☆58Updated 3 years ago
- Example for simple Apache Arrow Flight service with Apache Spark and TensorFlow clients☆37Updated 4 years ago
- A software engineering framework to jump start your machine learning projects☆37Updated last year
- Introduction to Ray Core Design Patterns and APIs.☆74Updated last year
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆114Updated 2 weeks ago
- The Internals of PySpark☆27Updated 10 months ago
- real-time data + ML pipeline☆53Updated last month
- Record matching and entity resolution at scale in Spark☆35Updated 2 years ago
- Ibis Substrait Compiler☆105Updated last week
- Delta reader for the Ray open-source toolkit for building ML applications☆45Updated last year
- ☆116Updated last month
- Fake Pandas / PySpark DataFrame creator☆48Updated last year
- FlorDB 🌻☆155Updated last month
- Real-time data processing/feature engineering in Rust and Python. Tailored for modern AI/ML systems.☆72Updated last week
- A portable Multimodal Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to you…☆251Updated this week
- In-Memory Analytics with Apache Arrow, published by Packt☆104Updated last week
- A write-audit-publish implementation on a data lake without the JVM☆45Updated last year
- Apache Arrow Cookbook☆105Updated last month
- Code examples for the Introduction to Kubeflow course☆14Updated 4 years ago
- Distributed SQL Query Engine in Python using Ray☆246Updated last year
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆30Updated last week
- Machine Learning Projects with Flytekit☆36Updated 2 years ago
- ☆22Updated 2 months ago
- Materials for my 2021 NYU class on NLP and ML Systems (Master of Engineering).☆96Updated 2 years ago
- Scaling Python Machine Learning☆50Updated 2 years ago
- IbisML is a library for building scalable ML pipelines using Ibis.☆117Updated 3 months ago
- Joblib Apache Spark Backend☆249Updated 7 months ago
- big data technologies comparisons for cleaning, manipulating and generally wrangling data in purpose of analysis and machine learning.☆65Updated 5 years ago