Alternatives and similar repositories for scaling-python-with-dask

Users that are interested in scaling-python-with-dask are comparing it to the libraries listed below

• delta-incubator / deltatorch
  ☆58Updated last year
• linkedin / lambda-learner
  Lambda Learner is a library for iterative incremental training of a class of supervised machine learning models.
  ☆42Updated 2 years ago
• BryanCutler / SparkArrowFlight
  Example for simple Apache Arrow Flight service with Apache Spark and TensorFlow clients
  ☆37Updated 4 years ago
• mlrun / storey
  real-time data + ML pipeline
  ☆54Updated this week
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆46Updated last year
• ing-bank / spark-matcher
  Record matching and entity resolution at scale in Spark
  ☆34Updated last year
• dmatrix / ray-core-tutorial
  Introduction to Ray Core Design Patterns and APIs.
  ☆70Updated last year
• fugue-project / tutorials
  Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…
  ☆113Updated last year
• Eventual-Inc / daft-cli
  A cli for spinning up and managing Ray clusters for the Daft Query Engine.
  ☆12Updated 4 months ago
• Spratiher9 / SparkDataset
  Instant search for and access to many datasets in Pyspark.
  ☆34Updated 2 years ago
• jordanvolz / lolpop
  A software engineering framework to jump start your machine learning projects
  ☆37Updated last year
• MaxHalford / taxi-demo-rp-mz-rv-rd-st
  🚕 Self-contained demo using Redpanda, Materialize, River, Redis, and Streamlit to predict taxi trip durations
  ☆46Updated 2 years ago
• MrPowers / beavis
  Pandas helper functions
  ☆31Updated 2 years ago
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated 9 months ago
• jwills / de4ml
  Supporting materials/code examples for my course in data engineering for machine learning.
  ☆38Updated 2 years ago
• scalingpythonml / scalingpythonml
  Scaling Python Machine Learning
  ☆46Updated last year
• dmatrix / feast_workshops
  A series of workshop modules introducing Feast feature store.
  ☆19Updated 3 years ago
• xdssio / big_data_benchmarks
  big data technologies comparisons for cleaning, manipulating and generally wrangling data in purpose of analysis and machine learning.
  ☆65Updated 5 years ago
• tdoehmen / duckdq
  ☆33Updated last year
• ibis-project / ibis-substrait
  Ibis Substrait Compiler
  ☆103Updated this week
• ibis-project / ibis-ml
  IbisML is a library for building scalable ML pipelines using Ibis.
  ☆109Updated 5 months ago
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• edublancas / ml-testing
  🐍 Material for PyData Global 2021 Presentation: Effective Testing for Machine Learning Projects
  ☆81Updated 3 years ago
• delta-incubator / dat
  Delta Acceptance Testing
  ☆20Updated 11 months ago
• MaterializeInc / demos
  Demos of Materialize, the operational data warehouse.
  ☆51Updated 3 months ago
• typedef-ai / fenic
  Build reliable AI and agentic applications with DataFrames
  ☆46Updated this week
• schelterlabs / jenga
  Jenga is an experimentation library that allows data science practititioners and researchers to study the effect of common data corruptio…
  ☆40Updated 2 years ago
• explosion / spacy-ray
  ☄️ Parallel and distributed training with spaCy and Ray
  ☆54Updated last year
• wesm / vldb-2019-apache-arrow-workshop
  Materials for Apache Arrow workshop at VLDB 2019
  ☆42Updated 4 years ago
• Spratiher9 / Sparkora
  Powerful rapid automatic EDA and feature engineering library with a very easy to use API 🌟
  ☆53Updated 3 years ago