Alternatives and similar repositories for scaling-python-with-dask

Users that are interested in scaling-python-with-dask are comparing it to the libraries listed below

• scalingpythonml / scaling-python-with-ray
  Serverless Python with Ray
  ☆58Updated 2 years ago
• delta-incubator / deltatorch
  ☆58Updated last year
• ing-bank / spark-matcher
  Record matching and entity resolution at scale in Spark
  ☆35Updated last year
• dmatrix / ray-core-tutorial
  Introduction to Ray Core Design Patterns and APIs.
  ☆72Updated last year
• stefan-grafberger / mlinspect
  Inspect ML Pipelines in Python in the form of a DAG
  ☆70Updated last year
• linkedin / lambda-learner
  Lambda Learner is a library for iterative incremental training of a class of supervised machine learning models.
  ☆42Updated 2 years ago
• fugue-project / tutorials
  Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…
  ☆114Updated last year
• japila-books / pyspark-internals
  The Internals of PySpark
  ☆26Updated 9 months ago
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆48Updated last year
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• BryanCutler / SparkArrowFlight
  Example for simple Apache Arrow Flight service with Apache Spark and TensorFlow clients
  ☆37Updated 4 years ago
• BauplanLabs / no-jvm-wap-with-iceberg
  A write-audit-publish implementation on a data lake without the JVM
  ☆46Updated last year
• edublancas / ml-testing
  🐍 Material for PyData Global 2021 Presentation: Effective Testing for Machine Learning Projects
  ☆82Updated 3 years ago
• MaxHalford / taxi-demo-rp-mz-rv-rd-st
  🚕 Self-contained demo using Redpanda, Materialize, River, Redis, and Streamlit to predict taxi trip durations
  ☆45Updated 2 years ago
• xdssio / big_data_benchmarks
  big data technologies comparisons for cleaning, manipulating and generally wrangling data in purpose of analysis and machine learning.
  ☆65Updated 5 years ago
• ibis-project / ibis-substrait
  Ibis Substrait Compiler
  ☆105Updated last week
• mlrun / storey
  real-time data + ML pipeline
  ☆54Updated 2 weeks ago
• ibis-project / ibis-ml
  IbisML is a library for building scalable ML pipelines using Ibis.
  ☆116Updated 2 months ago
• logicalclocks / maggy
  Distribution transparent Machine Learning experiments on Apache Spark
  ☆91Updated last year
• jason-jz-zhu / databathing
  ☆22Updated last month
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆46Updated last year
• pola-rs / polars-benchmark
  ☆107Updated 2 weeks ago
• scalingpythonml / scalingpythonml
  Scaling Python Machine Learning
  ☆50Updated 2 years ago
• datafusion-contrib / datafusion-python
  Python binding for DataFusion
  ☆59Updated 3 years ago
• jacopotagliabue / no-ops-machine-learning
  A PaaS End-to-End ML Setup with Metaflow, Serverless and SageMaker.
  ☆37Updated 4 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆60Updated 2 years ago
• modin-project / unidist
  Unified Distributed Execution
  ☆56Updated 11 months ago
• microsoft / ml-wrappers
  A unified wrapper for various ML frameworks - to have one uniform scikit-learn format for predict and predict_proba functions.
  ☆47Updated 8 months ago
• level-vc / useful
  The open-source Useful SDK. One python decorator in the Useful library allows for full observability of Python functions within an ETL.
  ☆19Updated last year
• dmatrix / feast_workshops
  A series of workshop modules introducing Feast feature store.
  ☆19Updated 3 years ago