Alternatives and similar repositories for scaling-python-with-dask

Users that are interested in scaling-python-with-dask are comparing it to the libraries listed below

• BryanCutler / SparkArrowFlight
  Example for simple Apache Arrow Flight service with Apache Spark and TensorFlow clients
  ☆37Updated 4 years ago
• ing-bank / spark-matcher
  Record matching and entity resolution at scale in Spark
  ☆35Updated last year
• delta-incubator / deltatorch
  ☆58Updated last year
• dmatrix / ray-core-tutorial
  Introduction to Ray Core Design Patterns and APIs.
  ☆71Updated last year
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆46Updated last year
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated 11 months ago
• fugue-project / tutorials
  Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…
  ☆113Updated last year
• BauplanLabs / no-jvm-wap-with-iceberg
  A write-audit-publish implementation on a data lake without the JVM
  ☆46Updated last year
• linkedin / lambda-learner
  Lambda Learner is a library for iterative incremental training of a class of supervised machine learning models.
  ☆42Updated 2 years ago
• ibis-project / ibis-substrait
  Ibis Substrait Compiler
  ☆104Updated this week
• scalingpythonml / scalingpythonml
  Scaling Python Machine Learning
  ☆47Updated last year
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• datastacktv / kubeflow-introduction
  Code examples for the Introduction to Kubeflow course
  ☆14Updated 4 years ago
• ognis1205 / delta-hub
  A platform and cloud-based service for data sharing based on the Delta Sharing protocol.
  ☆21Updated last year
• jason-jz-zhu / databathing
  ☆22Updated this week
• scalingpythonml / scaling-python-with-ray
  Serverless Python with Ray
  ☆57Updated 2 years ago
• joblib / joblib-spark
  Joblib Apache Spark Backend
  ☆249Updated 4 months ago
• MrPowers / ceja
  PySpark phonetic and string matching algorithms
  ☆39Updated last year
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆48Updated last year
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆60Updated last year
• MrPowers / beavis
  Pandas helper functions
  ☆31Updated 2 years ago
• MaterializeInc / mz-hack-day-2022
  Official repo for the Materialize + Redpanda + dbt Hack Day 2022, including a sample project to get everyone started!
  ☆60Updated 2 years ago
• dmatrix / feast_workshops
  A series of workshop modules introducing Feast feature store.
  ☆19Updated 3 years ago
• projectnessie / nessie-demos
  Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.
  ☆29Updated this week
• danhphan / trusted-data-pipeline
  Building 3D Trusted Data Pipelines With Dagster, Dbt, and Duckdb
  ☆21Updated last year
• japila-books / pyspark-internals
  The Internals of PySpark
  ☆26Updated 7 months ago
• volga-project / volga
  Real-time data processing/feature engineering in Python and Rust. Tailored for modern AI/ML systems.
  ☆62Updated this week
• logicalclocks / maggy
  Distribution transparent Machine Learning experiments on Apache Spark
  ☆91Updated last year
• pdet / duckdb-tutorial
  ☆79Updated 2 years ago
• typedef-ai / fenic
  Build reliable AI and agentic applications with DataFrames
  ☆199Updated this week