Alternatives and similar repositories for scaling-python-with-dask

Users that are interested in scaling-python-with-dask are comparing it to the libraries listed below

• ing-bank / spark-matcher
  Record matching and entity resolution at scale in Spark
  ☆35Updated last year
• delta-incubator / deltatorch
  ☆58Updated last year
• linkedin / lambda-learner
  Lambda Learner is a library for iterative incremental training of a class of supervised machine learning models.
  ☆42Updated 2 years ago
• dmatrix / ray-core-tutorial
  Introduction to Ray Core Design Patterns and APIs.
  ☆71Updated last year
• BryanCutler / SparkArrowFlight
  Example for simple Apache Arrow Flight service with Apache Spark and TensorFlow clients
  ☆37Updated 4 years ago
• MaxHalford / taxi-demo-rp-mz-rv-rd-st
  🚕 Self-contained demo using Redpanda, Materialize, River, Redis, and Streamlit to predict taxi trip durations
  ☆45Updated 2 years ago
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated 11 months ago
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆48Updated last year
• scalingpythonml / scaling-python-with-ray
  Serverless Python with Ray
  ☆58Updated 2 years ago
• fugue-project / tutorials
  Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…
  ☆114Updated last year
• japila-books / pyspark-internals
  The Internals of PySpark
  ☆26Updated 8 months ago
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• ray-project / xgboost_ray
  Distributed XGBoost on Ray
  ☆149Updated last year
• volga-project / volga
  Real-time data processing/feature engineering in Python and Rust. Tailored for modern AI/ML systems.
  ☆66Updated this week
• dmatrix / feast_workshops
  A series of workshop modules introducing Feast feature store.
  ☆19Updated 3 years ago
• BauplanLabs / no-jvm-wap-with-iceberg
  A write-audit-publish implementation on a data lake without the JVM
  ☆46Updated last year
• jacopotagliabue / paas-data-ingestion
  Ingesting data with Pulumi, AWS lambdas and Snowflake in a scalable, fully replayable manner
  ☆71Updated 3 years ago
• ibis-project / ibis-ml
  IbisML is a library for building scalable ML pipelines using Ibis.
  ☆115Updated last month
• pola-rs / polars-benchmark
  ☆103Updated this week
• ibis-project / ibis-substrait
  Ibis Substrait Compiler
  ☆105Updated last week
• joblib / joblib-spark
  Joblib Apache Spark Backend
  ☆249Updated 5 months ago
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆46Updated last year
• MrPowers / ceja
  PySpark phonetic and string matching algorithms
  ☆39Updated last year
• ray-project / deltacat
  A portable Pythonic Data Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to …
  ☆238Updated this week
• dominodatalab / domino-research
  Projects developed by Domino's R&D team
  ☆77Updated 3 years ago
• scalingpythonml / scalingpythonml
  Scaling Python Machine Learning
  ☆49Updated 2 years ago
• jwills / de4ml
  Supporting materials/code examples for my course in data engineering for machine learning.
  ☆38Updated 2 years ago
• Affirm / shparkley
  Spark implementation of computing Shapley Values using monte-carlo approximation
  ☆76Updated 2 years ago
• ognis1205 / delta-hub
  A platform and cloud-based service for data sharing based on the Delta Sharing protocol.
  ☆21Updated last year
• NVIDIA / spark-rapids-examples
  A repo for all spark examples using Rapids Accelerator including ETL, ML/DL, etc.
  ☆160Updated 2 weeks ago