Alternatives and similar repositories for scaling-python-with-dask:

Users that are interested in scaling-python-with-dask are comparing it to the libraries listed below

• ing-bank / spark-matcher
  Record matching and entity resolution at scale in Spark
  ☆34Updated last year
• BryanCutler / SparkArrowFlight
  Example for simple Apache Arrow Flight service with Apache Spark and TensorFlow clients
  ☆36Updated 4 years ago
• scalingpythonml / scalingpythonml
  Scaling Python Machine Learning
  ☆45Updated last year
• edublancas / ml-testing
  🐍 Material for PyData Global 2021 Presentation: Effective Testing for Machine Learning Projects
  ☆81Updated 3 years ago
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆45Updated last year
• delta-incubator / deltatorch
  ☆57Updated last year
• jordanvolz / lolpop
  A software engineering framework to jump start your machine learning projects
  ☆37Updated 10 months ago
• tdoehmen / duckdq
  ☆32Updated last year
• jorgecarleitao / arrowdantic
  Arrow, pydantic style
  ☆82Updated 2 years ago
• ibis-project / ibis-ml
  IbisML is a library for building scalable ML pipelines using Ibis.
  ☆108Updated 4 months ago
• msubzero2000 / bayesian-optimisation-metaflow-optuna
  example how to perform distributed bayesian optimisation (autoML) using optuna on metaflow
  ☆10Updated 3 years ago
• BauplanLabs / no-jvm-wap-with-iceberg
  A write-audit-publish implementation on a data lake without the JVM
  ☆46Updated 8 months ago
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated 7 months ago
• linkedin / lambda-learner
  Lambda Learner is a library for iterative incremental training of a class of supervised machine learning models.
  ☆42Updated last year
• mlrun / storey
  real-time data + ML pipeline
  ☆54Updated 2 weeks ago
• MaxHalford / taxi-demo-rp-mz-rv-rd-st
  🚕 Self-contained demo using Redpanda, Materialize, River, Redis, and Streamlit to predict taxi trip durations
  ☆46Updated 2 years ago
• scalingpythonml / scaling-python-with-ray
  Serverless Python with Ray
  ☆55Updated 2 years ago
• ibis-project / ibis-substrait
  Ibis Substrait Compiler
  ☆102Updated this week
• EthanRosenthal / medium-data-bakeoff
  A python library bakeoff for medium sized datasets
  ☆24Updated last year
• jwills / de4ml
  Supporting materials/code examples for my course in data engineering for machine learning.
  ☆38Updated 2 years ago
• Spratiher9 / SparkDataset
  Instant search for and access to many datasets in Pyspark.
  ☆34Updated 2 years ago
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• MrPowers / beavis
  Pandas helper functions
  ☆30Updated 2 years ago
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆46Updated last year
• wesm / vldb-2019-apache-arrow-workshop
  Materials for Apache Arrow workshop at VLDB 2019
  ☆42Updated 4 years ago
• voltrondata / flight-duckdb-example
  Sample code to accompany blog post showcasing Arrow Flight SQL running on DuckDB
  ☆33Updated 2 years ago
• modin-project / unidist
  Unified Distributed Execution
  ☆51Updated 6 months ago
• xdssio / big_data_benchmarks
  big data technologies comparisons for cleaning, manipulating and generally wrangling data in purpose of analysis and machine learning.
  ☆65Updated 4 years ago
• JoinBoost / JoinBoost
  Train Gradient Boosting and Random Forest with only SQL (VLDB 2023)
  ☆23Updated last year
• dominodatalab / domino-research
  Projects developed by Domino's R&D team
  ☆76Updated 3 years ago