Alternatives and similar repositories for scaling-python-with-dask:

Users that are interested in scaling-python-with-dask are comparing it to the libraries listed below

• BryanCutler / SparkArrowFlight
  Example for simple Apache Arrow Flight service with Apache Spark and TensorFlow clients
  ☆36Updated 4 years ago
• scalingpythonml / scalingpythonml
  Scaling Python Machine Learning
  ☆45Updated last year
• delta-incubator / deltatorch
  ☆55Updated last year
• voltrondata / superset-sqlalchemy-adbc-flight-sql-poc
  A proof-of-concept repo that attempts to use Apache Superset with a custom ADBC to Arrow Flight SQL SQLAlchemy driver.
  ☆23Updated last year
• ibis-project / ibis-ml
  IbisML is a library for building scalable ML pipelines using Ibis.
  ☆104Updated 2 months ago
• wesm / vldb-2019-apache-arrow-workshop
  Materials for Apache Arrow workshop at VLDB 2019
  ☆42Updated 4 years ago
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆45Updated last year
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated 6 months ago
• ibis-project / ibis-substrait
  Ibis Substrait Compiler
  ☆99Updated this week
• datafusion-contrib / datafusion-python
  Python binding for DataFusion
  ☆59Updated 2 years ago
• fugue-project / tutorials
  Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…
  ☆113Updated 11 months ago
• composable-logs / composable-logs
  Python library to run ML/data pipelines on stateless compute infrastructure (that may be ephemeral or serverless). Please see the documen…
  ☆18Updated last year
• ray-project / ray_beam_runner
  Ray-based Apache Beam runner
  ☆43Updated last year
• danhphan / trusted-data-pipeline
  Building 3D Trusted Data Pipelines With Dagster, Dbt, and Duckdb
  ☆20Updated last year
• scalingpythonml / scaling-python-with-ray
  Serverless Python with Ray
  ☆55Updated 2 years ago
• ing-bank / spark-matcher
  Record matching and entity resolution at scale in Spark
  ☆34Updated last year
• dmatrix / feast_workshops
  A series of workshop modules introducing Feast feature store.
  ☆19Updated 2 years ago
• Databeans / lighthouse
  Shed light on your data layout in order to monitor the health of your Lakehouse tables and identify when data maintenance operations shou…
  ☆10Updated last year
• linkedin / lambda-learner
  Lambda Learner is a library for iterative incremental training of a class of supervised machine learning models.
  ☆42Updated last year
• jorgecarleitao / arrowdantic
  Arrow, pydantic style
  ☆82Updated 2 years ago
• dmatrix / ray-core-tutorial
  Introduction to Ray Core Design Patterns and APIs.
  ☆67Updated last year
• BauplanLabs / no-jvm-wap-with-iceberg
  A write-audit-publish implementation on a data lake without the JVM
  ☆46Updated 7 months ago
• substrait-io / duckdb-substrait-extension
  ☆37Updated this week
• PacktPublishing / In-Memory-Analytics-with-Apache-Arrow-
  In-Memory Analytics with Apache Arrow, published by Packt
  ☆96Updated last year
• voltrondata / flight-duckdb-example
  Sample code to accompany blog post showcasing Arrow Flight SQL running on DuckDB
  ☆31Updated 2 years ago
• tdoehmen / duckdq
  ☆27Updated last year
• xdssio / big_data_benchmarks
  big data technologies comparisons for cleaning, manipulating and generally wrangling data in purpose of analysis and machine learning.
  ☆65Updated 4 years ago
• modin-project / unidist
  Unified Distributed Execution
  ☆51Updated 4 months ago
• JoinBoost / JoinBoost
  Train Gradient Boosting and Random Forest with only SQL (VLDB 2023)
  ☆22Updated last year