Alternatives and similar repositories for scaling-python-with-dask

Users that are interested in scaling-python-with-dask are comparing it to the libraries listed below

• delta-incubator / deltatorch
  ☆59Updated 2 years ago
• scalingpythonml / scaling-python-with-ray
  Serverless Python with Ray
  ☆59Updated 3 years ago
• BryanCutler / SparkArrowFlight
  Example for simple Apache Arrow Flight service with Apache Spark and TensorFlow clients
  ☆37Updated 4 years ago
• fugue-project / tutorials
  Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…
  ☆114Updated 2 months ago
• dmatrix / ray-core-tutorial
  Introduction to Ray Core Design Patterns and APIs.
  ☆74Updated 2 years ago
• ing-bank / spark-matcher
  Record matching and entity resolution at scale in Spark
  ☆36Updated 2 years ago
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆48Updated last year
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated last week
• scalingpythonml / scalingpythonml
  Scaling Python Machine Learning
  ☆53Updated 2 years ago
• BauplanLabs / no-jvm-wap-with-iceberg
  A write-audit-publish implementation on a data lake without the JVM
  ☆45Updated last year
• MrPowers / ceja
  PySpark phonetic and string matching algorithms
  ☆41Updated last year
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆45Updated 2 years ago
• dmatrix / feast_workshops
  A series of workshop modules introducing Feast feature store.
  ☆19Updated 3 years ago
• ibis-project / ibis-substrait
  Ibis Substrait Compiler
  ☆108Updated this week
• linkedin / lambda-learner
  Lambda Learner is a library for iterative incremental training of a class of supervised machine learning models.
  ☆41Updated 2 years ago
• modin-project / unidist
  Unified Distributed Execution
  ☆57Updated last year
• pola-rs / polars-benchmark
  ☆116Updated this week
• projectnessie / nessie-demos
  Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.
  ☆30Updated last week
• ray-project / deltacat
  A portable Multimodal Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to you…
  ☆267Updated last week
• datafusion-contrib / datafusion-python
  Python binding for DataFusion
  ☆59Updated 3 years ago
• josephmachado / cost_effective_data_pipelines
  Cost Efficient Data Pipelines with DuckDB
  ☆61Updated 8 months ago
• NVIDIA / spark-rapids-examples
  A repo for all spark examples using Rapids Accelerator including ETL, ML/DL, etc.
  ☆166Updated this week
• jason-jz-zhu / databathing
  ☆21Updated 5 months ago
• composable-logs / composable-logs
  Python library to run ML/data pipelines on stateless compute infrastructure (that may be ephemeral or serverless). Please see the documen…
  ☆18Updated 2 years ago
• dask-contrib / dask-sql
  Distributed SQL Engine in Python using Dask
  ☆409Updated last year
• ibis-project / ibis-ml
  IbisML is a library for building scalable ML pipelines using Ibis.
  ☆120Updated 6 months ago
• MaterializeInc / mz-hack-day-2022
  Official repo for the Materialize + Redpanda + dbt Hack Day 2022, including a sample project to get everyone started!
  ☆60Updated 3 years ago
• jacopotagliabue / paas-data-ingestion
  Ingesting data with Pulumi, AWS lambdas and Snowflake in a scalable, fully replayable manner
  ☆71Updated 4 years ago
• MrPowers / beavis
  Pandas helper functions
  ☆31Updated 2 years ago
• sfu-db / APIConnectors
  A curated list of example code to collect data from Web APIs using DataPrep.Connector.
  ☆36Updated 2 years ago