Alternatives and similar repositories for scaling-python-with-dask

Users that are interested in scaling-python-with-dask are comparing it to the libraries listed below

• delta-incubator / deltatorch
  ☆59Updated 2 years ago
• linkedin / lambda-learner
  Lambda Learner is a library for iterative incremental training of a class of supervised machine learning models.
  ☆41Updated 2 years ago
• dmatrix / ray-core-tutorial
  Introduction to Ray Core Design Patterns and APIs.
  ☆74Updated last year
• ing-bank / spark-matcher
  Record matching and entity resolution at scale in Spark
  ☆36Updated 2 years ago
• BryanCutler / SparkArrowFlight
  Example for simple Apache Arrow Flight service with Apache Spark and TensorFlow clients
  ☆37Updated 4 years ago
• scalingpythonml / scaling-python-with-ray
  Serverless Python with Ray
  ☆59Updated 3 years ago
• datafusion-contrib / datafusion-python
  Python binding for DataFusion
  ☆59Updated 3 years ago
• mlrun / storey
  real-time data + ML pipeline
  ☆53Updated 2 weeks ago
• fugue-project / tutorials
  Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…
  ☆114Updated last month
• ibis-project / ibis-substrait
  Ibis Substrait Compiler
  ☆108Updated 2 weeks ago
• logicalclocks / maggy
  Distribution transparent Machine Learning experiments on Apache Spark
  ☆91Updated last year
• ibis-project / ibis-ml
  IbisML is a library for building scalable ML pipelines using Ibis.
  ☆119Updated 5 months ago
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆45Updated last year
• MrPowers / beavis
  Pandas helper functions
  ☆31Updated 2 years ago
• BauplanLabs / no-jvm-wap-with-iceberg
  A write-audit-publish implementation on a data lake without the JVM
  ☆45Updated last year
• xdssio / big_data_benchmarks
  big data technologies comparisons for cleaning, manipulating and generally wrangling data in purpose of analysis and machine learning.
  ☆65Updated 5 years ago
• edublancas / ml-testing
  🐍 Material for PyData Global 2021 Presentation: Effective Testing for Machine Learning Projects
  ☆82Updated 3 years ago
• stefan-grafberger / mlinspect
  Inspect ML Pipelines in Python in the form of a DAG
  ☆70Updated last year
• NVIDIA / spark-xgboost-examples
  XGBoost GPU accelerated on Spark example applications
  ☆52Updated 3 years ago
• MaxHalford / taxi-demo-rp-mz-rv-rd-st
  🚕 Self-contained demo using Redpanda, Materialize, River, Redis, and Streamlit to predict taxi trip durations
  ☆45Updated 2 years ago
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• flyteorg / flytelab
  Machine Learning Projects with Flytekit
  ☆36Updated 2 years ago
• Spratiher9 / SparkDataset
  Instant search for and access to many datasets in Pyspark.
  ☆34Updated 3 years ago
• dmatrix / feast_workshops
  A series of workshop modules introducing Feast feature store.
  ☆19Updated 3 years ago
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated last year
• MrPowers / ceja
  PySpark phonetic and string matching algorithms
  ☆39Updated last year
• dominodatalab / domino-research
  Projects developed by Domino's R&D team
  ☆77Updated 3 years ago
• ray-project / deltacat
  A portable Multimodal Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to you…
  ☆262Updated last week
• duckdblabs / duckdb-substrait-demo
  ☆17Updated 2 years ago
• ognis1205 / delta-hub
  A platform and cloud-based service for data sharing based on the Delta Sharing protocol.
  ☆21Updated last year