Alternatives and similar repositories for cluster-pack:

Users that are interested in cluster-pack are comparing it to the libraries listed below

• jcrist / skein
  A tool and library for easily deploying applications on Apache YARN
  ☆143Updated last year
• zero323 / pyspark-stubs
  Apache (Py)Spark type annotations (stub files).
  ☆117Updated 2 years ago
• Ackuq / spark-pit
  Point-in-Time optimizations for Apache Spark
  ☆29Updated last year
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆58Updated last year
• jcrist / hadoop-test-cluster
  Dockerized setup for testing code on realistic hadoop clusters
  ☆27Updated 4 years ago
• zero323 / pyspark-asyncactions
  Asynchronous actions for PySpark
  ☆47Updated 3 years ago
• dask / dask-yarn
  Deploy dask on YARN clusters
  ☆69Updated 8 months ago
• airbnb / sputnik
  ☆63Updated 5 years ago
• SaurabhChawla100 / spark-radiant
  Spark-Radiant is Apache Spark Performance and Cost Optimizer
  ☆25Updated 3 months ago
• acroz / pylivy
  A Python client for Apache Livy, enabling use of remote Apache Spark clusters.
  ☆70Updated 3 years ago
• criteo / tf-yarn
  Train TensorFlow models on YARN in just a few lines of code!
  ☆88Updated last year
• nielsbasjes / splittablegzip
  Splittable Gzip codec for Hadoop
  ☆70Updated last week
• rymurr / flight-spark-source
  ☆105Updated last year
• swan-cern / sparkmonitor
  An extension for Jupyter Lab & Jupyter Notebook to monitor Apache Spark (pyspark) from notebooks
  ☆50Updated last month
• rapidsai / spark-examples
  [ARCHIVED] Moved to github.com/NVIDIA/spark-xgboost-examples
  ☆70Updated 4 years ago
• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆93Updated 4 years ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆224Updated last month
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 4 years ago
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆34Updated 6 months ago
• jupyterhub / yarnspawner
  Spawn JupyterHub single user notebook servers in Hadoop/YARN containers.
  ☆19Updated this week
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆45Updated last year
• feast-dev / feast-spark
  ☆30Updated 2 years ago
• logicalclocks / feature-store-api
  Python - Java/Scala API for the Hopsworks feature store
  ☆54Updated last month
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 5 years ago
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆71Updated 2 years ago
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆89Updated last year
• findify / featury
  Friendly ML feature store
  ☆45Updated 2 years ago
• dremio-hub / dremio-flight-connector
  Dremio Flight connector. Access Dremio using Arrow flight
  ☆40Updated 4 years ago
• japila-books / pyspark-internals
  The Internals of PySpark
  ☆26Updated 3 months ago
• dimajix / flowman
  Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…
  ☆94Updated this week