Alternatives and similar repositories for skein:

Users that are interested in skein are comparing it to the libraries listed below

• dask / dask-yarn
  Deploy dask on YARN clusters
  ☆69Updated 6 months ago
• zero323 / pyspark-stubs
  Apache (Py)Spark type annotations (stub files).
  ☆115Updated 2 years ago
• criteo / cluster-pack
  A library on top of either pex or conda-pack to make your Python code easily available on a cluster
  ☆45Updated 2 months ago
• krishnan-r / sparkmonitor
  Monitor Apache Spark from Jupyter Notebook
  ☆172Updated 2 years ago
• zero323 / pyspark-asyncactions
  Asynchronous actions for PySpark
  ☆47Updated 3 years ago
• criteo / tf-yarn
  Train TensorFlow models on YARN in just a few lines of code!
  ☆88Updated last year
• jupyterhub / yarnspawner
  Spawn JupyterHub single user notebook servers in Hadoop/YARN containers.
  ☆19Updated 2 years ago
• dask / hdfs3
  A wrapper for libhdfs3 to interact with HDFS from Python
  ☆136Updated 4 years ago
• sparklingpandas / sparklingml
  Machine Learning Pipeline Stages for Spark (exposed in Scala/Java + Python)
  ☆74Updated last year
• adtech-labs / spylon-kernel
  Jupyter kernel for scala and spark
  ☆187Updated last year
• adtech-labs / spylon
  Utilities to work with Scala/Java code with py4j
  ☆40Updated last year
• FRosner / drunken-data-quality
  Spark package for checking data quality
  ☆221Updated 4 years ago
• jcrist / hadoop-test-cluster
  Dockerized setup for testing code on realistic hadoop clusters
  ☆27Updated 4 years ago
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆185Updated 2 years ago
• mozilla / jupyter-spark
  Jupyter Notebook extension for Apache Spark integration
  ☆191Updated 4 years ago
• margitaii / pydeequ
  Python API for Deequ
  ☆41Updated 4 years ago
• itsjafer / jupyterlab-sparkmonitor
  JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook
  ☆92Updated 2 years ago
• modelop / hadrian
  Implementations of the Portable Format for Analytics (PFA)
  ☆129Updated 2 years ago
• julioasotodv / spark-df-profiling
  Create HTML profiling reports from Apache Spark DataFrames
  ☆195Updated 5 years ago
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆73Updated 5 years ago
• dc-sics / hopsworks
  HopsWorks - Hadoop for Humans
  ☆117Updated 5 years ago
• acroz / pylivy
  A Python client for Apache Livy, enabling use of remote Apache Spark clusters.
  ☆71Updated 3 years ago
• swan-cern / jupyter-extensions
  Jupyter extensions for SWAN
  ☆58Updated 2 months ago
• malexer / pytest-spark
  pytest plugin to run the tests with support of pyspark
  ☆84Updated 11 months ago
• aseigneurin / spark-ui-proxy
  Lightweight proxy to expose the UI of an Apache Spark cluster that is behind a firewall
  ☆98Updated 4 years ago
• Hydrospheredata / spark-ml-serving
  Spark ML Lib serving library
  ☆48Updated 6 years ago
• svenkreiss / pysparkling
  A pure Python implementation of Apache Spark's RDD and DStream interfaces.
  ☆268Updated 5 months ago
• collectivemedia / spark-ext
  Spark Extension : ML transformers, SQL aggregations, etc that are missing in Apache Spark
  ☆147Updated 9 years ago
• gopro / facets-overview-spark
  Spark Implementation of Google Facets Overview https://github.com/PAIR-code/facets
  ☆54Updated last year
• hammerlab / spree
  Live-updating Spark UI built with Meteor
  ☆190Updated 3 years ago