Alternatives and similar repositories for skein:

Users that are interested in skein are comparing it to the libraries listed below

• zero323 / pyspark-stubs
  Apache (Py)Spark type annotations (stub files).
  ☆117Updated 2 years ago
• dask / dask-yarn
  Deploy dask on YARN clusters
  ☆69Updated 9 months ago
• criteo / cluster-pack
  A library on top of either pex or conda-pack to make your Python code easily available on a cluster
  ☆45Updated 5 months ago
• zero323 / pyspark-asyncactions
  Asynchronous actions for PySpark
  ☆47Updated 3 years ago
• krishnan-r / sparkmonitor
  Monitor Apache Spark from Jupyter Notebook
  ☆172Updated 2 years ago
• criteo / tf-yarn
  Train TensorFlow models on YARN in just a few lines of code!
  ☆88Updated last year
• jcrist / hadoop-test-cluster
  Dockerized setup for testing code on realistic hadoop clusters
  ☆27Updated 4 years ago
• itsjafer / jupyterlab-sparkmonitor
  JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook
  ☆92Updated 2 years ago
• adtech-labs / spylon-kernel
  Jupyter kernel for scala and spark
  ☆188Updated last year
• dask / hdfs3
  A wrapper for libhdfs3 to interact with HDFS from Python
  ☆136Updated 4 years ago
• jupyterhub / yarnspawner
  Spawn JupyterHub single user notebook servers in Hadoop/YARN containers.
  ☆19Updated 2 weeks ago
• swan-cern / jupyter-extensions
  Jupyter extensions for SWAN
  ☆58Updated 3 weeks ago
• gateway-experiments / hadoop-yarn-api-python-client
  Python client for Hadoop® YARN API
  ☆109Updated 2 years ago
• Hydrospheredata / spark-ml-serving
  Spark ML Lib serving library
  ☆48Updated 6 years ago
• margitaii / pydeequ
  Python API for Deequ
  ☆41Updated 4 years ago
• adtech-labs / spylon
  Utilities to work with Scala/Java code with py4j
  ☆40Updated last year
• sparklingpandas / sparklingml
  Machine Learning Pipeline Stages for Spark (exposed in Scala/Java + Python)
  ☆74Updated last year
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆185Updated 2 years ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆223Updated last month
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆89Updated last year
• acroz / pylivy
  A Python client for Apache Livy, enabling use of remote Apache Spark clusters.
  ☆70Updated 3 years ago
• saurfang / sparksql-protobuf
  Read SparkSQL parquet file as RDD[Protobuf]
  ☆93Updated 6 years ago
• airbnb / sputnik
  ☆63Updated 5 years ago
• FRosner / drunken-data-quality
  Spark package for checking data quality
  ☆221Updated 5 years ago
• malexer / pytest-spark
  pytest plugin to run the tests with support of pyspark
  ☆86Updated last month
• feast-dev / feast-spark
  ☆30Updated 2 years ago
• swan-cern / sparkmonitor
  An extension for Jupyter Lab & Jupyter Notebook to monitor Apache Spark (pyspark) from notebooks
  ☆50Updated last month
• dc-sics / hopsworks
  HopsWorks - Hadoop for Humans
  ☆117Updated 6 years ago
• deepsense-ai / seahorse
  ☆106Updated 2 years ago
• julioasotodv / spark-df-profiling
  Create HTML profiling reports from Apache Spark DataFrames
  ☆196Updated 5 years ago