Alternatives and similar repositories for skein:

Users that are interested in skein are comparing it to the libraries listed below

• dask / dask-yarn
  Deploy dask on YARN clusters
  ☆69Updated 5 months ago
• zero323 / pyspark-stubs
  Apache (Py)Spark type annotations (stub files).
  ☆115Updated 2 years ago
• criteo / cluster-pack
  A library on top of either pex or conda-pack to make your Python code easily available on a cluster
  ☆46Updated last month
• krishnan-r / sparkmonitor
  Monitor Apache Spark from Jupyter Notebook
  ☆172Updated 2 years ago
• zero323 / pyspark-asyncactions
  Asynchronous actions for PySpark
  ☆47Updated 3 years ago
• criteo / tf-yarn
  Train TensorFlow models on YARN in just a few lines of code!
  ☆87Updated last year
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆186Updated last year
• acroz / pylivy
  A Python client for Apache Livy, enabling use of remote Apache Spark clusters.
  ☆71Updated 3 years ago
• adtech-labs / spylon
  Utilities to work with Scala/Java code with py4j
  ☆40Updated last year
• dask / hdfs3
  A wrapper for libhdfs3 to interact with HDFS from Python
  ☆136Updated 3 years ago
• adtech-labs / spylon-kernel
  Jupyter kernel for scala and spark
  ☆187Updated last year
• jcrist / hadoop-test-cluster
  Dockerized setup for testing code on realistic hadoop clusters
  ☆27Updated 4 years ago
• FRosner / drunken-data-quality
  Spark package for checking data quality
  ☆221Updated 4 years ago
• Hydrospheredata / spark-ml-serving
  Spark ML Lib serving library
  ☆48Updated 6 years ago
• mozilla / jupyter-spark
  Jupyter Notebook extension for Apache Spark integration
  ☆191Updated 4 years ago
• swan-cern / jupyter-extensions
  Jupyter extensions for SWAN
  ☆58Updated last month
• malexer / pytest-spark
  pytest plugin to run the tests with support of pyspark
  ☆84Updated 10 months ago
• svenkreiss / pysparkling
  A pure Python implementation of Apache Spark's RDD and DStream interfaces.
  ☆268Updated 4 months ago
• xhochy / fletcher
  Pandas ExtensionDType/Array backed by Apache Arrow
  ☆229Updated last year
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆205Updated last month
• kawadia / pyspark.test
  Example unit tests for Apache Spark Python scripts using the py.test framework
  ☆85Updated 8 years ago
• sparklingpandas / sparklingml
  Machine Learning Pipeline Stages for Spark (exposed in Scala/Java + Python)
  ☆74Updated last year
• margitaii / pydeequ
  Python API for Deequ
  ☆41Updated 4 years ago
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆86Updated 9 months ago
• jupyterhub / yarnspawner
  Spawn JupyterHub single user notebook servers in Hadoop/YARN containers.
  ☆19Updated 2 years ago
• gateway-experiments / hadoop-yarn-api-python-client
  Python client for Hadoop® YARN API
  ☆109Updated 2 years ago
• joblib / joblib-spark
  Joblib Apache Spark Backend
  ☆244Updated 5 months ago
• rapidsai / spark-examples
  [ARCHIVED] Moved to github.com/NVIDIA/spark-xgboost-examples
  ☆70Updated 4 years ago