Alternatives and similar repositories for skein:

Users that are interested in skein are comparing it to the libraries listed below

• criteo / cluster-pack
  A library on top of either pex or conda-pack to make your Python code easily available on a cluster
  ☆45Updated 4 months ago
• dask / dask-yarn
  Deploy dask on YARN clusters
  ☆69Updated 8 months ago
• zero323 / pyspark-stubs
  Apache (Py)Spark type annotations (stub files).
  ☆116Updated 2 years ago
• krishnan-r / sparkmonitor
  Monitor Apache Spark from Jupyter Notebook
  ☆172Updated 2 years ago
• zero323 / pyspark-asyncactions
  Asynchronous actions for PySpark
  ☆47Updated 3 years ago
• Hydrospheredata / spark-ml-serving
  Spark ML Lib serving library
  ☆48Updated 6 years ago
• sparklingpandas / sparklingml
  Machine Learning Pipeline Stages for Spark (exposed in Scala/Java + Python)
  ☆74Updated last year
• modelop / hadrian
  Implementations of the Portable Format for Analytics (PFA)
  ☆128Updated 2 years ago
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆185Updated 2 years ago
• mozilla / jupyter-spark
  Jupyter Notebook extension for Apache Spark integration
  ☆191Updated 4 years ago
• acroz / pylivy
  A Python client for Apache Livy, enabling use of remote Apache Spark clusters.
  ☆70Updated 3 years ago
• swan-cern / jupyter-extensions
  Jupyter extensions for SWAN
  ☆58Updated last week
• jcrist / hadoop-test-cluster
  Dockerized setup for testing code on realistic hadoop clusters
  ☆27Updated 4 years ago
• adtech-labs / spylon-kernel
  Jupyter kernel for scala and spark
  ☆188Updated last year
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆223Updated 3 weeks ago
• CODAIT / aardpfark
  A library for exporting Spark ML models and pipelines to PFA
  ☆54Updated 6 years ago
• adtech-labs / spylon
  Utilities to work with Scala/Java code with py4j
  ☆40Updated last year
• dask / hdfs3
  A wrapper for libhdfs3 to interact with HDFS from Python
  ☆136Updated 4 years ago
• criteo / tf-yarn
  Train TensorFlow models on YARN in just a few lines of code!
  ☆88Updated last year
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 4 years ago
• airbnb / sputnik
  ☆63Updated 5 years ago
• jupyterhub / yarnspawner
  Spawn JupyterHub single user notebook servers in Hadoop/YARN containers.
  ☆19Updated 2 years ago
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆88Updated last year
• rymurr / flight-spark-source
  ☆105Updated last year
• margitaii / pydeequ
  Python API for Deequ
  ☆41Updated 4 years ago
• spotify / zoltar
  Common library for serving TensorFlow, XGBoost and scikit-learn models in production.
  ☆139Updated last year
• xhochy / fletcher
  Pandas ExtensionDType/Array backed by Apache Arrow
  ☆229Updated 2 years ago
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆73Updated 5 years ago
• kawadia / pyspark.test
  Example unit tests for Apache Spark Python scripts using the py.test framework
  ☆84Updated 9 years ago
• svenkreiss / pysparkling
  A pure Python implementation of Apache Spark's RDD and DStream interfaces.
  ☆268Updated 7 months ago