Alternatives and similar repositories for skein

Users that are interested in skein are comparing it to the libraries listed below

• criteo / mlflow-yarn

  View on GitHub
  Backend implementation for running MLFlow projects on Hadoop/YARN.
  ☆11Dec 27, 2022Updated 3 years ago
• jupyterhub / yarnspawner

  View on GitHub
  Spawn JupyterHub single user notebook servers in Hadoop/YARN containers.
  ☆19Apr 23, 2025Updated 9 months ago
• criteo / tf-yarn

  View on GitHub
  Train TensorFlow models on YARN in just a few lines of code!
  ☆93Nov 3, 2023Updated 2 years ago
• criteo / cluster-pack

  View on GitHub
  A library on top of either pex or conda-pack to make your Python code easily available on a cluster
  ☆46Feb 4, 2026Updated last week
• jcrist / hadoop-test-cluster

  View on GitHub
  Dockerized setup for testing code on realistic hadoop clusters
  ☆26Jul 20, 2020Updated 5 years ago
• ExpediaGroup / datasqueeze

  View on GitHub
  Hadoop utility to compact small files
  ☆18Mar 5, 2024Updated last year
• tony-framework / TonY

  View on GitHub
  TonY is a framework to natively run deep learning frameworks on Apache Hadoop.
  ☆713Oct 14, 2023Updated 2 years ago
• BIDS / Kira

  View on GitHub
  Kira is an astronomy image processing toolkit implemented with Apache Spark.
  ☆15Feb 9, 2016Updated 10 years ago
• jcrist / venv-pack

  View on GitHub
  Package virtual environments for redistribution
  ☆46Nov 20, 2022Updated 3 years ago
• criteo / babar

  View on GitHub
  Profiler for large-scale distributed java applications (Spark, Scalding, MapReduce, Hive,...) on YARN.
  ☆128Sep 7, 2018Updated 7 years ago
• sinhrks / daskperiment

  View on GitHub
  Reproducibility for Humans: A lightweight tool to perform reproducible machine learning experiment.
  ☆24Apr 24, 2019Updated 6 years ago
• jcrist / hdfscm

  View on GitHub
  An HDFS backed ContentsManager implementation for Jupyter
  ☆12Apr 8, 2024Updated last year
• jupyterhub / kerberosauthenticator

  View on GitHub
  A JupyterHub authenticator using Kerberos
  ☆12Jul 16, 2019Updated 6 years ago
• MrBr-github / lshca

  View on GitHub
  ☆13Mar 3, 2025Updated 11 months ago
• cylondata / cylon

  View on GitHub
  Cylon is a fast, scalable, distributed memory, parallel runtime with a Pandas like DataFrame.
  ☆302Feb 4, 2026Updated last week
• dask / crick

  View on GitHub
  Streaming and approximate algorithms. WIP, use at own risk.
  ☆27Sep 4, 2025Updated 5 months ago
• acroz / pylivy

  View on GitHub
  A Python client for Apache Livy, enabling use of remote Apache Spark clusters.
  ☆70Jan 5, 2022Updated 4 years ago
• mtth / hdfs

  View on GitHub
  API and command line interface for HDFS
  ☆276Sep 24, 2024Updated last year
• rmgarnett / active_gp_hyperlearning

  View on GitHub
  Active learning of GP hyperparameters following Garnett, et al., "Active Learning of Linear Embeddings for Gaussian Processes," (UAI 2014…
  ☆16Aug 4, 2017Updated 8 years ago
• IntelPython / composability_bench

  View on GitHub
  Show effects of over-subscription and ways to fix that
  ☆16Aug 15, 2024Updated last year
• WillianFuks / pyClickModels

  View on GitHub
  ClickModels for Search Engines Implemented on top of Cython.
  ☆13Jun 9, 2021Updated 4 years ago
• timveil / docker-hadoop

  View on GitHub
  Simple functional examples of running Hadoop + Hive in Docker with Docker Compose
  ☆25Dec 25, 2022Updated 3 years ago
• hopshadoop / hops

  View on GitHub
  Hops Hadoop is a distribution of Apache Hadoop with distributed metadata.
  ☆320Jan 22, 2026Updated 3 weeks ago
• Chaffelson / whoville

  View on GitHub
  An opinionated auto-deployer for the Hortonworks Platform
  ☆34Feb 11, 2021Updated 5 years ago
• fitnr / unwiki

  View on GitHub
  Python module to remove wiki markup text.
  ☆10Jan 15, 2016Updated 10 years ago
• IntelPython / workshop

  View on GitHub
  Getting Python Performance with Intel(R) Distribution for Python
  ☆13Jan 25, 2023Updated 3 years ago
• JohnCoene / shinyscroll

  View on GitHub
  Scroll to an element in Shiny
  ☆22Jul 17, 2020Updated 5 years ago
• mengxr / spark-als

  View on GitHub
  Another, hopefully better, implementation of ALS on Spark
  ☆14May 20, 2015Updated 10 years ago
• TristanBilot / airflow-rbac-roles-cli

  View on GitHub
  A tool to create Airflow RBAC roles with dag-level permissions from cli.
  ☆13Sep 7, 2023Updated 2 years ago
• qubole / sparklens

  View on GitHub
  Qubole Sparklens tool for performance tuning Apache Spark
  ☆589Jun 26, 2024Updated last year
• rjagerman / glint

  View on GitHub
  Glint: High performance scala parameter server
  ☆170Jul 20, 2018Updated 7 years ago
• mindfulmachines / peapod

  View on GitHub
  Dependency and data pipeline management framework for Spark and Scala
  ☆15Apr 8, 2017Updated 8 years ago
• Quansight-Labs / udiff

  View on GitHub
  Automatic differentiation with uarray/unumpy.
  ☆16Mar 7, 2021Updated 4 years ago
• chbrown / awesome-annotation

  View on GitHub
  List of online / computer-based annotation tools
  ☆18Jan 11, 2017Updated 9 years ago
• WhiteFangBuck / CDSW-DL

  View on GitHub
  Set up tools for running a few DL libraries on CDH and CDSW
  ☆17Jul 23, 2020Updated 5 years ago
• apache / incubator-retired-mrql

  View on GitHub
  Mirror of Apache MRQL (Incubating)
  ☆17Aug 22, 2017Updated 8 years ago
• jsugarelli / shinyfilter

  View on GitHub
  Use interdependent filters on table columns in shiny apps as in spreadsheet applications
  ☆17May 10, 2021Updated 4 years ago
• jupyterhub / jupyterhub-on-hadoop

  View on GitHub
  Documentation and resources for deploying JupyterHub on Hadoop
  ☆19Jul 16, 2019Updated 6 years ago
• criteo / garmadon

  View on GitHub
  Java event logs collector for hadoop and frameworks
  ☆41Mar 25, 2025Updated 10 months ago