jcrist / skeinView external linksLinks
A tool and library for easily deploying applications on Apache YARN
☆146Mar 12, 2024Updated last year
Alternatives and similar repositories for skein
Users that are interested in skein are comparing it to the libraries listed below
Sorting:
- Deploy dask on YARN clusters☆69Aug 10, 2024Updated last year
- Spawn JupyterHub single user notebook servers in Hadoop/YARN containers.☆19Apr 23, 2025Updated 9 months ago
- A library on top of either pex or conda-pack to make your Python code easily available on a cluster☆46Feb 4, 2026Updated last week
- Dockerized setup for testing code on realistic hadoop clusters☆26Jul 20, 2020Updated 5 years ago
- Hadoop utility to compact small files☆18Mar 5, 2024Updated last year
- TonY is a framework to natively run deep learning frameworks on Apache Hadoop.☆713Oct 14, 2023Updated 2 years ago
- Kira is an astronomy image processing toolkit implemented with Apache Spark.☆15Feb 9, 2016Updated 10 years ago
- Profiler for large-scale distributed java applications (Spark, Scalding, MapReduce, Hive,...) on YARN.☆128Sep 7, 2018Updated 7 years ago
- Reproducibility for Humans: A lightweight tool to perform reproducible machine learning experiment.☆24Apr 24, 2019Updated 6 years ago
- A JupyterHub authenticator using Kerberos☆12Jul 16, 2019Updated 6 years ago
- ☆13Mar 3, 2025Updated 11 months ago
- Cylon is a fast, scalable, distributed memory, parallel runtime with a Pandas like DataFrame.☆302Feb 4, 2026Updated last week
- A Python client for Apache Livy, enabling use of remote Apache Spark clusters.☆70Jan 5, 2022Updated 4 years ago
- API and command line interface for HDFS☆276Sep 24, 2024Updated last year
- Dask tutorial for PyData DC 2016☆11Oct 7, 2016Updated 9 years ago
- 🔥 binders☆10Mar 4, 2018Updated 7 years ago
- ☆12Jun 23, 2016Updated 9 years ago
- Active learning of GP hyperparameters following Garnett, et al., "Active Learning of Linear Embeddings for Gaussian Processes," (UAI 2014…☆16Aug 4, 2017Updated 8 years ago
- Hops Hadoop is a distribution of Apache Hadoop with distributed metadata.☆320Jan 22, 2026Updated 3 weeks ago
- An opinionated auto-deployer for the Hortonworks Platform☆34Feb 11, 2021Updated 5 years ago
- Getting Python Performance with Intel(R) Distribution for Python☆13Jan 25, 2023Updated 3 years ago
- Python module to remove wiki markup text.☆10Jan 15, 2016Updated 10 years ago
- This project is used to capture machine learning pipelines created on top of Spark as OK☆54Nov 1, 2022Updated 3 years ago
- Qubole Sparklens tool for performance tuning Apache Spark☆589Jun 26, 2024Updated last year
- Glint: High performance scala parameter server☆170Jul 20, 2018Updated 7 years ago
- hanythingondemand provides a set of scripts to easily set up an ad-hoc Hadoop cluster through PBS jobs☆12Jul 2, 2019Updated 6 years ago
- Automatic differentiation with uarray/unumpy.☆16Mar 7, 2021Updated 4 years ago
- A wrapper for libhdfs3 to interact with HDFS from Python☆137Feb 9, 2021Updated 5 years ago
- A multi-tenant server for securely deploying and managing Dask clusters.☆143Feb 2, 2026Updated 2 weeks ago
- Documentation and resources for deploying JupyterHub on Hadoop☆19Jul 16, 2019Updated 6 years ago
- Mirror of Apache MRQL (Incubating)☆17Aug 22, 2017Updated 8 years ago
- Proof-of-concept of a conda package that includes JupyterLab with preinstalled extensions.☆19Nov 18, 2020Updated 5 years ago
- Utility for benchmarking changes in Spark using TPC-DS workloads☆16Jun 3, 2021Updated 4 years ago
- [ARCHIVED] Moved to github.com/NVIDIA/spark-xgboost-examples☆72Jul 15, 2020Updated 5 years ago
- Pandas ExtensionDType/Array backed by Apache Arrow☆232Feb 22, 2023Updated 2 years ago
- Async IPython Magic for Asynchronous Notebook Cell Execution☆22Aug 23, 2022Updated 3 years ago
- JupyterLab extensions developed by Tubi including nteract data explorer, shareable link and deep copy/cut/paste☆19Jan 5, 2023Updated 3 years ago
- Set-oriented Operations in Pandas☆24May 27, 2020Updated 5 years ago
- A tool for scale and performance testing of HDFS with a specific focus on the NameNode.☆134Jan 11, 2024Updated 2 years ago