A tool and library for easily deploying applications on Apache YARN
☆145Mar 12, 2024Updated 2 years ago
Alternatives and similar repositories for skein
Users that are interested in skein are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Deploy dask on YARN clusters☆69Aug 10, 2024Updated last year
- Spawn JupyterHub single user notebook servers in Hadoop/YARN containers.☆19Apr 23, 2025Updated last year
- A library on top of either pex or conda-pack to make your Python code easily available on a cluster☆46Feb 4, 2026Updated 2 months ago
- Train TensorFlow models on YARN in just a few lines of code!☆93Nov 3, 2023Updated 2 years ago
- Dockerized setup for testing code on realistic hadoop clusters☆26Jul 20, 2020Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- TonY is a framework to natively run deep learning frameworks on Apache Hadoop.☆710Oct 14, 2023Updated 2 years ago
- 🔥 binders☆10Mar 4, 2018Updated 8 years ago
- An HDFS backed ContentsManager implementation for Jupyter☆12Apr 8, 2024Updated 2 years ago
- Hadoop utility to compact small files☆18Feb 16, 2026Updated 2 months ago
- Profiler for large-scale distributed java applications (Spark, Scalding, MapReduce, Hive,...) on YARN.☆129Sep 7, 2018Updated 7 years ago
- Streaming and approximate algorithms. WIP, use at own risk.☆27Sep 4, 2025Updated 7 months ago
- Validation and data pipelines made easy!☆12Oct 8, 2019Updated 6 years ago
- Reproducibility for Humans: A lightweight tool to perform reproducible machine learning experiment.☆24Apr 24, 2019Updated 7 years ago
- A wrapper for libhdfs3 to interact with HDFS from Python☆137Feb 9, 2021Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Cylon is a fast, scalable, distributed memory, parallel runtime with a Pandas like DataFrame.☆302Mar 12, 2026Updated last month
- API and command line interface for HDFS☆276Sep 24, 2024Updated last year
- Mirror of https://gerrit.wikimedia.org/g/wikimedia/textcat See https://www.mediawiki.org/wiki/Developer_access for contributing☆11Apr 6, 2026Updated 3 weeks ago
- A Python client for Apache Livy, enabling use of remote Apache Spark clusters.☆71Jan 5, 2022Updated 4 years ago
- Documentation and resources for deploying JupyterHub on Hadoop☆19Jul 16, 2019Updated 6 years ago
- Qubole Sparklens tool for performance tuning Apache Spark☆588Jun 26, 2024Updated last year
- ClickModels for Search Engines Implemented on top of Cython.☆13Jun 9, 2021Updated 4 years ago
- Hops Hadoop is a distribution of Apache Hadoop with distributed metadata.☆324Jan 22, 2026Updated 3 months ago
- A multi-tenant server for securely deploying and managing Dask clusters.☆143Apr 6, 2026Updated 3 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- The deepr module provide abstractions (layers, readers, prepro, metrics, config) to help build tensorflow models on top of tf estimators☆53Nov 10, 2023Updated 2 years ago
- Python module to remove wiki markup text.☆10Jan 15, 2016Updated 10 years ago
- Demo for service oriented application hosted on Hadoop YARN cluster for HA and scheduling☆23Apr 2, 2018Updated 8 years ago
- Base hadoop/spark/bigdata image with advanced config loading scripts.☆11Nov 3, 2020Updated 5 years ago
- A tool for scale and performance testing of HDFS with a specific focus on the NameNode.☆135Jan 11, 2024Updated 2 years ago
- MLeap: Deploy ML Pipelines to Production☆1,535Mar 10, 2026Updated last month
- IPython magic for parallel profiling (like `%time`, but parallel)☆72Jul 17, 2017Updated 8 years ago
- This project is used to capture machine learning pipelines created on top of Spark as OK☆54Nov 1, 2022Updated 3 years ago
- Build and submit workflows to HTCondor in Python☆26Mar 2, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Linkedin's Cruise Control container image built for Koperator (https://github.com/banzaicloud/koperator)☆13Oct 14, 2023Updated 2 years ago
- Utility classes for dense and sparse matrices in JCuda☆11Mar 8, 2019Updated 7 years ago
- ☆24Apr 16, 2020Updated 6 years ago
- Pure python HDFS client: python3.x version☆26Jan 23, 2026Updated 3 months ago
- Apache YuniKorn Core☆1,007Apr 23, 2026Updated last week
- Getting Python Performance with Intel(R) Distribution for Python☆13Jan 25, 2023Updated 3 years ago
- Easy to use library to bring Tensorflow on Apache Spark☆296Oct 11, 2023Updated 2 years ago