A tool and library for easily deploying applications on Apache YARN
☆145Mar 12, 2024Updated 2 years ago
Alternatives and similar repositories for skein
Users that are interested in skein are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Deploy dask on YARN clusters☆69Aug 10, 2024Updated last year
- Spawn JupyterHub single user notebook servers in Hadoop/YARN containers.☆19Apr 23, 2025Updated last year
- A library on top of either pex or conda-pack to make your Python code easily available on a cluster☆47Feb 4, 2026Updated 5 months ago
- Dockerized setup for testing code on realistic hadoop clusters☆26Jul 20, 2020Updated 6 years ago
- TonY is a framework to natively run deep learning frameworks on Apache Hadoop.☆708Oct 14, 2023Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆12Sep 25, 2024Updated last year
- 🔥 binders☆10Mar 4, 2018Updated 8 years ago
- a project most codes extracting from spark-yarn module make build yarn program more easy☆13Apr 9, 2016Updated 10 years ago
- Hadoop utility to compact small files☆18Feb 16, 2026Updated 5 months ago
- Profiler for large-scale distributed java applications (Spark, Scalding, MapReduce, Hive,...) on YARN.☆129Sep 7, 2018Updated 7 years ago
- Streaming and approximate algorithms. WIP, use at own risk.☆27Sep 4, 2025Updated 10 months ago
- Validation and data pipelines made easy!☆12Oct 8, 2019Updated 6 years ago
- A wrapper for libhdfs3 to interact with HDFS from Python☆137Feb 9, 2021Updated 5 years ago
- Reproducibility for Humans: A lightweight tool to perform reproducible machine learning experiment.☆24Apr 24, 2019Updated 7 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- API and command line interface for HDFS☆276Sep 24, 2024Updated last year
- Cylon is a fast, scalable, distributed memory, parallel runtime with a Pandas like DataFrame.☆303May 26, 2026Updated last month
- Conda packages from flit information☆10Dec 10, 2021Updated 4 years ago
- A Python client for Apache Livy, enabling use of remote Apache Spark clusters.☆71Jan 5, 2022Updated 4 years ago
- A sink to save Spark Structured Streaming DataFrame into Hive table☆23May 7, 2018Updated 8 years ago
- Service for automatically managing and cleaning up unreferenced data☆50Apr 24, 2026Updated 2 months ago
- ClickModels for Search Engines Implemented on top of Cython.☆13Jun 9, 2021Updated 5 years ago
- Qubole Sparklens tool for performance tuning Apache Spark☆592Jun 26, 2024Updated 2 years ago
- Documentation and resources for deploying JupyterHub on Hadoop☆19Jul 16, 2019Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Glint: High performance scala parameter server☆170Jul 20, 2018Updated 8 years ago
- Hops Hadoop is a distribution of Apache Hadoop with distributed metadata.☆324Jan 22, 2026Updated 5 months ago
- A multi-tenant server for securely deploying and managing Dask clusters.☆146Updated this week
- Python module to remove wiki markup text.☆10Jan 15, 2016Updated 10 years ago
- Demo for service oriented application hosted on Hadoop YARN cluster for HA and scheduling☆23Apr 2, 2018Updated 8 years ago
- Terraform provider for hosted Deno APIs☆16Mar 18, 2025Updated last year
- Base hadoop/spark/bigdata image with advanced config loading scripts.☆11Nov 3, 2020Updated 5 years ago
- Koalas: pandas API on Apache Spark☆3,371Mar 20, 2024Updated 2 years ago
- A tool for scale and performance testing of HDFS with a specific focus on the NameNode.☆135Jan 11, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- MLeap: Deploy ML Pipelines to Production☆1,539Jul 10, 2026Updated last week
- IPython magic for parallel profiling (like `%time`, but parallel)☆72Jul 17, 2017Updated 9 years ago
- Utility classes for dense and sparse matrices in JCuda☆11Mar 8, 2019Updated 7 years ago
- ☆24Apr 16, 2020Updated 6 years ago
- Apache Hadoop - Docker distribution based on CentOS 7 and Oracle Java 8☆12Feb 20, 2018Updated 8 years ago
- Easy to use library to bring Tensorflow on Apache Spark☆295Oct 11, 2023Updated 2 years ago
- Centralized configuration management☆26Jun 14, 2017Updated 9 years ago