linkedin / dynoyarn
DynoYARN is a framework to run simulated YARN clusters and workloads for YARN scale testing.
☆59Updated 2 years ago
Alternatives and similar repositories for dynoyarn:
Users that are interested in dynoyarn are comparing it to the libraries listed below
- Performance optimization for Spark running on Kubernetes☆87Updated 4 years ago
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆326Updated last year
- A framework for writing performant user-defined functions (UDFs) that are portable across a variety of engines including Apache Spark, Ap…☆299Updated last year
- The gateway component to make Spark on K8s much easier for Spark users.☆187Updated 2 months ago
- A tool for scale and performance testing of HDFS with a specific focus on the NameNode.☆131Updated last year
- A temporary home for LinkedIn's changes to Apache Iceberg (incubating)☆61Updated 3 months ago
- Kubernetes (K8s) Operator for PrestoDB☆46Updated 3 years ago
- This project provides fully automated one-click experience to create Cloud and Kubernetes environment to run Data Analytics workload like…☆55Updated 2 years ago
- The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them☆135Updated last year
- Cache File System optimized for columnar formats and object stores☆183Updated 2 years ago
- Hive for MR3☆38Updated last month
- Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.☆88Updated last year
- ☆34Updated 4 years ago
- ACID Data Source for Apache Spark based on Hive ACID☆97Updated 3 years ago
- Spark metrics related custom classes and sinks (e.g. Prometheus)☆180Updated 2 years ago
- ☆56Updated last week
- Dione - a Spark and HDFS indexing library☆51Updated last year
- A tool to install, configure and manage Trino installations☆27Updated 3 years ago
- LinkedIn's version of Apache Calcite☆22Updated 4 months ago
- Hive federation service. Enables disparate tables to be concurrently accessed across multiple Hive deployments.☆281Updated last week
- A re-implementation of Hadoop DistCP in Apache Spark☆47Updated last year
- Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…☆120Updated this week
- ☆40Updated last year
- Spark* shuffle plugin for support shuffling data through a remote Hadoop-compatible file system, as opposed to vanilla Spark's local-dis…☆21Updated last year
- An Extensible Data Skipping Framework☆43Updated 2 months ago
- Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.☆37Updated 2 years ago
- Spark Connector to read and write with Pulsar☆113Updated 4 months ago
- ☆79Updated last year
- ☆83Updated this week
- Apache datasketches☆95Updated 2 years ago