NVIDIA / spark-rapids-jni
RAPIDS Accelerator JNI For Apache Spark
☆36Updated this week
Related projects: ⓘ
- User tools for Spark RAPIDS☆49Updated this week
- Spark RAPIDS Benchmarks – benchmark sets and utilities for the RAPIDS Accelerator for Apache Spark☆36Updated 2 weeks ago
- A repo for all spark examples using Rapids Accelerator including ETL, ML/DL, etc.☆118Updated this week
- Spark RAPIDS MLlib – accelerate Apache Spark MLlib with GPUs☆63Updated this week
- Spark RAPIDS plugin - accelerate Apache Spark with GPUs☆785Updated this week
- TPC-DS benchmark kit with some modifications/fixes☆85Updated last month
- Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.☆256Updated last year
- LST-Bench is a framework that allows users to run benchmarks specifically designed for evaluating Log-Structured Tables (LSTs) such as De…☆64Updated last week
- The Internals of Delta Lake☆180Updated last month
- Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.☆37Updated last year
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆82Updated 5 months ago
- Lakehouse storage system benchmark☆64Updated last year
- Apache Spark Kubernetes Operator☆48Updated this week
- ☆75Updated 2 weeks ago
- Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange☆127Updated 2 years ago
- All the things about TPC-DS in Apache Spark☆104Updated last year
- ☆104Updated last year
- Spark* shuffle plugin for support shuffling data through a remote Hadoop-compatible file system, as opposed to vanilla Spark's local-dis…☆20Updated 6 months ago
- The Internals of Spark on Kubernetes☆71Updated 2 years ago
- A tool to get better debug info on spark's memory usage☆42Updated 5 years ago
- An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.☆423Updated 2 years ago
- A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer☆44Updated 10 months ago
- A modular acceleration toolkit for big data analytic engines☆67Updated 4 months ago
- Spark-Radiant is Apache Spark Performance and Cost Optimizer☆25Updated last year
- Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).☆16Updated this week
- A library that provides useful extensions to Apache Spark and PySpark.☆193Updated this week
- Apache Spark - A unified analytics engine for large-scale data processing☆15Updated last year
- A new C++ vectorized database acceleration library aimed to optimizing query engines and data processing systems.☆19Updated this week
- A re-implementation of Hadoop DistCP in Apache Spark☆42Updated 8 months ago
- A S3 Shuffle plugin for Apache Spark to enable elastic scaling for generic Spark workloads.☆37Updated 4 months ago