All the things about TPC-DS in Apache Spark
☆109Jun 15, 2023Updated 2 years ago
Alternatives and similar repositories for spark-tpcds-datagen
Users that are interested in spark-tpcds-datagen are comparing it to the libraries listed below
Sorting:
- Use the TPC-DS benchmark to test Spark SQL performance☆184Apr 27, 2020Updated 5 years ago
- TPC-DS benchmark kit with some modifications/fixes☆357Apr 16, 2024Updated last year
- Performance optimization for Spark running on Kubernetes☆87Aug 18, 2020Updated 5 years ago
- Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.☆257Feb 21, 2023Updated 3 years ago
- A tool to get better debug info on spark's memory usage☆42Aug 21, 2019Updated 6 years ago
- Running TPC-H on Apache Hive☆41Jul 15, 2019Updated 6 years ago
- Source code for TPCx-BB benchmark for Hive and SparkSQL on scale factor of 300 GB☆10Jun 26, 2018Updated 7 years ago
- Spark cloud integration: tests, cloud committers and more☆20Jan 30, 2025Updated last year
- Port of TPC-DS dsdgen to Java☆22Nov 29, 2022Updated 3 years ago
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆17Jan 4, 2026Updated 2 months ago
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,525Updated this week
- Gluten: Plugin to Boost Trino's Performance☆76Oct 25, 2023Updated 2 years ago
- Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.☆1,039Updated this week
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆335Sep 29, 2023Updated 2 years ago
- Apache Spark TPC-DS benchmark setup with EMR launch setup☆17Jul 11, 2022Updated 3 years ago
- Uniffle is a high performance, general purpose Remote Shuffle Service.☆446Updated this week
- An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.☆431Jan 14, 2022Updated 4 years ago
- Visualize column-level data lineage in Spark SQL☆92May 13, 2022Updated 3 years ago
- Spark Shuffle Optimization with RDMA+AEP☆30May 23, 2023Updated 2 years ago
- Spark Terasort☆121Apr 21, 2023Updated 2 years ago
- TPC-DS Kit for Impala☆170May 20, 2024Updated last year
- ☆23Jan 3, 2025Updated last year
- Rocksdb state storage implementation for Structured Streaming.☆17Oct 21, 2020Updated 5 years ago
- Albis: High-Performance File Format for Big Data Systems☆21Jul 12, 2018Updated 7 years ago
- ☆393Jan 25, 2024Updated 2 years ago
- Enabling Spark Optimization through Cross-stack Monitoring and Visualization☆47Aug 23, 2017Updated 8 years ago
- SparkCube is an open-source project for extremely fast OLAP data analysis. SparkCube is an extension of Apache Spark.☆136Mar 6, 2023Updated 3 years ago
- A library that brings useful functions from various modern database management systems to Apache Spark☆61Sep 4, 2023Updated 2 years ago
- ☆121Updated this week
- Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.☆37Jan 3, 2023Updated 3 years ago
- Benchmark Suite for Apache Spark☆240Apr 12, 2023Updated 2 years ago
- HDFS based on Java implementation as a remote ObjectStore for DataFusion☆10Feb 13, 2024Updated 2 years ago
- ACID Data Source for Apache Spark based on Hive ACID☆96Jul 7, 2021Updated 4 years ago
- Framework for running macro benchmarks in a clustered environment☆25Aug 29, 2022Updated 3 years ago
- ☆32Jan 30, 2026Updated last month
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,310Updated this week
- ☆12Jan 6, 2026Updated 2 months ago
- Scala Algebra System☆17Feb 27, 2026Updated last week
- Secure HDFS Access from Kubernetes☆61Jun 11, 2020Updated 5 years ago