Use the TPC-DS benchmark to test Spark SQL performance
☆184Apr 27, 2020Updated 5 years ago
Alternatives and similar repositories for spark-tpc-ds-performance-test
Users that are interested in spark-tpc-ds-performance-test are comparing it to the libraries listed below
Sorting:
- All the things about TPC-DS in Apache Spark☆109Jun 15, 2023Updated 2 years ago
- TPC-DS benchmark kit with some modifications/fixes☆357Apr 16, 2024Updated last year
- TPC-H queries in Apache Spark SQL using native DataFrames API☆98Jan 24, 2024Updated 2 years ago
- ☆393Jan 25, 2024Updated 2 years ago
- ☆23May 12, 2018Updated 7 years ago
- Spark Terasort☆121Apr 21, 2023Updated 2 years ago
- Benchmark Suite for Apache Spark☆240Apr 12, 2023Updated 2 years ago
- Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.☆37Jan 3, 2023Updated 3 years ago
- JVM integration for Weld☆16Sep 24, 2018Updated 7 years ago
- MapReduce performance testing using teragen and terasort☆18Aug 26, 2021Updated 4 years ago
- Port of TPC-DS dsdgen to Java☆50Aug 5, 2024Updated last year
- A tool to get better debug info on spark's memory usage☆42Aug 21, 2019Updated 6 years ago
- HiBench is a big data benchmark suite.☆1,489Dec 15, 2025Updated 2 months ago
- A Spark SQL extension which provides SQL Standard Authorization for Apache Spark | This repo is contributed to Apache Kyuubi | 项目已迁移至 Apa…☆183Apr 6, 2022Updated 3 years ago
- This repo stores my Spark Tutorial slides.☆15Feb 8, 2016Updated 10 years ago
- A framework for writing performant user-defined functions (UDFs) that are portable across a variety of engines including Apache Spark, Ap…☆304Oct 30, 2025Updated 4 months ago
- tpcds queries for presto☆13Oct 18, 2016Updated 9 years ago
- ACID Data Source for Apache Spark based on Hive ACID☆96Jul 7, 2021Updated 4 years ago
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,521Updated this week
- This is archive of SparkRDMA project. The new repository with RDMA shuffle acceleration for Apache Spark is here: https://github.com/Nvid…☆257May 13, 2019Updated 6 years ago
- SQLBench Runners☆13Dec 17, 2023Updated 2 years ago
- Scripts for generating Grafana dashboards for monitoring Spark jobs☆242Mar 26, 2015Updated 10 years ago
- A simple optimizing Brainfuck compiler (used as the demo for my QCon Beijing 2015 talk)☆62Sep 23, 2022Updated 3 years ago
- TPC-DS Performance tests tool for Flink☆29May 21, 2021Updated 4 years ago
- An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.☆431Jan 14, 2022Updated 4 years ago
- Mirror of Apache crail (Incubating)☆151Jul 3, 2022Updated 3 years ago
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆94May 9, 2025Updated 9 months ago
- Profiling Spark Applications for Performance Comparison and Diagnosis☆17Nov 11, 2018Updated 7 years ago
- Benchmarking suite for Apache Spark☆15Nov 24, 2017Updated 8 years ago
- Db2 JDBC connector for Trino☆19Jan 6, 2023Updated 3 years ago
- Utility for benchmarking changes in Spark using TPC-DS workloads☆16Jun 3, 2021Updated 4 years ago
- Spark Shuffle Optimization with RDMA+AEP☆30May 23, 2023Updated 2 years ago
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆335Sep 29, 2023Updated 2 years ago
- Learn how to use Spark SQL and HSpark connector package to create / query data tables that reside in HBase region servers☆69Sep 17, 2025Updated 5 months ago
- Rocksdb state storage implementation for Structured Streaming.☆17Oct 21, 2020Updated 5 years ago
- Secure HDFS Access from Kubernetes☆61Jun 11, 2020Updated 5 years ago
- Benchmarks for Low Latency (Streaming) solutions including Apache Storm, Apache Spark, Apache Flink, ...☆646Dec 17, 2023Updated 2 years ago
- A Spark Atlas connector to track data lineage in Apache Atlas☆266Nov 16, 2022Updated 3 years ago
- Cache File System optimized for columnar formats and object stores☆187Aug 11, 2022Updated 3 years ago