groupon / sparklint
A tool for monitoring and tuning Spark jobs for efficiency.
☆357Updated 2 years ago
Alternatives and similar repositories for sparklint:
Users that are interested in sparklint are comparing it to the libraries listed below
- Examples of Spark 2.0☆211Updated 3 years ago
- A library to expose more of Apache Spark's metrics system☆146Updated 5 years ago
- Qubole Sparklens tool for performance tuning Apache Spark☆572Updated 8 months ago
- The Internals of Spark Structured Streaming☆418Updated 2 years ago
- Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive☆185Updated 2 years ago
- Build configuration-driven ETL pipelines on Apache Spark☆159Updated 2 years ago
- Profiler for large-scale distributed java applications (Spark, Scalding, MapReduce, Hive,...) on YARN.☆126Updated 6 years ago
- Mirror of Apache Bahir☆336Updated last year
- Spark, Spark Streaming and Spark SQL unit testing strategies☆218Updated 8 years ago
- Spark package for checking data quality☆221Updated 5 years ago
- Spark metrics related custom classes and sinks (e.g. Prometheus)☆180Updated 2 years ago
- Examples for High Performance Spark☆506Updated 4 months ago
- Scripts for generating Grafana dashboards for monitoring Spark jobs☆242Updated 9 years ago
- Custom state store providers for Apache Spark☆92Updated last month
- Write your Spark data to Kafka seamlessly☆174Updated 8 months ago
- Spark connector for SFTP☆100Updated last year
- hadoop-mini-clusters provides an easy way to test Hadoop projects directly in your IDE☆291Updated 2 years ago
- ☆243Updated 6 years ago
- Connect Spark to HBase for reading and writing data with ease☆296Updated 7 years ago
- SparkOnHBase☆279Updated 3 years ago
- The Internals of Delta Lake☆183Updated 2 months ago
- Big Data Toolkit for the JVM☆146Updated 4 years ago
- Hadoop output committers for S3☆108Updated 4 years ago
- Live-updating Spark UI built with Meteor☆189Updated 3 years ago
- Spark RDD to read, write and delete from HBase☆276Updated 4 years ago
- Spark Gotchas. A subjective compilation of the Apache Spark tips and tricks☆363Updated 7 years ago
- Enabling Spark Optimization through Cross-stack Monitoring and Visualization☆47Updated 7 years ago
- This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spa…☆736Updated last month
- An Open Source unit test framework for Hive queries based on JUnit 4 and 5☆256Updated 2 months ago
- A Spark SQL extension which provides SQL Standard Authorization for Apache Spark | This repo is contributed to Apache Kyuubi | 项目已迁移至 Apa…☆173Updated 2 years ago