awesome-spark / spark-gotchasLinks
Spark Gotchas. A subjective compilation of the Apache Spark tips and tricks
β363Updated 7 years ago
Alternatives and similar repositories for spark-gotchas
Users that are interested in spark-gotchas are comparing it to the libraries listed below
Sorting:
- Essential Spark extensions and helper methods β¨π²β760Updated 7 months ago
- β247Updated 5 years ago
- Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)β447Updated last week
- β309Updated 6 years ago
- Examples for High Performance Sparkβ509Updated 6 months ago
- Spark package for checking data qualityβ221Updated 5 years ago
- A tool for monitoring and tuning Spark jobs for efficiency.β358Updated 2 years ago
- Qubole Sparklens tool for performance tuning Apache Sparkβ577Updated 11 months ago
- The Internals of Spark Structured Streamingβ420Updated 2 years ago
- A boilerplate for writing PySpark Jobsβ396Updated last year
- Apache Sparkβ’ and Scala Workshopsβ264Updated 10 months ago
- Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productiveβ185Updated 2 years ago
- Real-world Spark pipelines examplesβ83Updated 7 years ago
- Spark style guideβ259Updated 8 months ago
- Examples for learning sparkβ332Updated 9 years ago
- Examples of Spark 2.0β211Updated 3 years ago
- Base classes to use when writing tests with Sparkβ1,534Updated 4 months ago
- Create HTML profiling reports from Apache Spark DataFramesβ196Updated 5 years ago
- Scala examples for learning to use Sparkβ444Updated 4 years ago
- This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spaβ¦β758Updated 3 weeks ago
- A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python supportβ¦β109Updated 7 years ago
- β129Updated 8 years ago
- Structured Streaming Machine Learning example with Spark 2.0β92Updated 8 years ago
- The Internals of Spark SQLβ466Updated 4 months ago
- A tutorial on the most important features and idioms of Scala that you need to use Spark's Scala APIs.β676Updated 2 years ago
- A simplified, lightweight ETL Framework based on Apache Sparkβ585Updated last year
- type-class based data cleansing library for Apache Spark SQLβ78Updated 5 years ago
- Spark, Spark Streaming and Spark SQL unit testing strategiesβ217Updated 8 years ago
- Serverless proxy for Spark clusterβ326Updated 4 years ago
- Self-written notes that may be usefulβ107Updated 9 years ago