mrpowers-io / spark-fast-testsView external linksLinks
Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)
☆454Feb 8, 2026Updated last week
Alternatives and similar repositories for spark-fast-tests
Users that are interested in spark-fast-tests are comparing it to the libraries listed below
Sorting:
- Essential Spark extensions and helper methods ✨😲☆766Sep 14, 2025Updated 5 months ago
- Base classes to use when writing tests with Spark☆1,549Dec 22, 2025Updated last month
- Spark style guide☆272Sep 30, 2024Updated last year
- Expressive types for Spark.☆895Feb 4, 2026Updated last week
- Spark DataFrame transformation and UDF test examples☆22Feb 13, 2023Updated 3 years ago
- PySpark test helper methods with beautiful error messages☆752Jan 13, 2026Updated last month
- Bulletproof Apache Spark jobs with fast root cause analysis of failures.☆73Mar 14, 2021Updated 4 years ago
- A giter8 template for Spark SBT projects☆72Mar 20, 2021Updated 4 years ago
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,580Feb 2, 2026Updated last week
- Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive☆186Oct 15, 2025Updated 4 months ago
- Qubole Sparklens tool for performance tuning Apache Spark☆589Jun 26, 2024Updated last year
- pyspark methods to enhance developer productivity 📣 👯 🎉☆682Mar 6, 2025Updated 11 months ago
- Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.☆300Jul 13, 2025Updated 7 months ago
- Filling in the Spark function gaps across APIs☆50Apr 14, 2021Updated 4 years ago
- This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spa…☆809Feb 5, 2026Updated last week
- Data Lineage Tracking And Visualization Solution☆653Feb 7, 2026Updated last week
- ☆45Apr 27, 2020Updated 5 years ago
- Run spark calculations from Ammonite☆117Feb 3, 2026Updated last week
- Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…☆62Sep 6, 2024Updated last year
- A library that provides useful extensions to Apache Spark and PySpark.☆232Jan 20, 2026Updated 3 weeks ago
- A Spark plugin for reading and writing Excel files☆520Updated this week
- A simplified, lightweight ETL Framework based on Apache Spark☆589Jan 24, 2024Updated 2 years ago
- A curated list of awesome Apache Spark packages and resources.☆1,861Oct 24, 2024Updated last year
- A library that brings useful functions from various modern database management systems to Apache Spark☆61Sep 4, 2023Updated 2 years ago
- Sample processing code using Spark 2.1+ and Scala☆51Jun 28, 2020Updated 5 years ago
- Delta lake and filesystem helper methods☆50Feb 29, 2024Updated last year
- A tool to validate data, built around Apache Spark.☆100Updated this week
- Type safety for spark columns☆79Oct 27, 2025Updated 3 months ago
- An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.☆432Jan 14, 2022Updated 4 years ago
- Spark functions to run popular phonetic and string matching algorithms☆59Feb 22, 2022Updated 3 years ago
- Test suite to document the behavior of Spark☆21Apr 15, 2021Updated 4 years ago
- Optics for Spark DataFrames☆47Mar 5, 2021Updated 4 years ago
- A composable command-line parser for Scala.☆669Feb 7, 2026Updated last week
- Pandas helper functions☆31Feb 19, 2023Updated 2 years ago
- The Internals of Apache Spark☆1,538Jul 5, 2025Updated 7 months ago
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆94May 9, 2025Updated 9 months ago
- A Python Library to support running data quality rules while the spark job is running⚡☆197Updated this week
- The Internals of Spark SQL☆484Jan 25, 2026Updated 3 weeks ago
- OS-Lib is a simple, flexible, high-performance Scala interface to common OS filesystem and subprocess APIs☆735Updated this week