type-class based data cleansing library for Apache Spark SQL
☆78Jun 23, 2019Updated 6 years ago
Alternatives and similar repositories for cleanframes
Users that are interested in cleanframes are comparing it to the libraries listed below
Sorting:
- Better bridge apache spark and postgresql☆23Sep 11, 2023Updated 2 years ago
- Essential Spark extensions and helper methods ✨😲☆766Sep 14, 2025Updated 6 months ago
- A tool to validate data, built around Apache Spark.☆101Feb 19, 2026Updated last month
- Spark package for checking data quality☆223Feb 28, 2020Updated 6 years ago
- Spark data profiling utilities☆23Nov 24, 2018Updated 7 years ago
- Big Data Toolkit for the JVM☆147Nov 4, 2020Updated 5 years ago
- An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.☆431Jan 14, 2022Updated 4 years ago
- Spark style guide☆271Sep 30, 2024Updated last year
- Sample Spark Code☆91Sep 19, 2018Updated 7 years ago
- Write property based tests easily on spark dataframes☆20Jan 19, 2024Updated 2 years ago
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,596Mar 10, 2026Updated last week
- SparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.☆46Jul 8, 2018Updated 7 years ago
- PySpark schema generator☆44Feb 23, 2023Updated 3 years ago
- HiveQL Jupyter Kernel☆10Aug 5, 2022Updated 3 years ago
- Validated Typesafe configuration☆38Apr 14, 2021Updated 4 years ago
- Qubole Sparklens tool for performance tuning Apache Spark☆590Jun 26, 2024Updated last year
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆95May 9, 2025Updated 10 months ago
- A library that brings useful functions from various modern database management systems to Apache Spark☆61Sep 4, 2023Updated 2 years ago
- Lahinch surf predictions with Hopsworks☆15May 21, 2025Updated 9 months ago
- Provides a POJO centric model as per Spring Data interfaces to interact with Amazon SimpleDB, a non-relational datastore☆12Sep 29, 2015Updated 10 years ago
- The missing MatPlotLib for Scala + Spark☆731Jan 30, 2022Updated 4 years ago
- Full stack skeleton project using Akka-http, Scala.js, Laminar, Sloth, Boopickle☆15Sep 1, 2020Updated 5 years ago
- Spark functions to run popular phonetic and string matching algorithms☆59Feb 22, 2022Updated 4 years ago
- End-to-end Azure Databricks Workspace automation with Azure Pipelines☆23Sep 10, 2023Updated 2 years ago
- Deriving Spark DataFrame schemas from case classes☆44Jun 24, 2024Updated last year
- An ETL tool for converting untyped CSV to parquet. Also triggers data lake updates.☆15Oct 29, 2021Updated 4 years ago
- Genie Framework improves Spark Pool utilization by executing multiple Synapse notebooks on the same spark pool instance☆28Dec 19, 2023Updated 2 years ago
- Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)☆455Feb 8, 2026Updated last month
- Spark Scala docker container sample for AWS testing - EKS & S3☆24Oct 4, 2018Updated 7 years ago
- Terraform module for a PostgreSQL-backed Apache Airflow instance☆24May 16, 2018Updated 7 years ago
- something to help you spark☆64Oct 23, 2018Updated 7 years ago
- hive-phoenix-handler is a hive plug-in that can access Apache Phoenix table on HBase using HiveQL.☆10Aug 17, 2017Updated 8 years ago
- Gives TreeLog a GUI, the ScalaJS ReactTreeView☆10Jun 23, 2016Updated 9 years ago
- Mutation testing for Scala☆206Updated this week
- Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌☆29May 15, 2020Updated 5 years ago
- A benchmark tool for lakehouses.☆14Mar 12, 2023Updated 3 years ago
- Easy Config makes Scala application configuration extremely easy. It reads configuration from the environment or command line arguments.☆17Mar 2, 2020Updated 6 years ago
- low-level helpers for Apache Spark libraries and tests☆16Dec 29, 2018Updated 7 years ago
- Dendriform di-algebra algorithms to compute using Loday's arithmetic on groves of planar binary trees☆16Dec 7, 2019Updated 6 years ago