type-class based data cleansing library for Apache Spark SQL
☆78Jun 23, 2019Updated 7 years ago
Alternatives and similar repositories for cleanframes
Users that are interested in cleanframes are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Spark data profiling utilities☆23Nov 24, 2018Updated 7 years ago
- Essential Spark extensions and helper methods ✨😲☆766Updated this week
- Better bridge apache spark and postgresql☆23Sep 11, 2023Updated 3 years ago
- A tool to validate data, built around Apache Spark.☆101Aug 10, 2026Updated 3 months ago
- Expressive types for Spark.☆898Oct 28, 2026Updated 3 weeks ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Spark package for checking data quality☆220Feb 28, 2020Updated 6 years ago
- Big Data Toolkit for the JVM☆147Nov 4, 2020Updated 6 years ago
- A library that brings useful functions from various modern database management systems to Apache Spark☆63Sep 4, 2023Updated 3 years ago
- Optics for Spark DataFrames☆48Mar 5, 2021Updated 5 years ago
- A framework for creating composable and pluggable data processing pipelines using Apache Spark, and running them on a cluster.☆47Aug 1, 2016Updated 10 years ago
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,660Oct 20, 2026Updated 3 weeks ago
- Delta Sharing + MLflow for ML model & experiment exchange (arcuate delta - a fan shaped river delta)☆22Jan 29, 2026Updated 9 months ago
- Material for the O'Reilly course "Open Source Reasoning Language Models"☆15Sep 28, 2026Updated last month
- Sample Spark Code☆91Sep 19, 2018Updated 8 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Qubole Sparklens tool for performance tuning Apache Spark☆593Jun 26, 2024Updated 2 years ago
- Validated Typesafe configuration☆39Apr 14, 2021Updated 5 years ago
- Run spark calculations from Almond☆118Updated this week
- Presentation and notebook sources for Scala IO and Scale by the Bay 2018 Spark and Frameless talk☆11Jan 16, 2019Updated 7 years ago
- Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.☆304Jul 13, 2025Updated last year
- Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…☆64Sep 6, 2024Updated 2 years ago
- The missing MatPlotLib for Scala + Spark☆729Jan 30, 2022Updated 4 years ago
- ☆46Apr 27, 2020Updated 6 years ago
- Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)☆456Apr 2, 2026Updated 7 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Spark DataFrame transformation and UDF test examples☆22Feb 13, 2023Updated 3 years ago
- A simplified, lightweight ETL Framework based on Apache Spark☆590Sep 1, 2026Updated 2 months ago
- Genie Framework improves Spark Pool utilization by executing multiple Synapse notebooks on the same spark pool instance☆27Dec 19, 2023Updated 2 years ago
- Write property based tests easily on spark dataframes☆21Jan 19, 2024Updated 2 years ago
- Simple but powerful tool for load testing JVM based modules☆17Apr 14, 2023Updated 3 years ago
- SparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.☆46Jul 8, 2018Updated 8 years ago
- End-to-end Azure Databricks Workspace automation with Azure Pipelines☆24Sep 10, 2023Updated 3 years ago
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆96May 11, 2026Updated 6 months ago
- Scala DSL for Unit-Testing Processing Topologies in Kafka Streams☆186Jan 16, 2021Updated 5 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Fybrik platform - Arrow/Flight module☆15Aug 10, 2024Updated 2 years ago
- Writing application logic for Spark jobs that can be unit-tested without a SparkContext☆77Jan 27, 2019Updated 7 years ago
- Apache Spark Connect Client for Rust☆116Nov 9, 2026Updated last week
- PySpark schema generator☆44Feb 23, 2023Updated 3 years ago
- A benchmark tool for lakehouses.☆14Mar 12, 2023Updated 3 years ago
- Lahinch surf predictions with Hopsworks☆15May 21, 2025Updated last year
- ☆16Nov 30, 2018Updated 7 years ago
Are these results useful?