type-class based data cleansing library for Apache Spark SQL
β78Jun 23, 2019Updated 7 years ago
Alternatives and similar repositories for cleanframes
Users that are interested in cleanframes are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Essential Spark extensions and helper methods β¨π²β766Oct 1, 2026Updated 3 weeks ago
- Spark data profiling utilitiesβ23Nov 24, 2018Updated 7 years ago
- A tool to validate data, built around Apache Spark.β101Aug 10, 2026Updated 2 months ago
- Expressive types for Spark.β898Updated this week
- Spark package for checking data qualityβ220Feb 28, 2020Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer β’ AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Big Data Toolkit for the JVMβ147Nov 4, 2020Updated 5 years ago
- Shed light on your data layout in order to monitor the health of your Lakehouse tables and identify when data maintenance operations shouβ¦β10Jul 31, 2023Updated 3 years ago
- Optics for Spark DataFramesβ48Mar 5, 2021Updated 5 years ago
- A framework for creating composable and pluggable data processing pipelines using Apache Spark, and running them on a cluster.β47Aug 1, 2016Updated 10 years ago
- An open source indexing subsystem that brings index-based query acceleration to Apache Sparkβ’ and big data workloads.β430Jan 14, 2022Updated 4 years ago
- Spark style guideβ271Sep 30, 2024Updated 2 years ago
- Material for the O'Reilly course "Open Source Reasoning Language Models"β15Sep 28, 2026Updated last month
- Delta Sharing + MLflow for ML model & experiment exchange (arcuate delta - a fan shaped river delta)β22Jan 29, 2026Updated 9 months ago
- Sample Spark Codeβ91Sep 19, 2018Updated 8 years ago
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.β3,656Oct 20, 2026Updated last week
- Qubole Sparklens tool for performance tuning Apache Sparkβ593Jun 26, 2024Updated 2 years ago
- Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines anβ¦β64Sep 6, 2024Updated 2 years ago
- Run spark calculations from Almondβ118Sep 24, 2026Updated last month
- β46Apr 27, 2020Updated 6 years ago
- Presentation and notebook sources for Scala IO and Scale by the Bay 2018 Spark and Frameless talkβ11Jan 16, 2019Updated 7 years ago
- Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.β304Jul 13, 2025Updated last year
- The missing MatPlotLib for Scala + Sparkβ729Jan 30, 2022Updated 4 years ago
- β16Nov 30, 2018Updated 7 years ago
- GPU virtual machines on DigitalOcean Gradient AI β’ AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)β455Apr 2, 2026Updated 6 months ago
- A simplified, lightweight ETL Framework based on Apache Sparkβ589Sep 1, 2026Updated last month
- Spark DataFrame transformation and UDF test examplesβ22Feb 13, 2023Updated 3 years ago
- End-to-end Azure Databricks Workspace automation with Azure Pipelinesβ24Sep 10, 2023Updated 3 years ago
- Lahinch surf predictions with Hopsworksβ15May 21, 2025Updated last year
- SparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.β46Jul 8, 2018Updated 8 years ago
- An ETL tool for converting untyped CSV to parquet. Also triggers data lake updates.β15Oct 29, 2021Updated 5 years ago
- β14Feb 10, 2026Updated 8 months ago
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are inβ¦β96May 11, 2026Updated 5 months ago
- End-to-end encrypted email - Proton Mail β’ AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Write property based tests easily on spark dataframesβ21Jan 19, 2024Updated 2 years ago
- Scala DSL for Unit-Testing Processing Topologies in Kafka Streamsβ186Jan 16, 2021Updated 5 years ago
- Genie Framework improves Spark Pool utilization by executing multiple Synapse notebooks on the same spark pool instanceβ28Dec 19, 2023Updated 2 years ago
- Simple but powerful tool for load testing JVM based modulesβ17Apr 14, 2023Updated 3 years ago
- Apache Spark Connect Client for Rustβ116Jun 10, 2025Updated last year
- Provides a POJO centric model as per Spring Data interfaces to interact with Amazon SimpleDB, a non-relational datastoreβ12Sep 29, 2015Updated 11 years ago
- Fybrik platform - Arrow/Flight moduleβ15Aug 10, 2024Updated 2 years ago