A lightweight, declarative PySpark framework for data quality validation — check columns, rows, and entire datasets directly in your Spark pipelines
☆78Sep 3, 2026Updated last month
Alternatives and similar repositories for sparkdq
Users that are interested in sparkdq are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Full-stack OpenTelemetry observability for Apache Spark☆20Updated this week
- Streaming PDF processor for Scala☆13Apr 2, 2025Updated last year
- Crash course in Scala☆22Apr 14, 2020Updated 6 years ago
- ☆17Sep 4, 2025Updated last year
- Run SQL queries on Snowflake from R☆11Oct 20, 2025Updated 11 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Renders options for ingesting data into Hadoop☆21Jun 18, 2013Updated 13 years ago
- ☆13May 12, 2026Updated 5 months ago
- ☆17Nov 27, 2025Updated 10 months ago
- Collection of functions for common business intelligence related analysis☆15Aug 8, 2026Updated 2 months ago
- example BQ data model using Dataform☆17Oct 5, 2026Updated last week
- A Scala SDK for interfacing with HashiCorp's Nomad☆18Nov 30, 2022Updated 3 years ago
- Kubernetes operator for Apache Superset. Deploy and run Superset with the Stackable Data Platform (SDP).☆35Updated this week
- A leightweight UI for Lakekeeper☆20Updated this week
- Source code for the "Scala For Beginners" book. https://leanpub.com/scalaforbeginners/☆14Oct 14, 2019Updated 6 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Manage and synchronize Synapse notebooks with Jupyter notebooks.☆11Nov 30, 2023Updated 2 years ago
- Provides domain models and codecs for common protocols☆28Oct 23, 2021Updated 4 years ago
- A sample project combining Microsoft Fabric Lakehouse, DuckLake and SQLMesh☆16Jun 24, 2025Updated last year
- A python SPark ETL libRary (SPETLR) for Databricks. https://discord.gg/p9bzqGybVW☆24Jul 24, 2026Updated 2 months ago
- From linear regression towards neural networks...☆27Sep 26, 2026Updated 2 weeks ago
- R package: make pixel art interactively in a plot window, get a matrix, make a gif☆24Oct 3, 2026Updated last week
- Samples for fabric user data functions☆29Updated this week
- Cost Efficient Data Pipelines with DuckDB☆63May 14, 2025Updated last year
- Restricts access to the server for SteamID members/employees listed in the whitelist☆12Nov 6, 2023Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆41Nov 19, 2021Updated 4 years ago
- Python API for Deequ☆826Updated this week
- Databricks framework to validate Data Quality of pySpark DataFrames and Tables☆468Updated this week
- Makes 'SimFin' data (https://simfin.com/) easily accessible in R.☆21Aug 13, 2025Updated last year
- ☆31Updated this week
- A very simple basic game of snake created in rust. Supports wall collisions, self collisions, and food with snake growth. Scores are reco…☆12Apr 23, 2026Updated 5 months ago
- Point-in-Time optimizations for Apache Spark☆30Jan 18, 2024Updated 2 years ago
- ☆21Aug 8, 2024Updated 2 years ago
- Stream content to/from an SFTP Server☆15Aug 16, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code for "Efficient Data Processing in Spark" Course☆396Jun 29, 2026Updated 3 months ago
- protobuf pyspark conversion☆23Jun 7, 2023Updated 3 years ago
- ☆25Jul 7, 2022Updated 4 years ago
- Code to demonstrate data engineering metadata & logging best practices☆21Mar 12, 2024Updated 2 years ago
- PySpark test helper methods with beautiful error messages☆776Updated this week
- textwrap.dedent with t-string support☆24Dec 15, 2025Updated 9 months ago
- ☆27Feb 14, 2025Updated last year