A lightweight, declarative PySpark framework for data quality validation — check columns, rows, and entire datasets directly in your Spark pipelines
☆78Aug 1, 2026Updated 3 weeks ago
Alternatives and similar repositories for sparkdq
Users that are interested in sparkdq are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Spark Streaming HBase Example☆22May 20, 2026Updated 3 months ago
- An R package for easy cohort analysis with event data☆13Jul 9, 2026Updated last month
- ☆17Sep 4, 2025Updated 11 months ago
- Hadoop/Hive/Spark container to perform CI tests☆10Dec 26, 2020Updated 5 years ago
- Python dataflow pipeline☆10May 12, 2019Updated 7 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ETL jobs for Firefox Telemetry☆29Aug 18, 2026Updated last week
- Python code that will collapse structured columns separating out the attributes into new columns☆10Mar 15, 2022Updated 4 years ago
- Renders options for ingesting data into Hadoop☆21Jun 18, 2013Updated 13 years ago
- A Framework for Web API Packages☆16Jun 7, 2026Updated 2 months ago
- Collection of functions for common business intelligence related analysis☆15Aug 8, 2026Updated 3 weeks ago
- This Power BI project provides insights into customer orders and product tracking using interactive dashboards. It visualizes order statu…☆10Aug 15, 2025Updated last year
- ☆15Aug 28, 2025Updated last year
- Submitting Forms to JSON APIs☆16Aug 20, 2024Updated 2 years ago
- A Scala SDK for interfacing with HashiCorp's Nomad☆18Nov 30, 2022Updated 3 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Source code for the "Scala For Beginners" book. https://leanpub.com/scalaforbeginners/☆14Oct 14, 2019Updated 6 years ago
- Use Text to SQL to analyze US Government contract data☆24Mar 29, 2025Updated last year
- A sample project combining Microsoft Fabric Lakehouse, DuckLake and SQLMesh☆16Jun 24, 2025Updated last year
- A python SPark ETL libRary (SPETLR) for Databricks. https://discord.gg/p9bzqGybVW☆24Jul 24, 2026Updated last month
- R package: make pixel art interactively in a plot window, get a matrix, make a gif☆24Jun 4, 2024Updated 2 years ago
- Samples for fabric user data functions☆29Updated this week
- Cost Efficient Data Pipelines with DuckDB☆63May 14, 2025Updated last year
- Spark fires is a anti-pattern playground where we deliberately break Spark applications in various ways so you can observe what happens a…☆42Nov 18, 2024Updated last year
- Examples of building APIs in R using Plumber☆24Nov 12, 2021Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- R package to wrap the Deutsche Bahn Fahrplan API☆17Feb 4, 2024Updated 2 years ago
- ☆41Nov 19, 2021Updated 4 years ago
- Databricks framework to validate Data Quality of pySpark DataFrames and Tables☆453Updated this week
- A restaurant analytical tool + sales forecasting model☆26Jul 4, 2020Updated 6 years ago
- ☆21Aug 8, 2024Updated 2 years ago
- Linux keyboard mapping utility☆14Nov 25, 2021Updated 4 years ago
- Inspiring the next generation of open source contributors and maintainers☆19Dec 1, 2023Updated 2 years ago
- Code for "Efficient Data Processing in Spark" Course☆393Jun 29, 2026Updated 2 months ago
- protobuf pyspark conversion☆23Jun 7, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A compact universal OpenTherm WiFi Interface☆21Aug 23, 2026Updated last week
- PySpark test helper methods with beautiful error messages☆773Aug 20, 2026Updated last week
- textwrap.dedent with t-string support☆24Dec 15, 2025Updated 8 months ago
- A super simple smooth resize plugin for neovim☆16Jan 23, 2026Updated 7 months ago
- ☆27Feb 14, 2025Updated last year
- ☆15Aug 20, 2024Updated 2 years ago
- General-purpose Gen AI Accelerator developed for Insight APAC projects☆24Jan 13, 2026Updated 7 months ago