Alternatives and similar repositories for pyspark-data-sources

Users that are interested in pyspark-data-sources are comparing it to the libraries listed below

• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆327Updated 2 weeks ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆197Updated this week
• delta-io / delta-examples
  Delta Lake examples
  ☆238Updated last year
• adidas / lakehouse-engine
  The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…
  ☆279Updated 3 months ago
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆224Updated 2 months ago
• alexott / databricks-playground
  Code samples, etc. for Databricks
  ☆73Updated 8 months ago
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆272Updated last year
• AbePabbathi / lakehouse-tacklebox
  This repo is a collection of tools to deploy, manage and operate a Databricks based Lakehouse.
  ☆46Updated last year
• StabRise / spark-pdf
  PDF DataSource for Apache Spark, allow to read PDF files directly to the DataFrame and ocr it
  ☆78Updated 9 months ago
• MrPowers / chispa
  PySpark test helper methods with beautiful error messages
  ☆750Updated 3 weeks ago
• alexott / databricks-nutter-repos-demo
  Demo of using the Nutter for testing of Databricks notebooks in the CI/CD pipeline
  ☆151Updated last year
• dataflint / spark
  Drop-in replacement for Apache Spark UI
  ☆397Updated this week
• CodyAustinDavis / dbsql_sme
  DBSQL SME Repo contains demos, tutorials, blog code, advanced production helper functions and more!
  ☆80Updated 2 months ago
• shannon-barrow / databricks-tpc-di
  Databricks Implementation of the TPC-DI Specification using Traditional Notebooks and/or Delta Live Tables
  ☆93Updated last month
• alexott / dlt-files-in-repos-demo
  Demonstration of using Files in Repos with Databricks Delta Live Tables
  ☆36Updated last year
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆81Updated last week
• SemyonSinchenko / flake8-pyspark-with-column
  A flake8 plugin that detects of usage withColumn in a loop or inside reduce
  ☆28Updated 7 months ago
• microsoft / nutter
  Testing framework for Databricks notebooks
  ☆314Updated last year
• souvik-databricks / dlt-with-debug
  A lightweight helper utility which allows developers to do interactive pipeline development by having a unified source code for both DLT …
  ☆49Updated 3 years ago
• dipankarmazumdar / awesome-lakehouse-guide
  Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture
  ☆140Updated 2 weeks ago
• delta-io / delta-docs
  Delta Lake Documentation
  ☆53Updated last year
• PatrickCuba / the_data_must_flow
  ☆30Updated 8 months ago
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆50Updated last year
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆45Updated last week
• newfront / hitchhikers_guide_to_deltalake_streaming
  Don't Panic. This guide will help you when it feels like the end of the world.
  ☆30Updated 5 months ago
• dbt-labs / dbt-spark
  This repository has moved into https://github.com/dbt-labs/dbt-adapters
  ☆443Updated 6 months ago
• delta-incubator / delta-lake-definitive-guide
  ☆59Updated last year
• derar-alhussein / Databricks-Certified-Data-Engineer-Professional
  The resources of the preparation course for Databricks Data Engineer Professional certification exam
  ☆172Updated last month
• tomasfarias / airflow-dbt-python
  A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.
  ☆210Updated last month
• andyweaves / system-tables-audit-logs
  SQL Queries & Alerts for Databricks System Tables access.audit Logs
  ☆40Updated 6 months ago