Alternatives and similar repositories for lighthouse

Users that are interested in lighthouse are comparing it to the libraries listed below

• delta-incubator / dat
  Delta Acceptance Testing
  ☆23Updated 5 months ago
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆48Updated last year
• delta-incubator / deltatorch
  ☆59Updated 2 years ago
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• Spratiher9 / JumpSpark
  JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.
  ☆10Updated 2 years ago
• MrPowers / beavis
  Pandas helper functions
  ☆31Updated 2 years ago
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆45Updated 2 years ago
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆118Updated last week
• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆42Updated 2 years ago
• dask-contrib / dask-snowflake
  Dask integration for Snowflake
  ☆30Updated 6 months ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆232Updated 2 weeks ago
• binste / dbt-ibis
  Write your dbt models using Ibis
  ☆75Updated 10 months ago
• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆97Updated 5 years ago
• dremio-hub / arrow-flight-client-examples
  ☆70Updated last year
• decodableco / dbt-decodable
  A dbt adapter for Decodable
  ☆12Updated 5 months ago
• BauplanLabs / no-jvm-wap-with-iceberg
  A write-audit-publish implementation on a data lake without the JVM
  ☆45Updated last year
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆45Updated last week
• dbt-labs / spark-utils
  Utility functions for dbt projects running on Spark
  ☆34Updated last month
• ronald-smith-angel / owl-data-sanitizer
  A pyspark lib to validate data quality
  ☆18Updated 3 years ago
• Data-Engineering-Weekly / dataengineeringweekly
  Weekly Data Engineering Newsletter
  ☆96Updated last year
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆197Updated this week
• unitycatalog / unitycatalog-ui
  Unity Catalog UI
  ☆43Updated last year
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆50Updated last year
• danielbeach / lakescum
  A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.
  ☆27Updated last year
• ananthdurai / schemata
  Schema modelling framework for decentralised domain-driven ownership of data.
  ☆261Updated 2 years ago
• Qbeast-io / qbeast-spark
  Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
  ☆235Updated last year
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆63Updated 3 years ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆33Updated 3 years ago
• jwills / de4ml
  Supporting materials/code examples for my course in data engineering for machine learning.
  ☆39Updated 3 years ago
• ognis1205 / delta-hub
  A platform and cloud-based service for data sharing based on the Delta Sharing protocol.
  ☆21Updated last year