Alternatives and similar repositories for lighthouse:

Users that are interested in lighthouse are comparing it to the libraries listed below

• delta-incubator / dat
  Delta Acceptance Testing
  ☆20Updated 8 months ago
• Spratiher9 / JumpSpark
  JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.
  ☆10Updated last year
• delta-incubator / deltatorch
  ☆57Updated last year
• ronald-smith-angel / owl-data-sanitizer
  A pyspark lib to validate data quality
  ☆18Updated 2 years ago
• MrPowers / beavis
  Pandas helper functions
  ☆30Updated 2 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆58Updated last year
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆46Updated last year
• decodableco / dbt-decodable
  A dbt adapter for Decodable
  ☆12Updated 2 months ago
• benchsci / tinsel
  PySpark schema generator
  ☆42Updated 2 years ago
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• MrPowers / spark-stringmetric
  Spark functions to run popular phonetic and string matching algorithms
  ☆60Updated 3 years ago
• coiled / dask-snowflake
  Dask integration for Snowflake
  ☆30Updated 5 months ago
• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆38Updated last year
• SemyonSinchenko / flake8-pyspark-with-column
  A flake8 plugin that detects of usage withColumn in a loop or inside reduce
  ☆27Updated 3 months ago
• MrPowers / ceja
  PySpark phonetic and string matching algorithms
  ☆39Updated last year
• voltrondata / superset-sqlalchemy-adbc-flight-sql-poc
  A proof-of-concept repo that attempts to use Apache Superset with a custom ADBC to Arrow Flight SQL SQLAlchemy driver.
  ☆24Updated last year
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆84Updated this week
• binste / dbt-ibis
  Write your dbt models using Ibis
  ☆64Updated last month
• unitycatalog / unitycatalog-ui
  Unity Catalog UI
  ☆40Updated 7 months ago
• danielbeach / lakescum
  A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.
  ☆23Updated last year
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated last year
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆34Updated 6 months ago
• amundsen-io / amundsengremlin
  Amundsen Gremlin
  ☆21Updated 2 years ago
• jwills / de4ml
  Supporting materials/code examples for my course in data engineering for machine learning.
  ☆38Updated 2 years ago
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆63Updated 2 years ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆223Updated last month
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆45Updated last year
• projectnessie / nessie-demos
  Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.
  ☆28Updated 3 weeks ago
• Upsolver / iceberg-diag
  ☆28Updated 4 months ago
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated 7 months ago