Alternatives and similar repositories for lighthouse

Users that are interested in lighthouse are comparing it to the libraries listed below

• delta-incubator / dat
  Delta Acceptance Testing
  ☆20Updated 2 months ago
• Spratiher9 / JumpSpark
  JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.
  ☆10Updated 2 years ago
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆109Updated this week
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆48Updated last year
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• delta-incubator / deltatorch
  ☆58Updated last year
• binste / dbt-ibis
  Write your dbt models using Ibis
  ☆71Updated 7 months ago
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated last year
• MrPowers / beavis
  Pandas helper functions
  ☆31Updated 2 years ago
• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆40Updated last year
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆190Updated last week
• Data-Engineering-Weekly / dataengineeringweekly
  Weekly Data Engineering Newsletter
  ☆96Updated last year
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆43Updated last week
• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆96Updated 5 years ago
• danielbeach / lakescum
  A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.
  ☆26Updated last year
• jwills / de4ml
  Supporting materials/code examples for my course in data engineering for machine learning.
  ☆38Updated 2 years ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆231Updated 3 months ago
• decodableco / dbt-decodable
  A dbt adapter for Decodable
  ☆12Updated last month
• dbt-labs / dbt-semantic-interfaces
  The shared semantic layer definitions that dbt-core and MetricFlow use.
  ☆87Updated 2 weeks ago
• dask-contrib / dask-snowflake
  Dask integration for Snowflake
  ☆30Updated 2 months ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆60Updated 2 years ago
• ananthdurai / schemata
  Schema modelling framework for decentralised domain-driven ownership of data.
  ☆259Updated last year
• getindata / dbt-airflow-factory
  Library to convert DBT manifest metadata to Airflow tasks
  ☆49Updated last year
• tdoehmen / duckdq
  ☆34Updated 2 years ago
• godatadriven / pytest-dbt-core
  Pytest plugin for dbt core
  ☆62Updated 9 months ago
• projectnessie / nessie-demos
  Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.
  ☆30Updated last week
• dbt-labs / spark-utils
  Utility functions for dbt projects running on Spark
  ☆33Updated 8 months ago
• danielbeach / sniffer
  csv and flat-file sniffer built in Rust.
  ☆43Updated last year
• starlake-ai / starlake
  Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.
  ☆156Updated this week
• SemyonSinchenko / flake8-pyspark-with-column
  A flake8 plugin that detects of usage withColumn in a loop or inside reduce
  ☆28Updated 4 months ago