Alternatives and similar repositories for lighthouse

Users that are interested in lighthouse are comparing it to the libraries listed below

• delta-incubator / dat
  Delta Acceptance Testing
  ☆21Updated 3 months ago
• Spratiher9 / JumpSpark
  JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.
  ☆10Updated 2 years ago
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated last year
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆230Updated last week
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆61Updated 2 years ago
• delta-incubator / deltatorch
  ☆59Updated last year
• decodableco / dbt-decodable
  A dbt adapter for Decodable
  ☆12Updated 3 months ago
• MrPowers / beavis
  Pandas helper functions
  ☆31Updated 2 years ago
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆48Updated last year
• dremio-hub / arrow-flight-client-examples
  ☆70Updated 11 months ago
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆44Updated last month
• dask-contrib / dask-snowflake
  Dask integration for Snowflake
  ☆30Updated 4 months ago
• rymurr / flight-spark-source
  ☆107Updated 2 years ago
• ronald-smith-angel / owl-data-sanitizer
  A pyspark lib to validate data quality
  ☆18Updated 3 years ago
• Qbeast-io / qbeast-spark
  Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
  ☆235Updated 10 months ago
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆34Updated last year
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆112Updated last week
• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆42Updated last year
• binste / dbt-ibis
  Write your dbt models using Ibis
  ☆73Updated 8 months ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆193Updated this week
• SemyonSinchenko / flake8-pyspark-with-column
  A flake8 plugin that detects of usage withColumn in a loop or inside reduce
  ☆28Updated 5 months ago
• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆96Updated 5 years ago
• Upsolver / iceberg-diag
  ☆30Updated last year
• ktrueda / parquet-tools
  easy install parquet-tools
  ☆182Updated last year
• voltrondata / superset-sqlalchemy-adbc-flight-sql-poc
  A proof-of-concept repo that attempts to use Apache Superset with a custom ADBC to Arrow Flight SQL SQLAlchemy driver.
  ☆25Updated 2 years ago
• FurcyPin / bigquery-frame
  ☆48Updated last year
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• projectnessie / nessie-demos
  Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.
  ☆30Updated 2 weeks ago
• MrPowers / spark-stringmetric
  Spark functions to run popular phonetic and string matching algorithms
  ☆60Updated 3 years ago
• benchsci / tinsel
  PySpark schema generator
  ☆43Updated 2 years ago