Alternatives and similar repositories for dat

Users that are interested in dat are comparing it to the libraries listed below

• Databeans / lighthouse
  Shed light on your data layout in order to monitor the health of your Lakehouse tables and identify when data maintenance operations shou…
  ☆10Updated 2 years ago
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆100Updated last week
• ognis1205 / delta-hub
  A platform and cloud-based service for data sharing based on the Delta Sharing protocol.
  ☆21Updated last year
• duckdb / uc_catalog
  Proof-of-concept extension combining the delta extension with Unity Catalog
  ☆89Updated last month
• unitycatalog / unitycatalog-rs
  Open, Multi-modal Catalog for Data & AI, written in Rust
  ☆81Updated 10 months ago
• voltrondata / sqlflite
  An example Flight SQL Server implementation - with DuckDB and SQLite back-ends.
  ☆267Updated 11 months ago
• apache / datafusion-python
  Apache DataFusion Python Bindings
  ☆494Updated this week
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆189Updated this week
• Upsolver / iceberg-diag
  ☆30Updated 8 months ago
• Mause / duckdb-deltatable-extension
  A purely experimental DuckDB Deltalake extension
  ☆95Updated 2 weeks ago
• duckdb / duckdb-iceberg
  ☆302Updated last week
• dask-contrib / dask-snowflake
  Dask integration for Snowflake
  ☆30Updated 3 weeks ago
• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆38Updated last year
• dremio-hub / arrow-flight-client-examples
  ☆70Updated 7 months ago
• binste / dbt-ibis
  Write your dbt models using Ibis
  ☆70Updated 5 months ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆229Updated last month
• delta-incubator / deltatorch
  ☆58Updated last year
• eakmanrq / sqlframe
  Turning PySpark Into a Universal DataFrame API
  ☆422Updated last week
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆218Updated last month
• dask-contrib / dask-sql
  Distributed SQL Engine in Python using Dask
  ☆407Updated 11 months ago
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• ananthdurai / schemata
  Schema modelling framework for decentralised domain-driven ownership of data.
  ☆256Updated last year
• datafusion-contrib / bdt
  Boring Data Tool
  ☆227Updated last year
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆46Updated last year
• SemyonSinchenko / flake8-pyspark-with-column
  A flake8 plugin that detects of usage withColumn in a loop or inside reduce
  ☆28Updated 2 months ago
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated 11 months ago
• canimus / cuallee
  Possibly the fastest DataFrame-agnostic quality check library in town.
  ☆202Updated last week
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated last year
• ibis-project / ibis-substrait
  Ibis Substrait Compiler
  ☆104Updated last week
• boringdata / boring-catalog
  ☆154Updated 3 months ago