manuzhang / awesome-lakehouseLinks
a curated list of awesome lakehouse frameworks, applications, etc
☆32Updated 4 months ago
Alternatives and similar repositories for awesome-lakehouse
Users that are interested in awesome-lakehouse are comparing it to the libraries listed below
Sorting:
- A Table format agnostic data sharing framework☆38Updated last year
- Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture☆83Updated this week
- Monitoring and insights on your data lakehouse tables☆29Updated last week
- CLI tool to bulk migrate the tables from one catalog another without a data copy☆79Updated 2 months ago
- ☆30Updated 6 months ago
- The Control Plane for Apache Iceberg☆128Updated this week
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆29Updated this week
- Unity Catalog UI☆40Updated 9 months ago
- Adapter for dbt that executes dbt pipelines on Apache Flink☆95Updated last year
- Multi-hop declarative data pipelines☆115Updated last week
- Library to convert DBT manifest metadata to Airflow tasks☆48Updated last year
- Apache Hive Metastore as a Standalone server in Docker☆78Updated 10 months ago
- Sample code to collect Apache Iceberg metrics for table monitoring☆28Updated 10 months ago
- Pythonic Iceberg REST Catalog☆1Updated last week
- Kafka Connector for Iceberg tables☆16Updated last year
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆95Updated this week
- Yet Another (Spark) ETL Framework☆21Updated last year
- A library that provides useful extensions to Apache Spark and PySpark.☆226Updated 3 months ago
- ☆80Updated 2 months ago
- Delta Lake helper methods. No Spark dependency.☆23Updated 9 months ago
- A dbt adapter for Decodable☆12Updated 4 months ago
- dbt-starrocks contains all of the code enabling dbt to work with StarRocks☆40Updated 3 weeks ago
- ☆50Updated last month
- Presto Trino with Apache Hive Postgres metastore☆42Updated 9 months ago
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆75Updated 3 years ago
- Delta reader for the Ray open-source toolkit for building ML applications☆46Updated last year
- Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…☆125Updated last month
- The Internals of Spark on Kubernetes☆71Updated 3 years ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆99Updated 2 years ago
- A Python Library to support running data quality rules while the spark job is running⚡☆188Updated last week