manuzhang / awesome-lakehouse
a curated list of awesome lakehouse frameworks, applications, etc
☆21Updated last month
Alternatives and similar repositories for awesome-lakehouse:
Users that are interested in awesome-lakehouse are comparing it to the libraries listed below
- CLI tool to bulk migrate the tables from one catalog another without a data copy☆75Updated this week
- Multi-hop declarative data pipelines☆109Updated last week
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆28Updated last week
- Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture☆56Updated last month
- The Internals of Spark on Kubernetes☆70Updated 2 years ago
- Unity Catalog UI☆39Updated 5 months ago
- Magic to help Spark pipelines upgrade☆34Updated 4 months ago
- A dbt adapter for Decodable☆12Updated this week
- BigQuery connector for Apache Flink☆29Updated this week
- Delta reader for the Ray open-source toolkit for building ML applications☆45Updated last year
- ☆47Updated 6 months ago
- One bite-sized tip or trick for Apache Flink practitioners every day leading up to Christmas Eve 2024.☆24Updated 2 months ago
- Monitoring and insights on your data lakehouse tables☆27Updated last month
- A Table format agnostic data sharing framework☆38Updated last year
- A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL☆39Updated 5 months ago
- Apache Hive Metastore as a Standalone server in Docker☆68Updated 6 months ago
- Scalable CDC Pattern Implemented using PySpark☆18Updated 5 years ago
- ☆79Updated last year
- Generate authentic looking mock data based on a SQL, JSON or Avro schema and produce to Kafka in JSON or Avro format.☆154Updated 2 months ago
- dbt-starrocks contains all of the code enabling dbt to work with StarRocks☆23Updated this week
- Demonstration of a Hive Input Format for Iceberg☆26Updated 3 years ago
- Dione - a Spark and HDFS indexing library☆51Updated 11 months ago
- A library that brings useful functions from various modern database management systems to Apache Spark☆58Updated last year
- Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.☆79Updated this week
- Examples for using Apache Flink® with DataStream API, Table API, Flink SQL and connectors such as MySQL, JDBC, CDC, Kafka.☆62Updated last year
- A DuckDB-powered command line interface for Snowflake security, governance, operations, and cost optimization.☆39Updated 6 months ago
- Adapter for dbt that executes dbt pipelines on Apache Flink☆90Updated 11 months ago
- Presto Trino with Apache Hive Postgres metastore☆40Updated 5 months ago
- A testing framework for Trino☆26Updated 3 months ago
- A sample implementation of stream writes to an Iceberg table on GCS using Flink and reading it using Trino☆19Updated 2 years ago