manuzhang / awesome-lakehouse
a curated list of awesome lakehouse frameworks, applications, etc
☆17Updated 3 months ago
Related projects ⓘ
Alternatives and complementary repositories for awesome-lakehouse
- Multi-hop declarative data pipelines☆91Updated 2 weeks ago
- CLI tool to bulk migrate the tables from one catalog another without a data copy☆61Updated this week
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆28Updated 2 weeks ago
- The Internals of Spark on Kubernetes☆70Updated 2 years ago
- Monitoring and insights on your data lakehouse tables☆22Updated this week
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆96Updated last year
- A Table format agnostic data sharing framework☆38Updated 9 months ago
- Demonstration of a Hive Input Format for Iceberg☆26Updated 3 years ago
- ☆78Updated last year
- Point-in-Time optimizations for Apache Spark☆29Updated 10 months ago
- Kafka Connector for Iceberg tables☆16Updated last year
- Apache Hive Metastore as a Standalone server in Docker☆67Updated 3 months ago
- Apache Spark Kubernetes Operator☆65Updated last week
- ☆43Updated 3 months ago
- Magic to help Spark pipelines upgrade☆34Updated last month
- Dione - a Spark and HDFS indexing library☆50Updated 8 months ago
- ☆40Updated last year
- A temporary home for LinkedIn's changes to Apache Iceberg (incubating)☆62Updated 6 months ago
- Spark-Radiant is Apache Spark Performance and Cost Optimizer☆25Updated 2 years ago
- Unity Catalog UI☆39Updated 2 months ago
- Presto Trino with Apache Hive Postgres metastore☆37Updated 2 months ago
- LST-Bench is a framework that allows users to run benchmarks specifically designed for evaluating Log-Structured Tables (LSTs) such as De…☆69Updated this week
- ☆104Updated last year
- pulsar lakehouse connector☆30Updated this week
- Apache Iceberg Documentation Site☆42Updated 9 months ago
- A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL☆37Updated 2 months ago
- ☆12Updated 2 years ago
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆92Updated 3 weeks ago