Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture
☆186Nov 20, 2026Updated this week
Alternatives and similar repositories for awesome-lakehouse-guide
Users that are interested in awesome-lakehouse-guide are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A repository of blogs/videos that presents how Apache Iceberg is being used in Production by various orgs☆21Jul 31, 2023Updated 3 years ago
- A leightweight UI for Lakekeeper☆21Updated this week
- Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processin…☆1,352Updated this week
- This project integrates Apache Fluss (stream-batch unified storage) with Apache Paimon (data lake storage) using Apache Flink☆15Jun 9, 2026Updated 5 months ago
- This repo contains examples of high throughput ingestion using Apache Spark and Apache Iceberg. These examples cover IoT and CDC scenario…☆32Jul 16, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An agent that can run on-premises and collect data to be sent to Jellyfish☆16Updated this week
- Iceberg Playground in a Box☆68Apr 8, 2026Updated 7 months ago
- Apache Polaris, the interoperable, open source catalog for Apache Iceberg☆2,123Updated this week
- Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)☆73Sep 23, 2023Updated 3 years ago
- Visits sessionization pipeline used for the talk☆13May 28, 2024Updated 2 years ago
- This repository helps teach people how to correctly define and create cumulative tables!☆778Oct 29, 2024Updated 2 years ago
- Advanced tools for multi-armed and contextual bandits☆23May 11, 2026Updated 6 months ago
- New and extensible file format for storage of large columnar datasets.☆745Sep 21, 2026Updated last month
- The observability platform for Iceberg lakehouses.☆484Jan 12, 2026Updated 10 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Apache DataFusion Comet Spark Accelerator☆1,325Updated this week
- Tutorials and examples of how to deploy Presto and connect it to different data sources☆25Jul 21, 2026Updated 3 months ago
- Apache Spark Kubernetes Operator☆331Nov 14, 2026Updated last week
- A portable Datamart and Business Intelligence suite built with Docker, sqlmesh + dbtcore, DuckDB and Superset☆61Oct 26, 2026Updated 3 weeks ago
- Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…☆81Sep 2, 2023Updated 3 years ago
- "Nature's economy shall be the base for our own, for it is immutable, but ours is secondary. An economist without knowledge of nature is …☆23May 31, 2021Updated 5 years ago
- Apache Iceberg REST Catalog in Rust — access control, credential vending and audit for every engine and AI agent. Apache 2.0.☆1,515Updated this week
- 🦆 Batch data pipeline with Airflow, DuckDB, Delta Lake, Trino, MinIO, and Metabase. Full observability and data quality.☆88Nov 5, 2025Updated last year
- Local Environment to Practice Data Engineering☆143Dec 30, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Don't Panic. This guide will help you when it feels like the end of the world.☆32Feb 7, 2026Updated 9 months ago
- Dockerized runner, utilities, and functions for FlinkSQL applications☆34Updated this week
- Personal project for setting up an open source data warehouse.☆32Jul 11, 2025Updated last year
- Open Data Stack Platform: a collection of projects and pipelines built with open data stack tools for scalable, observable data platform…☆24Sep 19, 2026Updated 2 months ago
- A write-audit-publish implementation on a data lake without the JVM☆45Aug 12, 2024Updated 2 years ago
- This project makes use of the open source Unity Catalog project and introduces a full notebook environment for simplifying how you work w…☆12Updated this week
- Assets used in Cloudera Tutorials☆19Nov 22, 2021Updated 4 years ago
- A tool to automate analytic platform evaluations. Barometer helps customers to get data points needed for service selection/service confi…☆19Jun 3, 2024Updated 2 years ago
- ASF Tooling Team Documentation Repository☆11Nov 13, 2026Updated last week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Turning PySpark Into a Universal DataFrame API☆544Updated this week
- A remotely accessible Kubernetes home lab with OIDC authentication. Build a modern development environment with integrated data analytics…☆32Sep 13, 2026Updated 2 months ago
- A Gentle introduction to Machine Learning with Apache Spark☆11Mar 2, 2026Updated 8 months ago
- This repo gives an introduction to setting up streaming analytics using open source technologies☆25Mar 2, 2023Updated 3 years ago
- Code to help generate SQL for stakeholders. Code at https://www.startdataengineering.com/post/data-democratize-llm/☆13May 24, 2024Updated 2 years ago
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆283Nov 13, 2026Updated last week
- Amazon EMR Serverless and Amazon MSK Serverless Demo☆13Jul 31, 2022Updated 4 years ago
Are these results useful?