Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)
☆69Sep 23, 2023Updated 2 years ago
Alternatives and similar repositories for lakehouse
Users that are interested in lakehouse are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Proof of concept of a big data cluster using open source tools☆11Apr 10, 2024Updated 2 years ago
- Gitbook Repo for Practical Data Pipeline☆25Feb 4, 2022Updated 4 years ago
- Building Data Lakehouse by open source technology. Support end to end data pipeline, from source data on AWS S3 to Lakehouse, visualize a…☆43Dec 15, 2025Updated 6 months ago
- Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…☆80Sep 2, 2023Updated 2 years ago
- End-to-end data platform: A PoC Data Platform project utilizing modern data stack (Spark, Airflow, DBT, Trino, Lightdash, Hive metastore,…☆49Oct 14, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi☆120Dec 15, 2023Updated 2 years ago
- Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work☆47Jul 13, 2022Updated 3 years ago
- Deploy a complete data stack in just a couple of minutes.☆15Mar 6, 2024Updated 2 years ago
- Trino connectors for accessing APIs with an OpenAPI spec☆49Feb 9, 2026Updated 5 months ago
- Building a Modern Data Lake with Minio, Spark, Airflow via Docker.☆23May 11, 2024Updated 2 years ago
- domain driven design in Go☆14Aug 18, 2020Updated 5 years ago
- This project demonstrates Real-Time streaming of CDC data from MySql to Apache Iceberg using Flink SQL Client for faster data analytics a…☆25Jan 16, 2024Updated 2 years ago
- A Docker Compose template that builds a interactive development environment for PySpark with Jupyter Lab, MinIO as object storage, Hive M…☆47Dec 19, 2024Updated last year
- Analytics engineering with dbt - projects and developer environment☆22Sep 27, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A collection of python notebooks exploring popular methods for rating sports teams (and other things)☆10Sep 7, 2017Updated 8 years ago
- Code to demonstrate data engineering metadata & logging best practices☆22Mar 12, 2024Updated 2 years ago
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆32Apr 13, 2023Updated 3 years ago
- A Model Context Protocol (MCP) server for Apache Kafka implemented in Go, leveraging franz-go and mcp-go.☆52Mar 9, 2026Updated 3 months ago
- Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake☆324Jun 22, 2026Updated 2 weeks ago
- Docker envinroment to stream data from Kafka to Iceberg tables☆30Feb 27, 2024Updated 2 years ago
- ☆23Nov 17, 2022Updated 3 years ago
- To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…☆47Mar 7, 2024Updated 2 years ago
- ☆25Mar 15, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Build DataOps platform with Apache Airflow and dbt on AWS☆58Jun 1, 2021Updated 5 years ago
- ☆27Jul 2, 2022Updated 4 years ago
- Modernize seu Data Warehouse☆15Nov 12, 2024Updated last year
- Kotlin helpers to make writing Flink jobs with Kotlin 27% more delightful☆35Dec 9, 2024Updated last year
- ⚡ Control Apache Airflow with natural language via MCP. Chat with your workflows using Claude, GPT, or any LLM — no REST API calls needed…☆48Updated this week
- Fivetran's Jira source dbt package☆14Oct 1, 2025Updated 9 months ago
- Helm Chart for deploying Spark history server in Amazon EKS for S3 Spark Event Logs☆29Apr 4, 2026Updated 3 months ago
- ☆21Dec 24, 2025Updated 6 months ago
- Build a data pipeline with Apache Airflow☆11May 7, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Elastic Stack Data Pipeline 구축 실습☆18Nov 20, 2021Updated 4 years ago
- This repo is an approach to TDD in machine learning model operation. it covers project structure, testing essentials using pytest with Gi…☆15Dec 2, 2020Updated 5 years ago
- A suite of tools aimed at making Iceberg REST Catalogs more approachable☆34Jun 30, 2026Updated last week
- API/Data Platform for Ingesting, Storing, and Serving Data through Postgres, and Litestar☆11Apr 25, 2026Updated 2 months ago
- Amazon EMR Serverless and Amazon MSK Serverless Demo☆13Jul 31, 2022Updated 3 years ago
- ☆267Oct 23, 2024Updated last year
- ☆10Jul 21, 2022Updated 3 years ago