Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)
☆66Sep 23, 2023Updated 2 years ago
Alternatives and similar repositories for lakehouse
Users that are interested in lakehouse are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Proof of concept of a big data cluster using open source tools☆11Apr 10, 2024Updated 2 years ago
- Gitbook Repo for Practical Data Pipeline☆25Feb 4, 2022Updated 4 years ago
- Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…☆78Sep 2, 2023Updated 2 years ago
- End-to-end data platform: A PoC Data Platform project utilizing modern data stack (Spark, Airflow, DBT, Trino, Lightdash, Hive metastore,…☆48Oct 14, 2024Updated last year
- Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi☆120Dec 15, 2023Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work☆47Jul 13, 2022Updated 3 years ago
- Deploy a complete data stack in just a couple of minutes.☆15Mar 6, 2024Updated 2 years ago
- Building a Modern Data Lake with Minio, Spark, Airflow via Docker.☆23May 11, 2024Updated last year
- domain driven design in Go☆14Aug 18, 2020Updated 5 years ago
- A Data Engineering Project that implements an ETL data pipeline using Dagster, Apache Spark, Streamlit, MinIO, Metabase, Dbt, Polars, Doc…☆23Nov 19, 2024Updated last year
- GB: Построение хранилища данных и основы ETL☆10Mar 27, 2021Updated 5 years ago
- This project demonstrates Real-Time streaming of CDC data from MySql to Apache Iceberg using Flink SQL Client for faster data analytics a…☆24Jan 16, 2024Updated 2 years ago
- A Docker Compose template that builds a interactive development environment for PySpark with Jupyter Lab, MinIO as object storage, Hive M…☆47Dec 19, 2024Updated last year
- Analytics engineering with dbt - projects and developer environment☆22Sep 27, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A custom end-to-end analytics platform for customer churn☆11May 15, 2025Updated 11 months ago
- A Model Context Protocol (MCP) server for Apache Kafka implemented in Go, leveraging franz-go and mcp-go.☆48Mar 9, 2026Updated 2 months ago
- Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake☆312Apr 30, 2026Updated last week
- ☆17Jan 23, 2026Updated 3 months ago
- Docker envinroment to stream data from Kafka to Iceberg tables☆30Feb 27, 2024Updated 2 years ago
- ☆23Nov 17, 2022Updated 3 years ago
- ☆25Mar 15, 2024Updated 2 years ago
- Apache Atlas client☆18Updated this week
- Build DataOps platform with Apache Airflow and dbt on AWS☆58Jun 1, 2021Updated 4 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- End-to-end data engineer project☆24Aug 17, 2023Updated 2 years ago
- ☆27Jul 2, 2022Updated 3 years ago
- My notes from the @makersacademy course.☆23Apr 10, 2015Updated 11 years ago
- A simple Data Engineering solution for testing or education purposes. You only need to know SQL and Python to understand this project. Da…☆29Jul 2, 2022Updated 3 years ago
- Kotlin helpers to make writing Flink jobs with Kotlin 27% more delightful☆35Dec 9, 2024Updated last year
- A data generator for Apache Druid☆12Mar 26, 2025Updated last year
- ⚡ Control Apache Airflow with natural language via MCP. Chat with your workflows using Claude, GPT, or any LLM — no REST API calls needed…☆45Apr 30, 2026Updated last week
- ✨🎨 Dark theme for Visual Studio code based on Aura theme with the "spirit" of dracula☆19Aug 28, 2022Updated 3 years ago
- Fivetran's Jira source dbt package☆14Oct 1, 2025Updated 7 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Helm Chart for deploying Spark history server in Amazon EKS for S3 Spark Event Logs☆29Apr 4, 2026Updated last month
- Build a data pipeline with Apache Airflow☆11May 7, 2021Updated 5 years ago
- Elastic Stack Data Pipeline 구축 실습☆18Nov 20, 2021Updated 4 years ago
- This repo is an approach to TDD in machine learning model operation. it covers project structure, testing essentials using pytest with Gi…☆15Dec 2, 2020Updated 5 years ago
- Rust + Python Lake House Health Analyzer | Detect • Diagnose • Optimize • Flow☆65Oct 20, 2025Updated 6 months ago
- A suite of tools aimed at making Iceberg REST Catalogs more approachable☆33Updated this week
- This extension makes vscode seamlessly work with dbt and bigquery☆15Sep 27, 2022Updated 3 years ago