Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testing.
☆81Sep 2, 2023Updated 3 years ago
Alternatives and similar repositories for Local-Data-LakeHouse
Users that are interested in Local-Data-LakeHouse are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)☆72Sep 23, 2023Updated 3 years ago
- New generation opensource data stack☆75May 20, 2022Updated 4 years ago
- A Docker Compose template that builds a interactive development environment for PySpark with Jupyter Lab, MinIO as object storage, Hive M…☆47Dec 19, 2024Updated last year
- Building Data Lakehouse by open source technology. Support end to end data pipeline, from source data on AWS S3 to Lakehouse, visualize a…☆42Dec 15, 2025Updated 10 months ago
- ☆23Feb 5, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Node.js kafka connect connector for prometheus☆13Dec 7, 2022Updated 3 years ago
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆30Apr 12, 2023Updated 3 years ago
- Apache Airflow advanced functionalities examples☆21Mar 22, 2024Updated 2 years ago
- Simple ETL pipeline using Python☆29May 22, 2023Updated 3 years ago
- ☆21Feb 18, 2024Updated 2 years ago
- Open Data Stack Platform: a collection of projects and pipelines built with open data stack tools for scalable, observable data platform…☆23Sep 19, 2026Updated last month
- ☆33Jan 17, 2025Updated last year
- Classify images of different kitchenware items☆11Apr 17, 2023Updated 3 years ago
- Rust And Delta Demo. Explanation and walkthrough on delta-rs☆10Aug 21, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆25Mar 15, 2024Updated 2 years ago
- The Data Pipeline and Analytics Stack is a comprehensive solution designed for processing, storing, and visualizing data. Explore a compl…☆18Dec 26, 2023Updated 2 years ago
- Yet Another (Spark) ETL Framework☆21Oct 21, 2023Updated 3 years ago
- velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…☆20Aug 12, 2025Updated last year
- This project demonstrates how to use Apache Airflow to submit jobs to Apache spark cluster in different programming laguages using Python…☆47Mar 14, 2024Updated 2 years ago
- A fully serverless, event-driven data pipeline that ingests, enriches, validates, and visualizes real-time news data using AWS services. …☆26Aug 10, 2025Updated last year
- Code to help generate SQL for stakeholders. Code at https://www.startdataengineering.com/post/data-democratize-llm/☆13May 24, 2024Updated 2 years ago
- End-to-End ELT data pipeline with Postgres, Airbyte, dbt, Dagster, Snowflake and Metabase☆12Jul 13, 2023Updated 3 years ago
- Apache Hive Metastore as a Standalone server in Docker☆81Aug 22, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A demonstration of an ELT (Extract, Load, Transform) pipeline☆32Feb 19, 2024Updated 2 years ago
- Efficient Data Processing in Distributed Database (Vietnamese docs)☆31Jul 2, 2025Updated last year
- This repository contains an end-to-end data engineering project using Apache Flink, focused on performing sales analytics. The project de…☆12Nov 18, 2023Updated 2 years ago
- A custom end-to-end analytics platform for customer churn☆10May 15, 2025Updated last year
- minio as local storage and DynamoDB as catalog☆15May 14, 2024Updated 2 years ago
- Sentiment Analysis of Tweets in real time☆12Dec 22, 2025Updated 10 months ago
- ☆15Oct 10, 2025Updated last year
- Dive into Apache Airflow 3 & the Airflow AI SDK! Learn to build a League of Legends data analysis pipeline using Google Gemini, Dynamic T…☆12May 12, 2025Updated last year
- You are free to use this to generate data for testing. Attribution to in/JosueBogran for the dataset with a link to the generator is appr…☆11Jan 20, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Feature demos, integration guides & hands-on labs/projects using Kpow, Flex, Kafka, Flink, Iceberg & more☆53Jul 28, 2026Updated 3 months ago
- A Covid-19 data pipeline on AWS featuring PySpark/Glue, Docker, Great Expectations, Airflow, and Redshift, templated in CloudFormation an…☆24Nov 21, 2023Updated 2 years ago
- ☆26Mar 4, 2024Updated 2 years ago
- ☆16Updated this week
- Conduktor Helm Chart Repository☆11Oct 23, 2026Updated 2 weeks ago
- ☆23Nov 17, 2022Updated 3 years ago
- 🦆 Batch data pipeline with Airflow, DuckDB, Delta Lake, Trino, MinIO, and Metabase. Full observability and data quality.☆88Nov 5, 2025Updated last year