Building Data Lakehouse by open source technology. Support end to end data pipeline, from source data on AWS S3 to Lakehouse, visualize and recommend app.
☆42Dec 15, 2025Updated 11 months ago
Alternatives and similar repositories for building-lakehouse
Users that are interested in building-lakehouse are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Pipeline for Automated Updates of Kaggle's "Formula 2 Dataset"☆11Aug 15, 2023Updated 3 years ago
- The Data Pipeline and Analytics Stack is a comprehensive solution designed for processing, storing, and visualizing data. Explore a compl…☆18Dec 26, 2023Updated 2 years ago
- ☆10Aug 17, 2021Updated 5 years ago
- ☆75Sep 24, 2025Updated last year
- Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…☆81Sep 2, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- End-to-end data pipeline that ingests, processes, and stores data. It uses Apache Airflow to schedule scripts that fetch data from an API…☆23Sep 23, 2026Updated last month
- This project implements an ELT (Extract - Load - Transform) data pipeline with the goodreads dataset, using dagster (orchestration), spar…☆46Apr 22, 2023Updated 3 years ago
- Conversion of audio files to text using whisper from OpenAI with a simple tkinter GUI☆10Apr 13, 2023Updated 3 years ago
- Ecommerce Realtime Data Pipeline (Data Modeling, Workflow Orchestration, Change Data Capture, Analytical Database and Dashboarding)☆72Mar 9, 2024Updated 2 years ago
- An end-to-end, containerized data pipeline for near-real-time user event analytics using Kafka, ClickHouse, Airflow, and PySpark. Made to…☆79Sep 12, 2025Updated last year
- In this article, you will learn how to set up a real-time data processing and analytics environment using Docker, MySQL, Redpanda, MinIO,…☆11Jun 27, 2023Updated 3 years ago
- ☆15Updated this week
- ☆14Oct 18, 2020Updated 6 years ago
- ☆12Mar 30, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- KnetBuilder data integration platform for building knowledge graphs. Previously known as ondex.☆16Sep 30, 2026Updated last month
- ☆17Dec 12, 2024Updated last year
- Data Engineering & Analysis Project- San Francisco Eviction Data ETL Pipeline An end-to-end batch data pipeline for performing ETL on San…☆10Oct 2, 2025Updated last year
- Themes for Bookdown.☆11Aug 10, 2018Updated 8 years ago
- Template for Retreival-Augmented Generation (RAG) application using Milvus for vector storage, LangGraph for ReAct agentic workflows, and…☆12May 21, 2025Updated last year
- To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…☆47Mar 7, 2024Updated 2 years ago
- ☆11Jul 28, 2026Updated 3 months ago
- SQLMesh example projects☆42Jul 2, 2025Updated last year
- A data pipeline for the ingestion & visualisation of U.S Geological Survey Earthquake data☆14Jun 24, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The dbt Semantic Layer SDK for Python☆17Oct 27, 2026Updated 3 weeks ago
- A turnkey MLOps pipeline demonstrating how to go from raw events to real-time predictions at scale.☆250Oct 21, 2025Updated last year
- This is a simple object detection application, which can be used to detect military objects☆15Nov 16, 2020Updated 6 years ago
- Hands-on workshop with Apache Iceberg☆14Mar 13, 2024Updated 2 years ago
- A sophisticated trading system leveraging local LLM deployment through Ollama, distributed computing with Apache Spark, and vector-based …☆15Feb 3, 2025Updated last year
- End-to-End ELT data pipeline with Postgres, Airbyte, dbt, Dagster, Snowflake and Metabase☆12Jul 13, 2023Updated 3 years ago
- ☆11Oct 19, 2023Updated 3 years ago
- A Firebase Cloud Function and a Firebase hosted web app to treat weather data collected by Cloud IoT Core☆18Mar 10, 2019Updated 7 years ago
- A local-first Data Warehouse ELT pipeline that extracts CFPB consumer complaint data, transforms it with dbt into analytics-ready models,…☆13Sep 17, 2026Updated 2 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A data science project that utilizes ETL, EDA and ML to analyze sentiments on various Amazon product reviews from different categories.☆11Dec 23, 2023Updated 2 years ago
- Short Range Ultrasonic Radar - A simple radar using the ultrasonic sensor, this radar works by measuring a range from 3cm to 40 cm as non…☆19Nov 11, 2024Updated 2 years ago
- Set of tools helping developers to build TEE-enabled application quicker.☆16Aug 22, 2025Updated last year
- ☆12Apr 3, 2026Updated 7 months ago
- Real-Time Alerts with AI, NATs and Streamlit☆10Jan 2, 2025Updated last year
- GoogleSQL dialect format server using ZetaSQL☆22Dec 16, 2021Updated 4 years ago
- An AI-powered system that generates sustainable trip plans and tourism recommendations for Southeast Asia. Built using a Retrieval-Augmen…☆14Oct 8, 2024Updated 2 years ago
Are these results useful?