Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data
☆50Dec 2, 2023Updated 2 years ago
Alternatives and similar repositories for Building-Data-LakeHouse
Users that are interested in Building-Data-LakeHouse are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Building Data Lakehouse by open source technology. Support end to end data pipeline, from source data on AWS S3 to Lakehouse, visualize a…☆42Dec 15, 2025Updated 10 months ago
- Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…☆81Sep 2, 2023Updated 3 years ago
- Building Realtime End to End Sales Forecasting ML Pipeline☆15Jul 30, 2025Updated last year
- velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…☆20Aug 12, 2025Updated last year
- This project implements an ELT (Extract - Load - Transform) data pipeline with the goodreads dataset, using dagster (orchestration), spar…☆45Apr 22, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- End-to-end ELT data engineering project☆23Dec 24, 2022Updated 3 years ago
- ☆23Feb 5, 2024Updated 2 years ago
- RAG-Microservice: A robust, scalable question-answering service leveraging the Retriever-Answer Generator (RAG) architecture. Built with …☆16Jan 18, 2025Updated last year
- This project serves as a comprehensive guide to building an end-to-end data engineering pipeline using TCP/IP Socket, Apache Spark, OpenA…☆47Jan 4, 2024Updated 2 years ago
- Basic framework utilities to quickly start writing production ready Apache Spark applications☆36Dec 15, 2024Updated last year
- ☆25Mar 15, 2024Updated 2 years ago
- Commercetools Python SDK☆17Oct 27, 2026Updated last week
- Delta Sharing + MLflow for ML model & experiment exchange (arcuate delta - a fan shaped river delta)☆22Jan 29, 2026Updated 9 months ago
- This repository contains an Apache Flink application for real-time sales analytics built using Docker Compose to orchestrate the necessar…☆53Dec 4, 2023Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- POC for all the stack of big data (kafka, spark, cassandra, hdfs, docker, springboot)☆12Dec 16, 2022Updated 3 years ago
- A ready to go Big Data cluster (Hadoop + Hadoop Streaming + Spark + PySpark) with Docker and Docker Swarm!☆22May 20, 2025Updated last year
- This project demonstrates how to use Apache Airflow to submit jobs to Apache spark cluster in different programming laguages using Python…☆47Mar 14, 2024Updated 2 years ago
- ☆42Jul 4, 2022Updated 4 years ago
- Autonomous UAV-Based Maritime SAR using onboard YOLOv8/v11 for real-time swimmer detection and precision life buoy deployment. Combines G…☆17Aug 7, 2026Updated 2 months ago
- https://aka.ms/lakehouselab☆23Feb 14, 2023Updated 3 years ago
- This project uses Google Analytics 4 BigQuery Exports as its source data, and offers useful base transformations to provide report-ready …☆20Sep 30, 2022Updated 4 years ago
- In this project I have built etl pipline which scraps the trending repository based on month,week and day LIVE extract other related info…☆12Sep 9, 2023Updated 3 years ago
- 🌟 An end-to-end full-stack data science project, including modelling, MLOps, and data storytelling. ✨☆16Aug 30, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆18Jul 25, 2024Updated 2 years ago
- NoSQL extract, transform, load (ETL) toolkit with Python☆16Oct 31, 2026Updated last week
- A Micosoft Power BI Custom Connector allowing you to import Trino data into Power BI.☆93Oct 30, 2026Updated last week
- Spark data pipeline that processes movie ratings data.☆31Updated this week
- A Python Client for Hive Metastore☆14Nov 4, 2025Updated last year
- ☆14Feb 23, 2025Updated last year
- The DataLake GraphQL Wrapper provides a GraphQL API for presto/trino.☆19Apr 17, 2023Updated 3 years ago
- Data pipeline project☆66Feb 11, 2025Updated last year
- cSkyLab is a virtual data center model that allows fast application deployment and gives you the choice to scale up your services in any …☆14Oct 30, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- In this article, you will learn how to set up a real-time data processing and analytics environment using Docker, MySQL, Redpanda, MinIO,…☆11Jun 27, 2023Updated 3 years ago
- Trino AI SQL Functions☆16Nov 29, 2024Updated last year
- A modern webUI for managing MinIO clusters☆12Oct 30, 2026Updated last week
- ☆13Feb 27, 2024Updated 2 years ago
- Apache iceberg Spark s3 examples☆20Mar 1, 2024Updated 2 years ago
- Examples of all Machine Learning Algorithm in Apache Spark☆15Nov 2, 2017Updated 9 years ago
- Guess what! ;)☆17Oct 5, 2026Updated last month