Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data
☆50Dec 2, 2023Updated 2 years ago
Alternatives and similar repositories for Building-Data-LakeHouse
Users that are interested in Building-Data-LakeHouse are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Building Data Lakehouse by open source technology. Support end to end data pipeline, from source data on AWS S3 to Lakehouse, visualize a…☆41Dec 15, 2025Updated 10 months ago
- This project implements an ELT (Extract - Load - Transform) data pipeline with the goodreads dataset, using dagster (orchestration), spar…☆45Apr 22, 2023Updated 3 years ago
- velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…☆20Aug 12, 2025Updated last year
- ☆23Feb 5, 2024Updated 2 years ago
- RAG-Microservice: A robust, scalable question-answering service leveraging the Retriever-Answer Generator (RAG) architecture. Built with …☆16Jan 18, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- This project serves as a comprehensive guide to building an end-to-end data engineering pipeline using TCP/IP Socket, Apache Spark, OpenA…☆47Jan 4, 2024Updated 2 years ago
- ☆25Mar 15, 2024Updated 2 years ago
- NoSQL extract, transform, load (ETL) toolkit with Python☆16Oct 7, 2026Updated last week
- trino + hive + minio with postgres in docker compose☆28Aug 18, 2023Updated 3 years ago
- Comprehensive study materials covering core data engineering concepts, tools, and practices.☆19Jan 20, 2026Updated 8 months ago
- used Airflow, Postgres, Kafka, Spark, and Cassandra, and GitHub Actions to establish an end-to-end data pipeline☆32Oct 25, 2023Updated 2 years ago
- ☆42Jul 4, 2022Updated 4 years ago
- POC for all the stack of big data (kafka, spark, cassandra, hdfs, docker, springboot)☆12Dec 16, 2022Updated 3 years ago
- Repo which holds the materials for the EMR Zero To Hero☆28May 7, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Micosoft Power BI Custom Connector allowing you to import Trino data into Power BI.☆93Jan 8, 2025Updated last year
- ☆19May 11, 2023Updated 3 years ago
- ☆33Nov 10, 2025Updated 11 months ago
- https://aka.ms/lakehouselab☆23Feb 14, 2023Updated 3 years ago
- A ready to go Big Data cluster (Hadoop + Hadoop Streaming + Spark + PySpark) with Docker and Docker Swarm!☆22May 20, 2025Updated last year
- Runner-up team (2nd place) in AI4VN2022: Air Quality Forcasting Challenge☆31Jul 12, 2023Updated 3 years ago
- This project uses Google Analytics 4 BigQuery Exports as its source data, and offers useful base transformations to provide report-ready …☆20Sep 30, 2022Updated 4 years ago
- ☆80Apr 23, 2025Updated last year
- Spark Structured Streaming data pipeline that processes movie ratings data in real-time.☆14Oct 7, 2026Updated last week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Hands-On SQL Server 2019 Analysis Services, published by Packt.☆11Apr 22, 2026Updated 5 months ago
- Trino AI SQL Functions☆16Nov 29, 2024Updated last year
- plan, design and implement enterprise data infrastructure solutions and create the blueprints for an organization’s data management syste…☆12Jun 25, 2023Updated 3 years ago
- AKS Course - Pluralsight☆10Oct 29, 2022Updated 3 years ago
- ☆13Feb 27, 2024Updated 2 years ago
- ☆12Mar 30, 2024Updated 2 years ago
- List customize [dot] files config.☆11May 14, 2025Updated last year
- ☆10Aug 2, 2021Updated 5 years ago
- Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline☆77Feb 15, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Mass Suricata rules creator, from a list of domain☆14Sep 14, 2018Updated 8 years ago
- Google Cloud Platform solution that provides an event driven process that flattens (unnests) Google Analytics 360 data that has been expo…☆16Apr 13, 2026Updated 6 months ago
- Apache iceberg Spark s3 examples☆20Mar 1, 2024Updated 2 years ago
- Code for youtube channel☆10Apr 15, 2022Updated 4 years ago
- Apache NiFi deployment on OpenShift☆13Jul 18, 2023Updated 3 years ago
- API for toxic text classification, utilized pre-trained Distilbert and trained on Kaggle datasets. It helps identify and handle toxic con…☆14Apr 30, 2024Updated 2 years ago
- Examples of all Machine Learning Algorithm in Apache Spark☆15Nov 2, 2017Updated 8 years ago