hnawaz007 / datalakeLinks
open source data lake
☆28Updated 10 months ago
Alternatives and similar repositories for datalake
Users that are interested in datalake are comparing it to the libraries listed below
Sorting:
- A Postgres data warehouse for processing synthetic data using IAC principles☆19Updated 2 years ago
- ☆88Updated 3 years ago
- ☆44Updated last year
- Full stack data engineering tools and infrastructure set-up☆57Updated 4 years ago
- PySpark Tutorial for Beginners on Google Colab: Hands-On Guide☆17Updated 5 years ago
- ☆10Updated 3 years ago
- Delta Lake Documentation☆51Updated last year
- Data Engineering with Spark and Delta Lake☆106Updated 2 years ago
- In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …☆37Updated last year
- Public source code for the Batch Processing with Apache Beam (Python) online course☆18Updated 5 years ago
- ☆72Updated this week
- Cost Efficient Data Pipelines with DuckDB☆60Updated 7 months ago
- This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and …☆34Updated last year
- ☆12Updated 3 years ago
- ☆21Updated 2 years ago
- To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…☆44Updated last year
- build dw with dbt☆49Updated last year
- Data Engineering with Scala, published by Packt☆27Updated last year
- Cloned by the `dbt init` task☆62Updated last year
- New generation opensource data stack☆76Updated 3 years ago
- Data engineering with dbt, published by Packt☆88Updated 3 months ago
- Duke MIDS: Data Engineering and DataOps Course☆67Updated 11 months ago
- Dockerizing an Apache Spark Standalone Cluster☆43Updated 3 years ago
- This repository contains an Apache Flink application for real-time sales analytics built using Docker Compose to orchestrate the necessar…☆46Updated 2 years ago
- Challenge Data Engineer☆25Updated 3 years ago
- Predicting Car Prices with FastAPI, Streamlit, MLflow, Kafka, and Debezium: A Practical Demonstration☆22Updated last year
- ☆16Updated 6 years ago
- Code for dbt tutorial☆165Updated 3 months ago
- Data pipeline that scrapes Rust cheater Steam profiles☆54Updated 3 years ago
- Scaling Machine Learning in Three Week course in a collaboration with O'Reilly following the guidance of Adi Polak's book - Scaling Machi…☆23Updated 2 years ago