douglasag17 / real-time-data-to-snowflake
Streaming data from a transactional database to a data warehouse using Kafka (Confluent Cloud), Snowflake, and PostgreSQL.
☆13Updated last year
Alternatives and similar repositories for real-time-data-to-snowflake:
Users that are interested in real-time-data-to-snowflake are comparing it to the libraries listed below
- The resources of the preparation course for Databricks Data Engineer Associate certification exam☆316Updated last month
- This is a template you can use for your next data engineering portfolio project.☆173Updated 3 years ago
- Sample project to demonstrate data engineering best practices☆174Updated 10 months ago
- ☆129Updated last year
- A template repository to create a data project with IAC, CI/CD, Data migrations, & testing☆253Updated 6 months ago
- Near real time ETL to populate a dashboard.☆71Updated 7 months ago
- Learn the entire ETL process based on Spotify API data☆250Updated 3 years ago
- ☆144Updated 2 years ago
- End to end data engineering project☆53Updated 2 years ago
- tokyo-olympic-azure-data-engineering-project☆176Updated 6 months ago
- ☆325Updated 4 months ago
- This repo contains "Databricks Certified Data Engineer Associate" Questions and related docs.☆106Updated 5 months ago
- I'm partaking in a Data Engineering Bootcamp / Zoomcamp. I'll store files and progress here.☆101Updated 2 years ago
- The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such …☆118Updated 2 years ago
- Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow☆135Updated 4 years ago
- Stream processing pipeline from Finnhub websocket using Spark, Kafka, Kubernetes and more☆317Updated last year
- Source code of the Apache Airflow Tutorial for Beginners on YouTube Channel Coder2j (https://www.youtube.com/c/coder2j)☆280Updated 10 months ago
- YouTube tutorial project☆97Updated last year
- Pipeline that extracts data from Crinacle's Headphone and InEarMonitor databases and finalizes data for a Metabase Dashboard. The dashboa…☆215Updated 2 years ago
- sql-for-data-engineering-course☆19Updated last year
- All demo code for the Udemy course "Programming in Snowflake".☆18Updated 7 months ago
- Docker with Airflow and Spark standalone cluster☆247Updated last year
- This project is for demonstrating knowledge of Data Engineering tools and concepts and also learning in the process☆45Updated 2 years ago
- Ultimate guide for mastering Spark Performance Tuning and Optimization concepts and for preparing for Data Engineering interviews☆97Updated 8 months ago
- Price Crawler - Tracking Price Inflation☆185Updated 4 years ago
- ☆116Updated 3 months ago
- Data Engineering YouTube Analysis Project by Darshil Parmar☆168Updated last year
- Local Environment to Practice Data Engineering☆120Updated 3 weeks ago
- This repo will guide you step-by-step method to create star schema dimensional model.☆24Updated 3 years ago
- Sample repo for startdataengineering DE 101 free course☆43Updated 6 months ago