douglasag17 / real-time-data-to-snowflakeLinks
Streaming data from a transactional database to a data warehouse using Kafka (Confluent Cloud), Snowflake, and PostgreSQL.
☆15Updated last year
Alternatives and similar repositories for real-time-data-to-snowflake
Users that are interested in real-time-data-to-snowflake are comparing it to the libraries listed below
Sorting:
- A template repository to create a data project with IAC, CI/CD, Data migrations, & testing☆265Updated 11 months ago
- The resources of the preparation course for Databricks Data Engineer Professional certification exam☆117Updated this week
- ☆9Updated 2 months ago
- ☆133Updated 4 months ago
- End to end data engineering project☆56Updated 2 years ago
- This repo contains "Databricks Certified Data Engineer Professional" Questions and related docs.☆81Updated 10 months ago
- Companion repository that goes along with Snowflake's "Introduction to Modern Data Engineering with Snowflake" course on Coursera☆62Updated 4 months ago
- This project is for demonstrating knowledge of Data Engineering tools and concepts and also learning in the process☆46Updated 2 years ago
- Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR☆84Updated 5 years ago
- ☆141Updated 2 years ago
- ☆151Updated 3 years ago
- This repository will contain all of the resources for the Mage component of the Data Engineering Zoomcamp: https://github.com/DataTalksCl…☆99Updated 10 months ago
- Repo for saving cheat sheets☆56Updated last year
- ☆21Updated last year
- This is a template you can use for your next data engineering portfolio project.☆176Updated 3 years ago
- Apartments Data Pipeline using Airflow and Spark.☆21Updated 3 years ago
- ☆22Updated last year
- Sample repo for startdataengineering DE 101 free course☆64Updated last year
- ☆87Updated 2 years ago
- Code for "Advanced data transformations in SQL" free live workshop☆82Updated last month
- Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow☆147Updated 5 years ago
- Sample project to demonstrate data engineering best practices☆194Updated last year
- With everything I learned from DEZoomcamp from datatalks.club, this project performs a batch processing on AWS for the cycling dataset wh…☆14Updated 3 years ago
- Generate synthetic Spotify music stream dataset to create dashboards. Spotify API generates fake event data emitted to Kafka. Spark consu…☆68Updated last year
- ☆51Updated last year
- Challenge Data Engineer☆25Updated 3 years ago
- ☆182Updated 4 years ago
- This project is about building a dimensional data warehouse in BigQuery by transforming an OLTP system to an OLAP system, using dbt as ou…☆12Updated last year
- The resources of the preparation course for Databricks Data Engineer Associate certification exam☆429Updated this week
- Price Crawler - Tracking Price Inflation☆184Updated 5 years ago