codingvarun / streaming-elt-pipeline
This is a real-life, high throughput streaming ELT data pipeline for ecommerce
☆13Updated last year
Alternatives and similar repositories for streaming-elt-pipeline:
Users that are interested in streaming-elt-pipeline are comparing it to the libraries listed below
- ☆17Updated 7 months ago
- reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.☆14Updated last year
- Snowflake Guide: Building a Recommendation Engine Using Snowflake & Amazon SageMaker☆31Updated 3 years ago
- The goal of this project is to offer an AWS EMR template using Spot Fleet and On-Demand Instances that you can use quickly. Just focus on…☆26Updated 2 years ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆27Updated 2 years ago
- Full stack data engineering tools and infrastructure set-up☆50Updated 4 years ago
- Code to help generate SQL for stakeholders. Code at https://www.startdataengineering.com/post/data-democratize-llm/☆11Updated 10 months ago
- Step by step instructions to create a production-ready data pipeline☆42Updated 3 months ago
- Example repo to create end to end tests for data pipeline.☆22Updated 9 months ago
- Apache Airflow advanced functionalities examples☆15Updated last year
- DataHub on AWS demonstration resources☆10Updated 2 years ago
- Automate and streamline the alerting & notification process for dbt test results🐞🚀☆17Updated last month
- This repository has a collection of utilities for Glue Crawlers. These utilities come in the form of AWS CloudFormation templates or AWS …☆19Updated 3 years ago
- Repo for holding the dbt project used to make sense of cloud cost data from the major cloud platforms☆37Updated 5 years ago
- ☆10Updated 2 years ago
- ☆65Updated last week
- ☆15Updated 7 months ago
- Skeleton project for Apache Airflow training participants to work on.☆16Updated 4 years ago
- An example dbt project using AutomateDV to create a Data Vault 2.0 Data Warehouse based on the Snowflake TPC-H dataset.☆46Updated last year
- data engineering 100 days 🤖 🧲 🦾 | #DE☆40Updated last year
- All the Snowflake Virtual Warehouse - Example☆12Updated 4 years ago
- Example Set up For DBT Cloud using Github Integrations☆11Updated 5 years ago
- ☆11Updated 3 years ago
- Build & Learn Data Engineering,Machine Learning over Kubernetes. No Shortcut approach.☆57Updated 2 years ago
- A simple Data Engineering solution for testing or education purposes. You only need to know SQL and Python to understand this project. Da…☆25Updated 2 years ago
- dbt / Amazon Redshift Demonstration Project☆34Updated 2 years ago
- learning-by-doing data model built with dbt-core☆11Updated 3 months ago
- Utility functions for dbt projects running on Spark☆31Updated last month
- Analytics Engineering best practices and standards used at Hiflylabs☆12Updated last week
- Faker for Snowflake!☆33Updated 2 years ago