codingvarun / streaming-elt-pipelineLinks
This is a real-life, high throughput streaming ELT data pipeline for ecommerce
☆13Updated 2 years ago
Alternatives and similar repositories for streaming-elt-pipeline
Users that are interested in streaming-elt-pipeline are comparing it to the libraries listed below
Sorting:
- ☆17Updated 10 months ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆28Updated 2 years ago
- reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.☆14Updated last year
- ☆18Updated 9 months ago
- Snowflake Guide: Building a Recommendation Engine Using Snowflake & Amazon SageMaker☆31Updated 3 years ago
- dbt / Amazon Redshift Demonstration Project☆34Updated 2 years ago
- Repo for holding the dbt project used to make sense of cloud cost data from the major cloud platforms☆37Updated 5 years ago
- Snowflake & AWS Service Catalog Integration☆10Updated 2 years ago
- dbt package for monitoring airflow DAGs and tasks☆29Updated 3 months ago
- This repository has a collection of utilities for Glue Crawlers. These utilities come in the form of AWS CloudFormation templates or AWS …☆19Updated 3 years ago
- Full stack data engineering tools and infrastructure set-up☆53Updated 4 years ago
- Automate and streamline the alerting & notification process for dbt test results🐞🚀☆17Updated last month
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆29Updated 2 years ago
- Cloned by the `dbt init` task☆61Updated last year
- An example dbt project using AutomateDV to create a Data Vault 2.0 Data Warehouse based on the Snowflake TPC-H dataset.☆50Updated last year
- Cost Efficient Data Pipelines with DuckDB☆53Updated 3 weeks ago
- Code for my "Efficient Data Processing in SQL" book.☆56Updated 9 months ago
- dlt-dagster-demo☆11Updated last year
- Code to help generate SQL for stakeholders. Code at https://www.startdataengineering.com/post/data-democratize-llm/☆11Updated last year
- Public source code for the Batch Processing with Apache Beam (Python) online course☆18Updated 4 years ago
- Example Set up For DBT Cloud using Github Integrations☆11Updated 5 years ago
- Fully unit tested utility functions for data engineering. Python 3 only.☆17Updated 9 months ago
- Collection of utility scripts to extract code so it can be upgraded to SnowFlake using the SnowConvert tool.☆15Updated last month
- A template DBT project for BigQuery on Google Cloud☆12Updated 4 years ago
- Layer DBT Adapters☆18Updated 2 years ago
- Source code for the YouTube video, Apache Beam Explained in 12 Minutes☆21Updated 4 years ago
- Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market☆58Updated 2 years ago
- Serverless ETL and Analytics with AWS Glue, published by Packt☆48Updated last year
- End-to-End ELT data pipeline with Postgres, Airbyte, dbt, Dagster, Snowflake and Metabase☆11Updated last year
- A template for dockerized dbt-Core projects with VS Code Dev Containers.☆21Updated 2 years ago