This is a real-life, high throughput streaming ELT data pipeline for ecommerce
☆15May 22, 2023Updated 2 years ago
Alternatives and similar repositories for streaming-elt-pipeline
Users that are interested in streaming-elt-pipeline are comparing it to the libraries listed below
Sorting:
- My first attempt at a rough ETL pipeline; technologies include spark, GCS, prefect orchestration, and terraform☆14Oct 12, 2022Updated 3 years ago
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆27Apr 12, 2023Updated 2 years ago
- dbt plugin for Palm CLI☆20Mar 20, 2024Updated last year
- dbtenv is a version manager for dbt, automatically installing and switching to the needed adapter and version of dbt.☆31Oct 27, 2022Updated 3 years ago
- Creation of a Fantasy Premier League data pipeline for analysis of both team & player performance. Technologies include, dbt, Prefect, Te…☆11Apr 13, 2023Updated 2 years ago
- An AI-powered CLI tool for converting DBT SQL files to YAML using OpenAI.☆11Mar 25, 2024Updated last year
- Sample project to get started with dbt-power-user vscode extension using dev-container☆11Apr 5, 2024Updated last year
- Repo for holding the dbt project used to make sense of cloud cost data from the major cloud platforms☆38Mar 1, 2020Updated 6 years ago
- Jinja cheatsheet for dbt development☆41Jul 25, 2022Updated 3 years ago
- This is the end to end MLOps project I built through participated the MLOps Zoomcamp☆10Sep 11, 2022Updated 3 years ago
- ecommerce GCP Streaming pipeline ― Cloud Storage, Compute Engine, Pub/Sub, Dataflow, Apache Beam, BigQuery and Tableau; GCP Batch pipelin…☆11Mar 9, 2022Updated 3 years ago
- Scala発火村の資料ですお☆30Oct 18, 2010Updated 15 years ago
- FluctSDK for Android☆10Updated this week
- Palm CLI - the tool-belt for data teams☆47Mar 20, 2024Updated last year
- strategy backtesting framework☆12Oct 22, 2024Updated last year
- Homework and notes for the DataTalks.Club MLOps Zoomcamp☆12Sep 10, 2022Updated 3 years ago
- Deployed an kafka instance in AWS EC2 Instance to streamline the data into Databricks☆10Aug 15, 2023Updated 2 years ago
- ☆10Jun 7, 2023Updated 2 years ago
- ☆17May 26, 2023Updated 2 years ago
- dbt + steampipe playground☆10Nov 5, 2022Updated 3 years ago
- ☆13Nov 12, 2016Updated 9 years ago
- Example multi-region application with data residency. Suitable for global and regulated businesses.☆12Dec 1, 2023Updated 2 years ago
- Decision tree that runs off a user supplied question graph☆10Oct 5, 2022Updated 3 years ago
- textlint + reviewdog example project☆12Feb 10, 2017Updated 9 years ago
- Analytics Engineering best practices and standards used at Hiflylabs☆12Jul 7, 2025Updated 7 months ago
- Business challenge that requires building a data platform for retailer data analytics.☆17Feb 19, 2023Updated 3 years ago
- Courses and projects on Data Camp☆11Jun 28, 2020Updated 5 years ago
- Easily put your django site behind a layer of Basic Authentication, for protecting the staging/testing servers☆13Apr 26, 2022Updated 3 years ago
- An experimental attempt to make a CLI for supply-chain modeling for Helpful Engineering's Project Data☆10Oct 29, 2023Updated 2 years ago
- Capstone Project for the IBM Data Engineering Professional Certification.☆13Mar 7, 2022Updated 3 years ago
- clean-architecture sample of go☆10Dec 1, 2018Updated 7 years ago
- A GitHub Action which sets your AWS environment variables so that it can assume a role☆12Feb 14, 2020Updated 6 years ago
- Simple k8s watcher to copy a file into a configmap☆11Aug 5, 2023Updated 2 years ago
- Sample Project to Learn Data Engineering☆10Aug 1, 2021Updated 4 years ago
- Amazon ECR-ECS deployment service☆11May 17, 2017Updated 8 years ago
- From the SELECT team, a dbt package to automatically tag dbt-issued queries with informative metadata.☆54Jan 19, 2026Updated last month
- Example application to support Proof of Value of the Change Stream technology in MongoDB☆12Feb 14, 2019Updated 7 years ago
- Advanced TradingView like watchlists for Zerodha Kite☆12Dec 26, 2025Updated 2 months ago
- Collection of LeetCode questions to ace the coding interview!☆15Feb 22, 2026Updated last week