This is a real-life, high throughput streaming ELT data pipeline for ecommerce
β15May 22, 2023Updated 3 years ago
Alternatives and similar repositories for streaming-elt-pipeline
Users that are interested in streaming-elt-pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- strategy backtesting frameworkβ14Oct 22, 2024Updated 2 years ago
- Automate and streamline the alerting & notification process for dbt test resultsππβ19Mar 30, 2026Updated 7 months ago
- Homework and notes for the DataTalks.Club MLOps Zoomcampβ11Sep 10, 2022Updated 4 years ago
- Cloud Spanner Connector for Apache Sparkβ18Updated this week
- My first attempt at a rough ETL pipeline; technologies include spark, GCS, prefect orchestration, and terraformβ14Oct 12, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient β’ AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- β20Dec 1, 2024Updated last year
- Collection Of All Python Notebooks Shared On Twitterβ11Apr 10, 2023Updated 3 years ago
- Python SDK for Warrantβ12Jun 3, 2024Updated 2 years ago
- A URL shortener written in Go, with a Mongo based backend, Prometheus and Grafana based monitoring, Memcached based write-through cachingβ¦β38Jun 11, 2021Updated 5 years ago
- Resources and projects from Udacity Data Engineering with AWS nano degree programmeβ30Apr 12, 2023Updated 3 years ago
- Easily put your django site behind a layer of Basic Authentication, for protecting the staging/testing serversβ13Apr 26, 2022Updated 4 years ago
- dbt plugin for Palm CLIβ20Mar 20, 2024Updated 2 years ago
- β10Sep 17, 2024Updated 2 years ago
- This repository provides the resources required for the Amazon Redshift Streaming workshopβ14Apr 13, 2026Updated 7 months ago
- Virtual machines for every use case on DigitalOcean β’ AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- fastAPI-Tutorialβ38Oct 11, 2026Updated last month
- Hudi Demo Notebookβ11Mar 5, 2024Updated 2 years ago
- Deployed an kafka instance in AWS EC2 Instance to streamline the data into Databricksβ10Aug 15, 2023Updated 3 years ago
- Cross-provider market data validation for OHLCV prices, adjusted returns, discrepancies, and consensus datasets.β16Sep 28, 2026Updated last month
- An agent harness built step by step with LangGraph, as a tutorial seriesβ18Sep 29, 2026Updated last month
- β26Mar 22, 2025Updated last year
- Sorting Algorithms Visualizer which sorts colors, graphs, and barsβ16Sep 15, 2020Updated 6 years ago
- Rank_3 Solution.β15Jun 22, 2020Updated 6 years ago
- β13Nov 12, 2016Updated 10 years ago
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Boilerplate for PySpark on Cloud Kubernetesβ33Oct 12, 2021Updated 5 years ago
- Various projects built using express JS.β12Mar 5, 2023Updated 3 years ago
- Example application to support Proof of Value of the Change Stream technology in MongoDBβ12Feb 14, 2019Updated 7 years ago
- A pathfinder visualizer in Flutter. Create mazes, generate random walls, or draw your own walls and see the pathfinding algorithms in actβ¦β17Sep 19, 2020Updated 6 years ago
- Role-Based Access Control System for Python implements ANSI INCITS 359β15Aug 29, 2025Updated last year
- Using scene-specific contexts and region-based attention in neural image captioningβ45Apr 8, 2020Updated 6 years ago
- Play design patternsβ12Feb 14, 2019Updated 7 years ago
- Pine Script v5 indicator that detects BOS/MSS structure, marks a stop and TP when a reversal breaks a swing inside the prior zone, and caβ¦β15Sep 30, 2026Updated last month
- it's bad don't even tryβ20Aug 16, 2026Updated 3 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits β’ AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- dbtenv is a version manager for dbt, automatically installing and switching to the needed adapter and version of dbt.β31Oct 27, 2022Updated 4 years ago
- Takes dbt runs and turns them into OpenTelemetry tracesβ11Jun 20, 2025Updated last year
- FluctSDK for Androidβ10Nov 12, 2026Updated last week
- Batch Final Project for Data Engineering Zoomcamp Courseβ11Apr 6, 2023Updated 3 years ago
- A data generator script for Shopifyβ14Sep 5, 2020Updated 6 years ago
- ecommerce GCP Streaming pipeline β Cloud Storage, Compute Engine, Pub/Sub, Dataflow, Apache Beam, BigQuery and Tableau; GCP Batch pipelinβ¦β10Mar 9, 2022Updated 4 years ago
- Get historical dividends, splits, capital gains distributions, and prices for a set of symbols from Yahoo Financeβ12Dec 23, 2025Updated 10 months ago
Are these results useful?