reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.
☆14Jun 26, 2023Updated 2 years ago
Alternatives and similar repositories for modern-data-pipeline
Users that are interested in modern-data-pipeline are comparing it to the libraries listed below
Sorting:
- In this article, you will learn how to set up a real-time data processing and analytics environment using Docker, MySQL, Redpanda, MinIO,…☆11Jun 27, 2023Updated 2 years ago
- Machine Learning DevOps Engineer Nanodegree☆11Jan 27, 2022Updated 4 years ago
- ☆16Jul 15, 2023Updated 2 years ago
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆27Apr 12, 2023Updated 2 years ago
- Data Pipeline from the Global Historical Climatology Network DataSet☆27Dec 20, 2022Updated 3 years ago
- Example repo to create end to end tests for data pipeline.☆25Jun 14, 2024Updated last year
- Repository for Data Engineering Interview Series☆36Oct 17, 2024Updated last year
- Simple ETL pipeline using Python☆29May 22, 2023Updated 2 years ago
- Big Data Engineering & Analytics Project☆36Nov 6, 2020Updated 5 years ago
- ☆29Jan 12, 2023Updated 3 years ago
- ☆30Nov 16, 2023Updated 2 years ago
- Final Project for Data Engineering Zoomcamp Course 2024 🧙🔥☆11Apr 17, 2024Updated last year
- The "One Role to Rule them all" Ansible setup☆12Sep 20, 2019Updated 6 years ago
- My solutions for the Udacity Data Engineering Nanodegree☆34Oct 14, 2019Updated 6 years ago
- A Gentle Introduction to RAG☆15Oct 8, 2024Updated last year
- Maps Medicare LDS claims data to the Tuva Input Layer so you can easily run the Tuva Project.☆12Dec 15, 2025Updated 2 months ago
- Python tool to help export Azure DevOps WIKI into a single PDF☆10May 10, 2020Updated 5 years ago
- full code written for the Twilio blog https://www.twilio.com/blog/media-file-storage-python-flask-amazon-s3-buckets☆11May 4, 2024Updated last year
- This is a real-life, high throughput streaming ELT data pipeline for ecommerce☆15May 22, 2023Updated 2 years ago
- ☆11Jan 13, 2024Updated 2 years ago
- A Deep Reinforcement Learning Library for Automated Trading in Quantitative Finance. NeurIPS 2020. Please star. 🔥☆12Mar 13, 2023Updated 2 years ago
- ☆15Sep 7, 2025Updated 6 months ago
- A fun little data analysis project to whether American prefers Mexican food over Italian food or Chinese Food.☆12Sep 11, 2017Updated 8 years ago
- DuckDuckGo Image Search Resuts - Programatically download Image Search Results☆11Jan 18, 2023Updated 3 years ago
- This is the end to end MLOps project I built through participated the MLOps Zoomcamp☆10Sep 11, 2022Updated 3 years ago
- ☆10Jan 28, 2025Updated last year
- Objects and Animals detection with Wifi camera and Yolo☆15Apr 28, 2024Updated last year
- R package for tracking Covid19 cases in San Francisco☆12Apr 2, 2023Updated 2 years ago
- Analyze coinbase orderbook in real-time in Python with Bytewax☆11Apr 23, 2024Updated last year
- Sample Project to Learn Data Engineering☆10Aug 1, 2021Updated 4 years ago
- ☆10May 24, 2021Updated 4 years ago
- Classify images of different kitchenware items☆11Apr 17, 2023Updated 2 years ago
- Dapr SDK to compose pluggable components in Go.☆11Jul 16, 2025Updated 7 months ago
- Code for the paper "FinRLlama: A Solution to LLM-Engineered Signals Challenge at FinRL Contest 2024"☆13Feb 14, 2025Updated last year
- PrimeHub Python SDK☆13Apr 21, 2023Updated 2 years ago
- Ansible setup of my development workstation☆13Sep 22, 2023Updated 2 years ago
- An experimental attempt to make a CLI for supply-chain modeling for Helpful Engineering's Project Data☆10Oct 29, 2023Updated 2 years ago
- hackintosh 13900 macos☆12Jun 23, 2023Updated 2 years ago
- This is a discord bot written in C# which allows guilds to create a personality that they can interact with.☆12Aug 7, 2023Updated 2 years ago