Stefen-Taime / modern-data-pipelineView external linksLinks
reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.
☆15Jun 26, 2023Updated 2 years ago
Alternatives and similar repositories for modern-data-pipeline
Users that are interested in modern-data-pipeline are comparing it to the libraries listed below
Sorting:
- In this article, you will learn how to set up a real-time data processing and analytics environment using Docker, MySQL, Redpanda, MinIO,…☆11Jun 27, 2023Updated 2 years ago
- Machine Learning DevOps Engineer Nanodegree☆11Jan 27, 2022Updated 4 years ago
- ☆16Jul 15, 2023Updated 2 years ago
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆28Apr 12, 2023Updated 2 years ago
- Data Pipeline from the Global Historical Climatology Network DataSet☆27Dec 20, 2022Updated 3 years ago
- Example repo to create end to end tests for data pipeline.☆25Jun 14, 2024Updated last year
- Big Data Engineering & Analytics Project☆36Nov 6, 2020Updated 5 years ago
- Simple ETL pipeline using Python☆29May 22, 2023Updated 2 years ago
- Repository for Data Engineering Interview Series☆36Oct 17, 2024Updated last year
- ☆29Jan 12, 2023Updated 3 years ago
- ☆30Nov 16, 2023Updated 2 years ago
- Final Project for Data Engineering Zoomcamp Course 2024 🧙🔥☆11Apr 17, 2024Updated last year
- This is a real-life, high throughput streaming ELT data pipeline for ecommerce☆14May 22, 2023Updated 2 years ago
- ☆15Sep 7, 2025Updated 5 months ago
- My solutions for the Udacity Data Engineering Nanodegree☆34Oct 14, 2019Updated 6 years ago
- ☆10Jan 28, 2025Updated last year
- ☆10Nov 27, 2023Updated 2 years ago
- The "One Role to Rule them all" Ansible setup☆12Sep 20, 2019Updated 6 years ago
- full code written for the Twilio blog https://www.twilio.com/blog/media-file-storage-python-flask-amazon-s3-buckets☆11May 4, 2024Updated last year
- Maps Medicare LDS claims data to the Tuva Input Layer so you can easily run the Tuva Project.☆11Dec 15, 2025Updated 2 months ago
- This is the end to end MLOps project I built through participated the MLOps Zoomcamp☆10Sep 11, 2022Updated 3 years ago
- A Deep Reinforcement Learning Library for Automated Trading in Quantitative Finance. NeurIPS 2020. Please star. 🔥☆12Mar 13, 2023Updated 2 years ago
- A fun little data analysis project to whether American prefers Mexican food over Italian food or Chinese Food.☆12Sep 11, 2017Updated 8 years ago
- ☆11Jan 13, 2024Updated 2 years ago
- Python tool to help export Azure DevOps WIKI into a single PDF☆10May 10, 2020Updated 5 years ago
- DuckDuckGo Image Search Resuts - Programatically download Image Search Results☆10Jan 18, 2023Updated 3 years ago
- ☆11Dec 9, 2020Updated 5 years ago
- Business challenge that requires building a data platform for retailer data analytics.☆16Feb 19, 2023Updated 2 years ago
- Courses and projects on Data Camp☆11Jun 28, 2020Updated 5 years ago
- ☆13Sep 9, 2024Updated last year
- ☆10Mar 22, 2021Updated 4 years ago
- This is a discord bot written in C# which allows guilds to create a personality that they can interact with.☆12Aug 7, 2023Updated 2 years ago
- Tooling to build a custom Confluent Platform Kafka Connect container with additional connectors from Confluent Hub.☆15Oct 26, 2020Updated 5 years ago
- Dapr SDK to compose pluggable components in Go.☆11Jul 16, 2025Updated 7 months ago
- ☆10May 24, 2021Updated 4 years ago
- Different ways to connect to storage in Azure Databricks☆11Jul 19, 2019Updated 6 years ago
- Analyze coinbase orderbook in real-time in Python with Bytewax☆11Apr 23, 2024Updated last year
- PrimeHub Python SDK☆14Apr 21, 2023Updated 2 years ago
- A simple home-made way of getting AI to help you out during a remote interview☆11Nov 30, 2023Updated 2 years ago