reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.
☆15Jun 26, 2023Updated 3 years ago
Alternatives and similar repositories for modern-data-pipeline
Users that are interested in modern-data-pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- In this article, you will learn how to set up a real-time data processing and analytics environment using Docker, MySQL, Redpanda, MinIO,…☆11Jun 27, 2023Updated 3 years ago
- Machine Learning DevOps Engineer Nanodegree☆11Jan 27, 2022Updated 4 years ago
- ☆14Jul 25, 2023Updated 3 years ago
- Example repo to create end to end tests for data pipeline.☆25Jun 14, 2024Updated 2 years ago
- The "One Role to Rule them all" Ansible setup☆13Sep 20, 2019Updated 6 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Ansible setup of my development workstation☆13Sep 22, 2023Updated 2 years ago
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆30Apr 12, 2023Updated 3 years ago
- a lightweight, semi-automated setup guide for HashiStack: Consul + Vault + Nomad, on Footloose powered Docker "container VMs", with Ansib…☆11Jul 2, 2021Updated 5 years ago
- Generate Python data structures and XML parser from Xschema (Python 3 port)☆12Jan 13, 2015Updated 11 years ago
- ☆16Jul 15, 2023Updated 3 years ago
- Demo running DBT as a Databricks Workflow task☆13Nov 13, 2024Updated last year
- This portfolio is tiny, it saves the environment 😮☆14May 8, 2026Updated 2 months ago
- Different ways to connect to storage in Azure Databricks☆11Jul 19, 2019Updated 7 years ago
- Garage (distributed, s3 compatible object storage service) setup using Ansible and Docker☆19Mar 15, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Tooling to build a custom Confluent Platform Kafka Connect container with additional connectors from Confluent Hub.☆15Oct 26, 2020Updated 5 years ago
- StatusNotifier for xfce4-panel and vala-panel - GitHub mirror☆11Apr 12, 2019Updated 7 years ago
- Portfolio built with Storyblok and Astro☆14Aug 25, 2024Updated last year
- Building Event Driven Application with AWS Lambda and Amazon Redshift Data API☆17Oct 27, 2020Updated 5 years ago
- Playbook to provision a Confluent Cluster☆10Oct 22, 2017Updated 8 years ago
- A POC framework to create Wordpress docker image with Ansible/Packer and deploy it to AWS ECS using Terraform☆17Jun 23, 2021Updated 5 years ago
- Zhongwen Tools, tools for dealing with Chinese--pinyin, trad-simp conversion and more.☆13Feb 25, 2026Updated 5 months ago
- Freepn tray controller for fpnd based on pygobject, app-indicator3 and gtk3☆16Dec 4, 2020Updated 5 years ago
- Glue VSCode devcontainer setup☆14Jan 31, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Data Pipeline from the Global Historical Climatology Network DataSet☆27Dec 20, 2022Updated 3 years ago
- Examples which shows how to create MATE panel applet with Python.☆18Sep 14, 2019Updated 6 years ago
- Simple ETL pipeline using Python☆29May 22, 2023Updated 3 years ago
- Parallelized Video Processing implementations using OpenCV in Python, ffmpeg☆18Nov 13, 2018Updated 7 years ago
- Email digest aggregator for fail2ban☆13Oct 9, 2024Updated last year
- Python tool to help export Azure DevOps WIKI into a single PDF☆10May 10, 2020Updated 6 years ago
- Appindicator for various cryptocoins written in python for GTK+3 systems☆17Mar 25, 2019Updated 7 years ago
- ☆30Nov 16, 2023Updated 2 years ago
- Automated basic infrastructure to intall OKD4 on free ESXi☆13Aug 8, 2020Updated 5 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Maps Medicare LDS claims data to the Tuva Input Layer so you can easily run the Tuva Project.☆12Dec 15, 2025Updated 7 months ago
- End to end data pipeline to extract and analyze submissions from any subreddit using Pushshift, python, dbt and BigQuery.☆12Jul 17, 2023Updated 3 years ago
- A Proof of concept of a modern python CLI with click, pydantic, rich and anyio☆21Jan 13, 2024Updated 2 years ago
- my personal portfolio☆13Sep 6, 2025Updated 10 months ago
- Data Structures and Algorithms☆22May 24, 2026Updated 2 months ago
- Rust And Delta Demo. Explanation and walkthrough on delta-rs☆10Aug 21, 2023Updated 2 years ago
- Final Project for Data Engineering Zoomcamp Course 2024 🧙🔥☆11Apr 17, 2024Updated 2 years ago