reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.
☆15Jun 26, 2023Updated 3 years ago
Alternatives and similar repositories for modern-data-pipeline
Users that are interested in modern-data-pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An example Data Vault 2.0 data warehouse modelling Microsoft's Northwind sample database.☆13Oct 18, 2023Updated 3 years ago
- Data Structures and Algorithms☆22May 24, 2026Updated 4 months ago
- In this article, you will learn how to set up a real-time data processing and analytics environment using Docker, MySQL, Redpanda, MinIO,…☆11Jun 27, 2023Updated 3 years ago
- Typst package for creating elegant headers and footers☆10Mar 1, 2025Updated last year
- ☆14Jul 25, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The "One Role to Rule them all" Ansible setup☆13Sep 20, 2019Updated 7 years ago
- Example repo to create end to end tests for data pipeline.☆25Jun 14, 2024Updated 2 years ago
- Generate Python data structures and XML parser from Xschema (Python 3 port)☆12Jan 13, 2015Updated 11 years ago
- My personal project for data engineering zoomcamp☆18Dec 13, 2024Updated last year
- a lightweight, semi-automated setup guide for HashiStack: Consul + Vault + Nomad, on Footloose powered Docker "container VMs", with Ansib…☆11Jul 2, 2021Updated 5 years ago
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆30Apr 12, 2023Updated 3 years ago
- Ansible setup of my development workstation☆13Sep 22, 2023Updated 3 years ago
- Different ways to connect to storage in Azure Databricks☆11Jul 19, 2019Updated 7 years ago
- ☆16Jul 15, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- This portfolio is tiny, it saves the environment 😮☆14May 8, 2026Updated 5 months ago
- Tooling to build a custom Confluent Platform Kafka Connect container with additional connectors from Confluent Hub.☆15Oct 26, 2020Updated 5 years ago
- Garage (distributed, s3 compatible object storage service) setup using Ansible and Docker☆19Mar 15, 2023Updated 3 years ago
- Portfolio built with Storyblok and Astro☆14Aug 25, 2024Updated 2 years ago
- Demo running DBT as a Databricks Workflow task☆13Nov 13, 2024Updated last year
- StatusNotifier for xfce4-panel and vala-panel - GitHub mirror☆11Apr 12, 2019Updated 7 years ago
- Playbook to provision a Confluent Cluster☆10Oct 22, 2017Updated 8 years ago
- A POC framework to create Wordpress docker image with Ansible/Packer and deploy it to AWS ECS using Terraform☆17Jun 23, 2021Updated 5 years ago
- Building Event Driven Application with AWS Lambda and Amazon Redshift Data API☆17Oct 27, 2020Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆16Apr 16, 2025Updated last year
- Freepn tray controller for fpnd based on pygobject, app-indicator3 and gtk3☆16Dec 4, 2020Updated 5 years ago
- Glue VSCode devcontainer setup☆14Jan 31, 2023Updated 3 years ago
- Zhongwen Tools, tools for dealing with Chinese--pinyin, trad-simp conversion and more.☆13Feb 25, 2026Updated 7 months ago
- A project portfolio to accompany my resume☆31Sep 5, 2023Updated 3 years ago
- Parallelized Video Processing implementations using OpenCV in Python, ffmpeg☆18Nov 13, 2018Updated 7 years ago
- Examples which shows how to create MATE panel applet with Python.☆18Sep 14, 2019Updated 7 years ago
- Python tool to help export Azure DevOps WIKI into a single PDF☆10May 10, 2020Updated 6 years ago
- Email digest aggregator for fail2ban☆13Oct 9, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Data Pipeline from the Global Historical Climatology Network DataSet☆27Dec 20, 2022Updated 3 years ago
- Appindicator for various cryptocoins written in python for GTK+3 systems☆17Mar 25, 2019Updated 7 years ago
- Automated basic infrastructure to intall OKD4 on free ESXi☆13Aug 8, 2020Updated 6 years ago
- I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…☆29May 2, 2023Updated 3 years ago
- End to end data pipeline to extract and analyze submissions from any subreddit using Pushshift, python, dbt and BigQuery.☆13Jul 17, 2023Updated 3 years ago
- ☆11Mar 13, 2024Updated 2 years ago
- A Proof of concept of a modern python CLI with click, pydantic, rich and anyio☆21Jan 13, 2024Updated 2 years ago