Fully automated csv to dashboard pipeline using Terraform, Google Cloud Storage, BigQuery, dbt, Prefect and Looker Studio. Peer ranked 9 of 298. Explore the dashboard below
☆45Nov 15, 2024Updated last year
Alternatives and similar repositories for end_to_end_data_pipeline
Users that are interested in end_to_end_data_pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An end-to-end workflow for processing streaming data on Azure.☆17Sep 20, 2024Updated last year
- Ansible setup of my development workstation☆13Sep 22, 2023Updated 2 years ago
- a lightweight, semi-automated setup guide for HashiStack: Consul + Vault + Nomad, on Footloose powered Docker "container VMs", with Ansib…☆11Jul 2, 2021Updated 4 years ago
- This portfolio is tiny, it saves the environment 😮☆13Jan 24, 2026Updated 3 months ago
- reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.☆15Jun 26, 2023Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A little Pomodoro app☆13Jun 5, 2022Updated 3 years ago
- ☆13Mar 30, 2024Updated 2 years ago
- ☆23Feb 5, 2024Updated 2 years ago
- Portfolio built with Storyblok and Astro☆14Aug 25, 2024Updated last year
- dbt-github-workflow is a boilerplate that contains all the necessary configurations to set up a simple CI/CD pipeline for your data model…☆17Mar 27, 2022Updated 4 years ago
- 📝 This is my resume☆15Feb 5, 2026Updated 3 months ago
- Portfolio Website of Murtuzaali Surti☆14Mar 22, 2026Updated last month
- A pretty resume template in Typst | 一个美观的typst简历模板☆17Feb 12, 2025Updated last year
- My typst templates & utilities (WIP)☆28Oct 21, 2025Updated 6 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Generate lookml from dbt☆23Oct 19, 2022Updated 3 years ago
- A simple low-cost finance data pipeline orchestration. All you need is just python & SQL.☆18Apr 26, 2023Updated 3 years ago
- Building Data Lakehouse by open source technology. Support end to end data pipeline, from source data on AWS S3 to Lakehouse, visualize a…☆40Dec 15, 2025Updated 4 months ago
- ☆21Apr 7, 2025Updated last year
- ☆29Nov 7, 2025Updated 5 months ago
- A CV template inspired by Deedy-Resume☆50Oct 21, 2025Updated 6 months ago
- ☆37Jun 3, 2023Updated 2 years ago
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆32Apr 13, 2023Updated 3 years ago
- A Model Context Protocol server that provides documentation access capabilities. This server enables LLMs to search and retrieve content …☆19Apr 29, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Practical Data Engineering: A Hands-On Real-Estate Project Guide☆801Mar 10, 2026Updated last month
- ☆34Dec 12, 2022Updated 3 years ago
- This project demonstrates how to use Apache Airflow to submit jobs to Apache spark cluster in different programming laguages using Python…☆48Mar 14, 2024Updated 2 years ago
- Site Reliability Engineering Cheat Sheet☆18May 19, 2020Updated 5 years ago
- An AWS Lambda function created in Python 2.7 that triggers on CloudWatch Event of an EC2 instance starting and takes the Public IPv4 Addr…☆10Oct 25, 2018Updated 7 years ago
- I will be adding different kind of opensource data extraction tools code using python☆10Nov 15, 2024Updated last year
- wpseek.com WordPress Developer Assistant for Sublime Text 2 / 3☆21Jan 7, 2026Updated 3 months ago
- Get going with Home Assistant on Docker - compose file and base config files to give you a quick start☆12Oct 19, 2023Updated 2 years ago
- Automate research and outbound lead generation.☆16May 18, 2025Updated 11 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A TerraForm and Flux 2.0 template to easily bootstrap a GitOps managed kubernetes cluster using OCI's free tier☆58Apr 27, 2026Updated last week
- Integrate Amazon S3, CloudFront and Amazon S3–compatible storage with Joomla!'s Media Manager☆10Apr 21, 2026Updated 2 weeks ago
- Python script to pull perfmon data into InfluxDB, which can then be used in Grafana☆11May 3, 2020Updated 6 years ago
- A complete pipeline to pull data from Scryfall's "Magic: The Gathering"-API, via Prefect orchestration and dbt transformation.☆43Apr 27, 2023Updated 3 years ago
- Browser automation for creating new pages in WordPress☆13Jun 7, 2025Updated 10 months ago
- ⚡ Developer-friendly hybrid-RAG toolkit merging Graphiti, Qdrant, mem0, LlamaIndex, and LangChain into one powerful engine.☆17Jan 14, 2026Updated 3 months ago
- Library and worker to handle transfer of data in s3 into redshift. Includes table creation and manipulation, as well as time-based insert…☆60Jan 1, 2023Updated 3 years ago