Fully automated csv to dashboard pipeline using Terraform, Google Cloud Storage, BigQuery, dbt, Prefect and Looker Studio. Peer ranked 9 of 298. Explore the dashboard below
☆47Nov 15, 2024Updated last year
Alternatives and similar repositories for end_to_end_data_pipeline
Users that are interested in end_to_end_data_pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The "One Role to Rule them all" Ansible setup☆13Sep 20, 2019Updated 6 years ago
- Ansible setup of my development workstation☆13Sep 22, 2023Updated 2 years ago
- a lightweight, semi-automated setup guide for HashiStack: Consul + Vault + Nomad, on Footloose powered Docker "container VMs", with Ansib…☆11Jul 2, 2021Updated 4 years ago
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆51Dec 2, 2023Updated 2 years ago
- A Proof of concept of a modern python CLI with click, pydantic, rich and anyio☆21Jan 13, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Transform data from on-premises SQL Server to Azure Delta Lake Storage for Analytics and Visualization☆26Jul 16, 2023Updated 2 years ago
- ☆13Mar 30, 2024Updated 2 years ago
- A little Pomodoro app☆13Jun 5, 2022Updated 4 years ago
- MCP (model context protocol) server for interacting with dbt Docs☆23Aug 19, 2025Updated 9 months ago
- Portfolio built with Storyblok and Astro☆14Aug 25, 2024Updated last year
- Repo for learning DBT with Snowflake, featuring projects and models for data transformation and automation☆26Mar 31, 2025Updated last year
- Thư viện sách của Xóm - Free & Public 😎☆203Sep 27, 2025Updated 8 months ago
- Federated Learning on Google Cloud☆21May 11, 2026Updated last month
- Golang package and command line tool to return or output the difference between date, time or duration☆32Jul 10, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Portfolio Website of Murtuzaali Surti☆14Mar 22, 2026Updated 2 months ago
- A few scripts to show the battery state of a Razer device in the tray (Percent / Loading). Leverages Openrazer, Pillow and pystray.☆43Mar 5, 2026Updated 3 months ago
- Sophisticated alerting block for looker built in Lookml☆16Oct 20, 2020Updated 5 years ago
- My typst templates & utilities (WIP)☆27Oct 21, 2025Updated 7 months ago
- Display live blood sugar data from Nightscout in your system menu bar.☆30Jun 2, 2026Updated last week
- my personal portfolio☆13Sep 6, 2025Updated 9 months ago
- My personal branch of an adaptation of some parts of AAPS☆19May 16, 2026Updated 3 weeks ago
- A simple Data Engineering solution for testing or education purposes. You only need to know SQL and Python to understand this project. Da…☆29Jul 2, 2022Updated 3 years ago
- A CV template inspired by Deedy-Resume☆51Oct 21, 2025Updated 7 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆37Jun 3, 2023Updated 3 years ago
- 🌟 Stardex: Explore GitHub Stars Intelligently. Stardex is a powerful web app that lets you search, filter, and cluster any GitHub user's…☆15Mar 17, 2026Updated 2 months ago
- A Model Context Protocol server that provides documentation access capabilities. This server enables LLMs to search and retrieve content …☆18Apr 29, 2025Updated last year
- Setup a full fledged portainer + Traefik swam cluster with ansible playbooks and a few VPS☆42Oct 11, 2025Updated 8 months ago
- Learn the first step in Retrieval-Augmented Generation (RAG), how to vector encode incoming data to insert and continuously update your v…☆32Feb 1, 2025Updated last year
- This project implements an ELT (Extract - Load - Transform) data pipeline with the goodreads dataset, using dagster (orchestration), spar…☆44Apr 22, 2023Updated 3 years ago
- This project demonstrates how to use Apache Airflow to submit jobs to Apache spark cluster in different programming laguages using Python…☆48Mar 14, 2024Updated 2 years ago
- Practical Data Engineering: A Hands-On Real-Estate Project Guide☆804Mar 10, 2026Updated 3 months ago
- Site Reliability Engineering Cheat Sheet☆18May 19, 2020Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ETL pipeline for the Ethereum blockchain☆44Feb 13, 2019Updated 7 years ago
- I will be adding different kind of opensource data extraction tools code using python☆10Nov 15, 2024Updated last year
- This API provides file upload/download operations on cloud storage. Includes local MinIO storage. But also supports Google Cloud Storage …☆27Apr 7, 2023Updated 3 years ago
- 💻 My workstation setup☆47Updated this week
- wpseek.com WordPress Developer Assistant for Sublime Text 2 / 3☆21Updated this week
- The Web Metadata Extraction Toolkit is designed to streamline the process of extracting, cleaning, and analyzing metadata from websites. …☆18Jul 8, 2024Updated last year
- An operator for managing BuildKit instances on Kubernetes☆31Updated this week