Fully automated csv to dashboard pipeline using Terraform, Google Cloud Storage, BigQuery, dbt, Prefect and Looker Studio. Peer ranked 9 of 298. Explore the dashboard below
☆44Nov 15, 2024Updated last year
Alternatives and similar repositories for end_to_end_data_pipeline
Users that are interested in end_to_end_data_pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆51Dec 2, 2023Updated 2 years ago
- ☆16Apr 1, 2025Updated last year
- Awesome ETL tools for blockchain data☆13Apr 15, 2024Updated last year
- Appindicator for various cryptocoins written in python for GTK+3 systems☆17Mar 25, 2019Updated 7 years ago
- dbt-github-workflow is a boilerplate that contains all the necessary configurations to set up a simple CI/CD pipeline for your data model…☆17Mar 27, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Looker map_layers base model containing multiple topojson map layers☆12Jul 28, 2023Updated 2 years ago
- On-premises ELT Pipeline☆31Jul 10, 2025Updated 8 months ago
- Udacity Data Engineer Nanodegree - Capstone project☆11Dec 19, 2019Updated 6 years ago
- A quick start app for Google Cloud's Conversational Analytics API☆47Mar 30, 2026Updated last week
- Sophisticated alerting block for looker built in Lookml☆16Oct 20, 2020Updated 5 years ago
- For Data Enthusiasts Statistics Cheatsheet 2024☆26May 14, 2024Updated last year
- Generate lookml from dbt☆24Oct 19, 2022Updated 3 years ago
- A simple low-cost finance data pipeline orchestration. All you need is just python & SQL.☆18Apr 26, 2023Updated 2 years ago
- Demo for making use of RATP's real-time API☆13May 3, 2017Updated 8 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆21Apr 7, 2025Updated last year
- Knowledge sharing - Cheat sheets☆21Apr 1, 2026Updated last week
- A simple Data Engineering solution for testing or education purposes. You only need to know SQL and Python to understand this project. Da…☆28Jul 2, 2022Updated 3 years ago
- The best hip-hop songs of all time, visualized☆18Jun 25, 2022Updated 3 years ago
- This repository is a production dbt pipeline example that model the profitability of an e-commerce business. Data is extracted and loaded…☆30Jun 14, 2024Updated last year
- This project implements an ELT (Extract - Load - Transform) data pipeline with the goodreads dataset, using dagster (orchestration), spar…☆43Apr 22, 2023Updated 2 years ago
- 🌟 Stardex: Explore GitHub Stars Intelligently. Stardex is a powerful web app that lets you search, filter, and cluster any GitHub user's…☆13Mar 17, 2026Updated 3 weeks ago
- Portfolio of data science projects completed by me for academic, self learning, and hobby purposes.☆42Oct 19, 2023Updated 2 years ago
- A Model Context Protocol server that provides documentation access capabilities. This server enables LLMs to search and retrieve content …☆19Apr 29, 2025Updated 11 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆31Apr 13, 2023Updated 2 years ago
- This project serves as a 5-year DCF model to evaluate companies' target prices, using Selenium to fetch stock information mainly from Yah…☆25Nov 5, 2024Updated last year
- ☆34Dec 12, 2022Updated 3 years ago
- Site Reliability Engineering Cheat Sheet☆18May 19, 2020Updated 5 years ago
- An AWS Lambda function created in Python 2.7 that triggers on CloudWatch Event of an EC2 instance starting and takes the Public IPv4 Addr…☆10Oct 25, 2018Updated 7 years ago
- ETL pipeline for the Ethereum blockchain☆44Feb 13, 2019Updated 7 years ago
- I will be adding different kind of opensource data extraction tools code using python☆10Nov 15, 2024Updated last year
- The Web Metadata Extraction Toolkit is designed to streamline the process of extracting, cleaning, and analyzing metadata from websites. …☆17Jul 8, 2024Updated last year
- Basic web application using FastAPI ready to be deployed on Kubernetes☆39Oct 9, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Automate research and outbound lead generation.☆14May 18, 2025Updated 10 months ago
- Singer.io Tap for extracting data from the Google Analytics Reporting API☆12Mar 30, 2026Updated last week
- Python script to pull perfmon data into InfluxDB, which can then be used in Grafana☆11May 3, 2020Updated 5 years ago
- Browser automation for creating new pages in WordPress☆13Jun 7, 2025Updated 10 months ago
- ⚡ Developer-friendly hybrid-RAG toolkit merging Graphiti, Qdrant, mem0, LlamaIndex, and LangChain into one powerful engine.☆17Jan 14, 2026Updated 2 months ago
- Python Script to Download Universal Analytics Data☆11Jun 20, 2024Updated last year
- Crawl4DeepSeek = Crawl4AI + DeepSeek 🚀 Smart, efficient, and built for deep web exploration! 🌐🤖☆18Feb 9, 2025Updated last year