A demonstration of an ELT (Extract, Load, Transform) pipeline
☆31Feb 19, 2024Updated 2 years ago
Alternatives and similar repositories for data-pipeline-demo
Users that are interested in data-pipeline-demo are comparing it to the libraries listed below
Sorting:
- Apache Airflow advanced functionalities examples☆21Mar 22, 2024Updated last year
- An example repository showing how to leverage Kafka to stream your data☆21May 11, 2024Updated last year
- This repository contains an end-to-end data engineering project using Apache Flink, focused on performing sales analytics. The project de…☆11Nov 18, 2023Updated 2 years ago
- Orchestrate Modal and OpenAI workloads with Dagster☆13Dec 11, 2024Updated last year
- ☆16Oct 2, 2024Updated last year
- End-to-end data pipeline that ingests, processes, and stores data. It uses Apache Airflow to schedule scripts that fetch data from an API…☆21Jul 26, 2024Updated last year
- This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…☆45Dec 11, 2023Updated 2 years ago
- Fully dockerized Data Warehouse (DWH) using Airflow, dbt, PostgreSQL and dashboard using redash☆25Nov 12, 2022Updated 3 years ago
- Example projects built on MotherDuck☆43Updated this week
- Repository for Data Engineering Interview Series☆36Oct 17, 2024Updated last year
- ☆30Nov 16, 2023Updated 2 years ago
- ☆212Aug 13, 2023Updated 2 years ago
- Repository for the dbt Semantic Layer course☆12Updated this week
- Fundamental Accounting Concept Relations validation for International Financial Reporting Standards (IFRS).☆14Sep 20, 2018Updated 7 years ago
- This project shows how to capture changes from postgres database and stream them into kafka☆41May 17, 2024Updated last year
- ☆47Feb 23, 2021Updated 5 years ago
- Code for blog at: https://www.startdataengineering.com/post/docker-for-de/☆40Apr 29, 2024Updated last year
- Visual Stuidio extension based on Everything search engine (https://www.voidtools.com/).☆10May 27, 2017Updated 8 years ago
- Symbolic Regression from Scratch with Python☆13Dec 6, 2022Updated 3 years ago
- This project sets up a real-time data pipeline utilizing Change Data Capture (CDC) to stream changes from a PostgreSQL database to a Clic…☆12May 9, 2024Updated last year
- Syllabus and course material of "Online Data Collection and Management" (oDCM) - learn how to collect web data for your empirical researc…☆15Updated this week
- This project showcases how to integrate the world of DevOps, focusing on Continuous Integration (CI) and Continuous Deployment (CD) with …☆15Dec 27, 2023Updated 2 years ago
- DBT and clickhouse test project with dagster☆12Aug 29, 2023Updated 2 years ago
- This construct builds some elements for you to quickly launch an EMR Serverless application. After submitting the Emr Serverless job, you…☆11Nov 18, 2025Updated 3 months ago
- Transform messy HTML from Google Docs into well-structured HTML!☆14Jul 10, 2025Updated 7 months ago
- A wrapper making possible to create SolidWorks Professional PDM add-ins in any programming language, including scripting languages.☆12Mar 30, 2020Updated 5 years ago
- AlvinToh Learning Repository for The Ultimate Hands-On Hadoop - Tame your Big Data!☆10May 23, 2018Updated 7 years ago
- 🕷 Курсовой проект по дисциплине "Базы данных"☆10Nov 19, 2021Updated 4 years ago
- ☆10Feb 3, 2025Updated last year
- debug path list environment variables☆13Dec 23, 2025Updated 2 months ago
- A highly customizable homepage (or startpage / application dashboard) with Docker and service API integrations.☆10May 25, 2025Updated 9 months ago
- ☆15May 2, 2023Updated 2 years ago
- Source code of webpro.nl☆11Oct 12, 2025Updated 4 months ago
- Trying out the Dataframe Polars library with Delta Lake ... feat Python.☆12Jan 29, 2025Updated last year
- Examples from Rob's Awesome Python Template☆14Mar 2, 2026Updated last week
- Python client for Rosstat open data corporate reports for 2012-2018.☆11Aug 3, 2021Updated 4 years ago
- The easiest way to create jamstack sites, as simple or as complex as you like☆10Apr 10, 2022Updated 3 years ago
- Python script for easily replacing an old Philips Hue bulb with a new one, and copying Group and Scene data☆11Sep 13, 2022Updated 3 years ago
- Firefox extension that shows parquet schema when going over GCP cloud storage. Use DuckDB WASM☆12Jan 19, 2024Updated 2 years ago