Data Engineering examples for Airflow, Prefect; dbt for BigQuery, Redshift, ClickHouse, Postgres, DuckDB; PySpark for Batch processing; Kafka for Stream processing
☆81Nov 1, 2026Updated this week
Alternatives and similar repositories for data-engineering-labs
Users that are interested in data-engineering-labs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- DBT and clickhouse test project with dagster☆12Aug 29, 2023Updated 3 years ago
- Machine Learning Model and Deployment for Classification of Mango Varieties☆10Dec 22, 2022Updated 3 years ago
- Streamlit-Powered DataTalksClub Project Analyzer: Interactive Insights at Your Fingertips☆25May 5, 2026Updated 6 months ago
- Repository for Data Engineering Zoomcamp 2024☆14Mar 25, 2024Updated 2 years ago
- A xfce4-panel plugin that shows activate window title and icon (quite useful in some tiling window managers)☆18Apr 9, 2021Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Code for dbt tutorial☆190Jun 4, 2026Updated 5 months ago
- This repository contains the capstone project carried out as part of Machine Learning Zoomcamp course☆10Dec 26, 2022Updated 3 years ago
- This is a real-life, high throughput streaming ELT data pipeline for ecommerce☆15May 22, 2023Updated 3 years ago
- Data pipeline for extracting, transforming, and visualising Covid-19 data☆14Apr 23, 2023Updated 3 years ago
- Advent of code - 30 challenges for learning Dagster☆27Dec 19, 2024Updated last year
- ☆14Jul 25, 2023Updated 3 years ago
- Typst package for creating elegant headers and footers☆10Mar 1, 2025Updated last year
- In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …☆40Dec 18, 2023Updated 2 years ago
- Scan and monitor your network effortlessly! Nmap Prometheus Exporter provides insights into network health and security with Prometheus-c…☆15Oct 2, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Cloud Spanner Connector for Apache Spark☆18Updated this week
- a lightweight, semi-automated setup guide for HashiStack: Consul + Vault + Nomad, on Footloose powered Docker "container VMs", with Ansib…☆11Jul 2, 2021Updated 5 years ago
- Various Kazakhstani Maps offers as Data Frames and 'sf' Objects☆10Jul 1, 2024Updated 2 years ago
- This portfolio is tiny, it saves the environment 😮☆14May 8, 2026Updated 5 months ago
- Django-based course management platform for Zoomcamps☆87Updated this week
- Python library to run ML/data pipelines on stateless compute infrastructure (that may be ephemeral or serverless). Please see the documen…☆18May 23, 2023Updated 3 years ago
- Analytics Engineer Course☆20May 17, 2023Updated 3 years ago
- Building a Modern Data Lake with Minio, Spark, Airflow via Docker.☆23May 11, 2024Updated 2 years ago
- A collection of airflow sample workflows for data processing on aws☆12Dec 1, 2017Updated 8 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Freepn tray controller for fpnd based on pygobject, app-indicator3 and gtk3☆16Dec 4, 2020Updated 5 years ago
- Final Project of the MLOps Zoomcamp hosted by DataTalksClub.☆25Dec 19, 2022Updated 3 years ago
- Update 3D Human motion Research Papers Daily☆15Updated this week
- Stock Market predictions with Prophet and FastAPI☆17Dec 22, 2021Updated 4 years ago
- Display live blood sugar data from Nightscout in your system menu bar.☆33Updated this week
- This project aims to leverage Amazon Web Services to create trending Youtube videos analytics service. Project contains different data en…☆24Aug 16, 2025Updated last year
- paraphase sentence☆11Aug 22, 2025Updated last year
- Earthquakes API Live Data Project - Data Engineering Zoomcamp Project☆16May 3, 2023Updated 3 years ago
- reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.☆15Jun 26, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Official DC/OS Grafana dashboards☆16Sep 2, 2020Updated 6 years ago
- ☆18Oct 21, 2021Updated 5 years ago
- ☆40Mar 13, 2026Updated 7 months ago
- Appindicator for various cryptocoins written in python for GTK+3 systems☆17Mar 25, 2019Updated 7 years ago
- an end-to-end data pipeline extracting music listening habits and producing an insightful dashboard☆17Mar 31, 2024Updated 2 years ago
- vLLM Processing for Unstructured Historical Documents☆12Jun 22, 2025Updated last year
- Sample Dockerized flask app deployed on Kubernetes on Azure using AKS☆23Feb 17, 2023Updated 3 years ago