Data Engineering examples for Airflow, Prefect; dbt for BigQuery, Redshift, ClickHouse, Postgres, DuckDB; PySpark for Batch processing; Kafka for Stream processing
☆80Aug 10, 2026Updated 2 months ago
Alternatives and similar repositories for data-engineering-labs
Users that are interested in data-engineering-labs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Repository for Data Engineering Zoomcamp 2024☆14Mar 25, 2024Updated 2 years ago
- This is a real-life, high throughput streaming ELT data pipeline for ecommerce☆15May 22, 2023Updated 3 years ago
- This repository contains the capstone project carried out as part of Machine Learning Zoomcamp course☆10Dec 26, 2022Updated 3 years ago
- Homework and notes for the DataTalks.Club MLOps Zoomcamp☆11Sep 10, 2022Updated 4 years ago
- Code for dbt tutorial☆187Jun 4, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …☆40Dec 18, 2023Updated 2 years ago
- A xfce4-panel plugin that shows activate window title and icon (quite useful in some tiling window managers)☆18Apr 9, 2021Updated 5 years ago
- ☆14Jul 25, 2023Updated 3 years ago
- Data pipeline for extracting, transforming, and visualising Covid-19 data☆14Apr 23, 2023Updated 3 years ago
- Cloud Spanner Connector for Apache Spark☆18Oct 8, 2026Updated last week
- ☆28May 25, 2022Updated 4 years ago
- A custom end-to-end analytics platform for customer churn☆10May 15, 2025Updated last year
- Django-based course management platform for Zoomcamps☆86Updated this week
- Scan and monitor your network effortlessly! Nmap Prometheus Exporter provides insights into network health and security with Prometheus-c…☆15Oct 2, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This project provides valuable customer sentiment insights for Zomato by tracking and analyzing tweets related to their brand and service…☆15Aug 27, 2023Updated 3 years ago
- a lightweight, semi-automated setup guide for HashiStack: Consul + Vault + Nomad, on Footloose powered Docker "container VMs", with Ansib…☆11Jul 2, 2021Updated 5 years ago
- Analytics Engineer Course☆20May 17, 2023Updated 3 years ago
- ☆32May 30, 2023Updated 3 years ago
- This project aims to leverage Amazon Web Services to create trending Youtube videos analytics service. Project contains different data en…☆23Aug 16, 2025Updated last year
- A collection of airflow sample workflows for data processing on aws☆12Dec 1, 2017Updated 8 years ago
- Проекты курса Инженер данных на платформе Yandex Practicum☆10May 27, 2025Updated last year
- Stock Market predictions with Prophet and FastAPI☆17Dec 22, 2021Updated 4 years ago
- reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.☆15Jun 26, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Final Project of the MLOps Zoomcamp hosted by DataTalksClub.☆25Dec 19, 2022Updated 3 years ago
- My notes of the Data Engineering Zoomcamp by DataTalksClub☆39Apr 16, 2023Updated 3 years ago
- Display live blood sugar data from Nightscout in your system menu bar.☆32Oct 9, 2026Updated last week
- paraphase sentence☆11Aug 22, 2025Updated last year
- Earthquakes API Live Data Project - Data Engineering Zoomcamp Project☆16May 3, 2023Updated 3 years ago
- A POC framework to create Wordpress docker image with Ansible/Packer and deploy it to AWS ECS using Terraform☆17Jun 23, 2021Updated 5 years ago
- End-to-End ELT data pipeline with Postgres, Airbyte, dbt, Dagster, Snowflake and Metabase☆12Jul 13, 2023Updated 3 years ago
- Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼☆46,248Updated this week
- Freepn tray controller for fpnd based on pygobject, app-indicator3 and gtk3☆16Dec 4, 2020Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆12Jun 25, 2024Updated 2 years ago
- Serverless Datalake architecture☆18Aug 5, 2026Updated 2 months ago
- Cloned by the `dbt init` task☆62Apr 28, 2024Updated 2 years ago
- Data pipeline for uploading, preprocessing, and visualising COVID19 data☆18Apr 1, 2023Updated 3 years ago
- ☆40Mar 13, 2026Updated 7 months ago
- Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO☆66Jul 21, 2023Updated 3 years ago
- A Scala library for Firestore in Datastore mode☆13Jun 11, 2024Updated 2 years ago