Data Engineering examples for Airflow, Prefect; dbt for BigQuery, Redshift, ClickHouse, Postgres, DuckDB; PySpark for Batch processing; Kafka for Stream processing
☆80Aug 10, 2026Updated last month
Alternatives and similar repositories for data-engineering-labs
Users that are interested in data-engineering-labs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Streamlit-Powered DataTalksClub Project Analyzer: Interactive Insights at Your Fingertips☆25May 5, 2026Updated 4 months ago
- Machine Learning Model and Deployment for Classification of Mango Varieties☆10Dec 22, 2022Updated 3 years ago
- This is a real-life, high throughput streaming ELT data pipeline for ecommerce☆15May 22, 2023Updated 3 years ago
- In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …☆40Dec 18, 2023Updated 2 years ago
- Code for dbt tutorial☆187Jun 4, 2026Updated 3 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Homework and notes for the DataTalks.Club MLOps Zoomcamp☆11Sep 10, 2022Updated 4 years ago
- A xfce4-panel plugin that shows activate window title and icon (quite useful in some tiling window managers)☆18Apr 9, 2021Updated 5 years ago
- ☆14Jul 25, 2023Updated 3 years ago
- Code for the Data Engineering Zoomcamp☆49May 7, 2023Updated 3 years ago
- ☆27May 25, 2022Updated 4 years ago
- Django-based course management platform for Zoomcamps☆85Sep 19, 2026Updated last week
- The "One Role to Rule them all" Ansible setup☆13Sep 20, 2019Updated 7 years ago
- Scan and monitor your network effortlessly! Nmap Prometheus Exporter provides insights into network health and security with Prometheus-c…☆15Oct 2, 2023Updated 2 years ago
- Ansible setup of my development workstation☆13Sep 22, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This project provides valuable customer sentiment insights for Zomato by tracking and analyzing tweets related to their brand and service…☆15Aug 27, 2023Updated 3 years ago
- a lightweight, semi-automated setup guide for HashiStack: Consul + Vault + Nomad, on Footloose powered Docker "container VMs", with Ansib…☆11Jul 2, 2021Updated 5 years ago
- Analytics Engineer Course☆20May 17, 2023Updated 3 years ago
- This portfolio is tiny, it saves the environment 😮☆14May 8, 2026Updated 4 months ago
- ☆32May 30, 2023Updated 3 years ago
- Project was based on an interest in Data Engineering, ETL pipeline. It also provided a good opportunity to develop skills and experience…☆32Sep 12, 2023Updated 3 years ago
- This project aims to leverage Amazon Web Services to create trending Youtube videos analytics service. Project contains different data en…☆22Aug 16, 2025Updated last year
- Проекты курса Инженер данных на платформе Yandex Practicum☆10May 27, 2025Updated last year
- A collection of airflow sample workflows for data processing on aws☆12Dec 1, 2017Updated 8 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.☆15Jun 26, 2023Updated 3 years ago
- My notes of the Data Engineering Zoomcamp by DataTalksClub☆39Apr 16, 2023Updated 3 years ago
- paraphase sentence☆11Aug 22, 2025Updated last year
- Display live blood sugar data from Nightscout in your system menu bar.☆32Updated this week
- A POC framework to create Wordpress docker image with Ansible/Packer and deploy it to AWS ECS using Terraform☆17Jun 23, 2021Updated 5 years ago
- End-to-End ELT data pipeline with Postgres, Airbyte, dbt, Dagster, Snowflake and Metabase☆12Jul 13, 2023Updated 3 years ago
- Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼☆45,817Sep 15, 2026Updated last week
- Freepn tray controller for fpnd based on pygobject, app-indicator3 and gtk3☆16Dec 4, 2020Updated 5 years ago
- ☆12Jun 25, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Detailed notes and homeworks from 2025 Data Engineering Zoomcamp by Datatalks.Club☆60Mar 10, 2025Updated last year
- Serverless Datalake architecture☆17Aug 5, 2026Updated last month
- Cloned by the `dbt init` task☆62Apr 28, 2024Updated 2 years ago
- Examples which shows how to create MATE panel applet with Python.☆18Sep 14, 2019Updated 7 years ago
- ☆40Mar 13, 2026Updated 6 months ago
- Appindicator for various cryptocoins written in python for GTK+3 systems☆17Mar 25, 2019Updated 7 years ago
- Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO☆66Jul 21, 2023Updated 3 years ago