Data Engineering examples for Airflow, Prefect; dbt for BigQuery, Redshift, ClickHouse, Postgres, DuckDB; PySpark for Batch processing; Kafka for Stream processing
☆79Aug 10, 2026Updated 3 weeks ago
Alternatives and similar repositories for data-engineering-labs
Users that are interested in data-engineering-labs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Repository for Data Engineering Zoomcamp 2024☆14Mar 25, 2024Updated 2 years ago
- Machine Learning Model and Deployment for Classification of Mango Varieties☆10Dec 22, 2022Updated 3 years ago
- This is a real-life, high throughput streaming ELT data pipeline for ecommerce☆15May 22, 2023Updated 3 years ago
- This repository contains the capstone project carried out as part of Machine Learning Zoomcamp course☆10Dec 26, 2022Updated 3 years ago
- strategy backtesting framework☆12Oct 22, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …☆39Dec 18, 2023Updated 2 years ago
- Code for dbt tutorial☆186Jun 4, 2026Updated 3 months ago
- A xfce4-panel plugin that shows activate window title and icon (quite useful in some tiling window managers)☆18Apr 9, 2021Updated 5 years ago
- Cloud Spanner Connector for Apache Spark☆18Updated this week
- ☆27May 25, 2022Updated 4 years ago
- A custom end-to-end analytics platform for customer churn☆10May 15, 2025Updated last year
- Django-based course management platform for Zoomcamps☆84Aug 31, 2026Updated last week
- Scan and monitor your network effortlessly! Nmap Prometheus Exporter provides insights into network health and security with Prometheus-c…☆15Oct 2, 2023Updated 2 years ago
- A monthly budget analyser. It helps you keep to a budget, see how much you can spend and analyse past data to improve your budget.☆14Aug 28, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Codebasics Resume Project Challenge, Provide Insights to Revenue Team in Hospitality Domain☆10Sep 27, 2022Updated 3 years ago
- a lightweight, semi-automated setup guide for HashiStack: Consul + Vault + Nomad, on Footloose powered Docker "container VMs", with Ansib…☆11Jul 2, 2021Updated 5 years ago
- Analytics Engineer Course☆20May 17, 2023Updated 3 years ago
- Project was based on an interest in Data Engineering, ETL pipeline. It also provided a good opportunity to develop skills and experience…☆32Sep 12, 2023Updated 2 years ago
- This project aims to leverage Amazon Web Services to create trending Youtube videos analytics service. Project contains different data en…☆22Aug 16, 2025Updated last year
- Проекты курса Инженер данных на платформе Yandex Practicum☆10May 27, 2025Updated last year
- A collection of airflow sample workflows for data processing on aws☆12Dec 1, 2017Updated 8 years ago
- reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.☆15Jun 26, 2023Updated 3 years ago
- My notes of the Data Engineering Zoomcamp by DataTalksClub☆39Apr 16, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- paraphase sentence☆11Aug 22, 2025Updated last year
- Display live blood sugar data from Nightscout in your system menu bar.☆32Updated this week
- Earthquakes API Live Data Project - Data Engineering Zoomcamp Project☆16May 3, 2023Updated 3 years ago
- A POC framework to create Wordpress docker image with Ansible/Packer and deploy it to AWS ECS using Terraform☆17Jun 23, 2021Updated 5 years ago
- End-to-End ELT data pipeline with Postgres, Airbyte, dbt, Dagster, Snowflake and Metabase☆12Jul 13, 2023Updated 3 years ago
- Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼☆45,288Updated this week
- ☆12Jun 25, 2024Updated 2 years ago
- Detailed notes and homeworks from 2025 Data Engineering Zoomcamp by Datatalks.Club☆59Mar 10, 2025Updated last year
- Cloned by the `dbt init` task☆62Apr 28, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A complete pipeline to pull data from Scryfall's "Magic: The Gathering"-API, via Prefect orchestration and dbt transformation.☆43Apr 27, 2023Updated 3 years ago
- ☆40Mar 13, 2026Updated 5 months ago
- Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO☆66Jul 21, 2023Updated 3 years ago
- Predict the number of deaths due to covid19 in the next two weeks☆11Oct 2, 2022Updated 3 years ago
- my personal portfolio☆13Sep 6, 2025Updated last year
- Code review for data in dbt☆495Jan 3, 2025Updated last year
- Golang package and command line tool to return or output the difference between date, time or duration☆32Jul 10, 2024Updated 2 years ago