Data Engineering examples for Airflow, Prefect; dbt for BigQuery, Redshift, ClickHouse, Postgres, DuckDB; PySpark for Batch processing; Kafka for Stream processing
☆75Mar 9, 2026Updated last month
Alternatives and similar repositories for data-engineering-labs
Users that are interested in data-engineering-labs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Streamlit-Powered DataTalksClub Project Analyzer: Interactive Insights at Your Fingertips☆20Apr 5, 2026Updated 3 weeks ago
- Machine Learning Model and Deployment for Classification of Mango Varieties☆10Dec 22, 2022Updated 3 years ago
- This is a real-life, high throughput streaming ELT data pipeline for ecommerce☆15May 22, 2023Updated 2 years ago
- Code for dbt tutorial☆174Sep 9, 2025Updated 7 months ago
- Cloud Spanner Connector for Apache Spark☆18Apr 24, 2026Updated last week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A xfce4-panel plugin that shows activate window title and icon (quite useful in some tiling window managers)☆18Apr 9, 2021Updated 5 years ago
- In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …☆39Dec 18, 2023Updated 2 years ago
- Display live blood sugar data from Nightscout in your system menu bar.☆28Apr 21, 2026Updated last week
- ☆14Jul 25, 2023Updated 2 years ago
- Django-based course management platform for Zoomcamps☆78Mar 29, 2026Updated last month
- Scan and monitor your network effortlessly! Nmap Prometheus Exporter provides insights into network health and security with Prometheus-c…☆15Oct 2, 2023Updated 2 years ago
- The "One Role to Rule them all" Ansible setup☆12Sep 20, 2019Updated 6 years ago
- Quickly land a free google compute vm instance with docker installed☆13Oct 18, 2019Updated 6 years ago
- A monthly budget analyser. It helps you keep to a budget, see how much you can spend and analyse past data to improve your budget.☆14Jul 20, 2025Updated 9 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Codebasics Resume Project Challenge, Provide Insights to Revenue Team in Hospitality Domain☆10Sep 27, 2022Updated 3 years ago
- Ansible setup of my development workstation☆13Sep 22, 2023Updated 2 years ago
- ☆26May 25, 2022Updated 3 years ago
- a lightweight, semi-automated setup guide for HashiStack: Consul + Vault + Nomad, on Footloose powered Docker "container VMs", with Ansib…☆11Jul 2, 2021Updated 4 years ago
- Analytics Engineer Course☆20May 17, 2023Updated 2 years ago
- A collection of airflow sample workflows for data processing on aws☆12Dec 1, 2017Updated 8 years ago
- This project aims to leverage Amazon Web Services to create trending Youtube videos analytics service. Project contains different data en…☆22Aug 16, 2025Updated 8 months ago
- A Proof of concept of a modern python CLI with click, pydantic, rich and anyio☆21Jan 13, 2024Updated 2 years ago
- reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.☆15Jun 26, 2023Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆22Mar 4, 2023Updated 3 years ago
- A little Pomodoro app☆13Jun 5, 2022Updated 3 years ago
- StatusNotifier for xfce4-panel and vala-panel - GitHub mirror☆11Apr 12, 2019Updated 7 years ago
- Detailed notes and homeworks from 2025 Data Engineering Zoomcamp by Datatalks.Club☆56Mar 10, 2025Updated last year
- A POC framework to create Wordpress docker image with Ansible/Packer and deploy it to AWS ECS using Terraform☆17Jun 23, 2021Updated 4 years ago
- End-to-End ELT data pipeline with Postgres, Airbyte, dbt, Dagster, Snowflake and Metabase☆11Jul 13, 2023Updated 2 years ago
- Cloned by the `dbt init` task☆62Apr 28, 2024Updated 2 years ago
- Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. The next cohort starts in January 2026. Jo…☆40,481Apr 20, 2026Updated last week
- Project was based on an interest in Data Engineering, ETL pipeline. It also provided a good opportunity to develop skills and experience…☆31Sep 12, 2023Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A complete pipeline to pull data from Scryfall's "Magic: The Gathering"-API, via Prefect orchestration and dbt transformation.☆43Apr 27, 2023Updated 3 years ago
- Freepn tray controller for fpnd based on pygobject, app-indicator3 and gtk3☆16Dec 4, 2020Updated 5 years ago
- Examples which shows how to create MATE panel applet with Python.☆18Sep 14, 2019Updated 6 years ago
- Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO☆65Jul 21, 2023Updated 2 years ago
- A Scala library for Firestore in Datastore mode☆13Jun 11, 2024Updated last year
- dbt module for myBI connect☆13Jan 31, 2023Updated 3 years ago
- Telegram bot using GPT4 API☆15Aug 26, 2024Updated last year