Welcome to my data engineering projects repository! Here you will find a collection of data engineering projects that I have worked on.
☆27Apr 27, 2023Updated 3 years ago
Alternatives and similar repositories for data-engineering-projects
Users that are interested in data-engineering-projects are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Construindo Pipeline de Dados com Astro Python SDK, dbt & Apache Airflow☆10Mar 20, 2024Updated 2 years ago
- Sample Project to Learn Data Engineering☆10Aug 1, 2021Updated 5 years ago
- Data pipeline to build a data warehouse on Postgres☆16Aug 11, 2024Updated 2 years ago
- ☆13Mar 5, 2023Updated 3 years ago
- In this project I have built etl pipline which scraps the trending repository based on month,week and day LIVE extract other related info…☆12Sep 9, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- NoSQL extract, transform, load (ETL) toolkit with Python☆16Oct 31, 2026Updated 3 weeks ago
- Fivetran data models for QuickBooks using dbt.☆41Updated this week
- Comprehensive open-source supply-chain visibility, providing system-wide package discovery, validation, vulnerability scanning, and allow…☆13Updated this week
- This app is designed to assist applicants in searching for potential jobs and to help recruiters find talented candidates.☆15Feb 16, 2025Updated last year
- scrapeflow-react☆10Dec 17, 2024Updated last year
- Business Intelligence and Data Warehousing Project☆12Dec 4, 2019Updated 6 years ago
- ☆12Mar 6, 2021Updated 5 years ago
- Spark Structured Streaming data pipeline that processes movie ratings data in real-time.☆14Nov 1, 2026Updated 3 weeks ago
- Python or SQL for data transformation☆11Jul 4, 2024Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Simple Flutter Application which uses On-Device Machine Learning.☆10Sep 7, 2020Updated 6 years ago
- ☆14Feb 23, 2025Updated last year
- XCloud Project's objective is to build similar infrastructure on both AWS and GCP to have multi cloud infrastructure for an organization …☆14Aug 1, 2022Updated 4 years ago
- Get Crypto data from API, stream it to Kafka with Airflow. Write data to MySQL and visualize with Metabase☆17Oct 2, 2023Updated 3 years ago
- 🦜 Flutter app that detects the species of the bird☆12Dec 31, 2024Updated last year
- Hands-on LangChain tutorial for Retrieval-Augmented Generation (RAG). Notebooks cover document loading, embeddings, simple and advanced R…☆17Updated this week
- Examples of Clean Architecture in Python, with folders matching the classic circle diagram.☆13Oct 9, 2026Updated last month
- Example of a Streamlit data app powered by Vaex☆11Jul 7, 2022Updated 4 years ago
- C# library with demo UI app for creating, training and validation of neural network models☆11May 1, 2021Updated 5 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- The project aims to automate the extraction of data from a YouTube channel, transform the data into a suitable format, and make it availa…☆12Sep 24, 2023Updated 3 years ago
- This is an analytical project done using python to process and extract valuable insights from WhatsApp text file, deployed as a webapp us…☆19Dec 8, 2023Updated 2 years ago
- An ETL pipeline for Covid19 Data collected from John Hopkin's Github☆11Dec 18, 2020Updated 5 years ago
- Hands-On Tutorial on Building Multimodal RAG Systems☆14Apr 10, 2025Updated last year
- Script to obtain PPG Bilateral lending between 2 countries using World Bank API☆64Sep 30, 2022Updated 4 years ago
- End to End Data Engineering Projects☆16May 13, 2024Updated 2 years ago
- Try to code some algorithms☆17Apr 3, 2025Updated last year
- Formação Engenheiro de Dados Cloud e Big Data (Azure & DataBricks)☆18Oct 31, 2023Updated 3 years ago
- This repository contains a collection of hands-on labs designed to help you learn and practice working with Amazon Web Services (AWS). Wh…☆12Jan 14, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆10Feb 27, 2025Updated last year
- StarCraft 2 Data Pipeline with Airflow, DuckDB and Streamlit☆18Mar 14, 2024Updated 2 years ago
- Designed and implemented a Task Management Application using React, Node.js, Express.js, and MongoDB. Key features include secure JWT aut…☆13Dec 7, 2024Updated last year
- ☆13May 19, 2023Updated 3 years ago
- A Model Context Protocol (MCP) server built with C# and .NET 10. Tools, resources and prompts, backed by Azure SQL, secured with Microsof…☆15Oct 3, 2026Updated last month
- how to unit test your PySpark code☆29Mar 26, 2021Updated 5 years ago
- velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…☆20Aug 12, 2025Updated last year
Are these results useful?