The goal of this project is to illustrate Extract Transform Load (ETL) using Python and SQL. ETL is a process commonly done in computing, which takes raw data, cleans it and stores it for later use. The extraction phase targets and retrieves the data. Transform manipulates and cleans the data. Then load stores the data, typically in a data wareh…
☆34Sep 7, 2021Updated 4 years ago
Alternatives and similar repositories for ETL-Project
Users that are interested in ETL-Project are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- German Language Learning Resource☆42Jul 11, 2021Updated 5 years ago
- This repository contains tasks on how to build an ETL pipeline for the online transaction data of an e-commerce company.☆19Jun 27, 2023Updated 3 years ago
- This is a comprehensive end-to-end data engineering project. I extracted data directly from YouTube in raw JSON format using Python and A…☆12Jun 4, 2024Updated 2 years ago
- NoSQL extract, transform, load (ETL) toolkit with Python☆16Updated this week
- This project describes how to write full ETL data pipeline using spark.☆15Oct 15, 2022Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- 🌟 An end-to-end full-stack data science project, including modelling, MLOps, and data storytelling. ✨☆16Aug 30, 2025Updated last year
- This project is for a Data Analytics Internship.☆15Dec 23, 2022Updated 3 years ago
- Data Engineering, Data Warehouse, Data Mart, Cloud Data, AWS, SAS, Redshift, S3☆34Feb 2, 2021Updated 5 years ago
- Django Argon Dashboard - Tailwind CSS (Open-Source) | AppSeed☆11Mar 16, 2023Updated 3 years ago
- StarCraft 2 Data Pipeline with Airflow, DuckDB and Streamlit☆17Mar 14, 2024Updated 2 years ago
- INSAID Assignment to create a ML model to detect fraud transactions for a financial company.☆16Nov 19, 2022Updated 3 years ago
- This project would demonstrate the following capabilities: 1. Extraction Loading and Transformation of S&P 500 data and company fundament…☆15Sep 26, 2021Updated 4 years ago
- ☆16Sep 19, 2023Updated 2 years ago
- velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…☆21Aug 12, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- This project focuses on creating comprehensive financial reports using Power BI, leveraging Data Analysis Expressions (DAX), Excel data, …☆18Dec 24, 2023Updated 2 years ago
- Skooldio: Data Pipelines with Airflow☆23May 24, 2025Updated last year
- End-to-End BI & DW project: Data Warehousing design and modeling (MySQL), ETL (PDI) and Dashboard (Tableau)☆18Aug 10, 2020Updated 6 years ago
- ☆19Dec 14, 2021Updated 4 years ago
- DataTalks.Club's Data Engineering Zoomcamp Project☆25Jul 14, 2022Updated 4 years ago
- ☆25Dec 18, 2020Updated 5 years ago
- Open episode of the data engineering practice course☆31Jul 2, 2024Updated 2 years ago
- Awesome list for datapipeline☆37Feb 6, 2023Updated 3 years ago
- Simple ETL pipeline using Python☆29May 22, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A end-to-end real-time stock market data pipeline with Python, AWS EC2, Apache Kafka, and Cassandra Data is processed on AWS EC2 with Apa…☆29Jun 7, 2023Updated 3 years ago
- Spark data pipeline that processes movie ratings data.☆31Aug 1, 2026Updated last month
- Welcome to my data engineering projects repository! Here you will find a collection of data engineering projects that I have worked on.☆25Apr 27, 2023Updated 3 years ago
- Training workshop content on Azure Data Factory and Azure Synapse Analytics Data Integration Pipelines☆31Nov 12, 2024Updated last year
- This project serves as a comprehensive guide to building an end-to-end data engineering pipeline using TCP/IP Socket, Apache Spark, OpenA…☆45Jan 4, 2024Updated 2 years ago
- data engineering 100 days 🤖 🧲 🦾 | #DE☆41Sep 15, 2023Updated 2 years ago
- Attack Active Directory Trusts with a single tool☆14Jan 15, 2025Updated last year
- An awesome Data Science repository to learn and apply for real world problems.☆32Jul 1, 2016Updated 10 years ago
- ☆38May 21, 2026Updated 3 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Tool for obtaining information about PPL processes☆16Feb 12, 2024Updated 2 years ago
- A python wrapper for Indian Railways Enquiry API!☆49May 22, 2023Updated 3 years ago
- ☆42Oct 20, 2024Updated last year
- A PoC executing shellcode in Dart☆15Jun 28, 2022Updated 4 years ago
- Python sample for Z-Ware Web API☆16Oct 12, 2018Updated 7 years ago
- LLM Vulnerable Application☆13Aug 19, 2023Updated 3 years ago
- AI modular structure that provides automation-based attack and penetration☆14May 10, 2024Updated 2 years ago