This is a comprehensive end-to-end data engineering project. I extracted data directly from YouTube in raw JSON format using Python and AWS Lambda, performed transformations using Apache Spark and AWS Glue, and finally loaded the data into a table format in the data warehouse using Snowflake.
☆13Jun 4, 2024Updated 2 years ago
Alternatives and similar repositories for Youtube_End_To_End_Data_Pipeline
Users that are interested in Youtube_End_To_End_Data_Pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12Mar 17, 2022Updated 4 years ago
- This repository contains the "RFM Analysis" for a Sales Data of a Retailer in SQL. This is part of my Data Science Portfolio Projects☆10Jul 3, 2023Updated 3 years ago
- Codebasics Resume Project Challenge, Provide Insights to Revenue Team in Hospitality Domain☆10Sep 27, 2022Updated 4 years ago
- data-warehouse-snowflake-for-data-engineering☆19Sep 14, 2023Updated 3 years ago
- 💡 You can easily extract photos 📸 from an Excel 📊 cell using this Python script. But wait, there's more! These photos can also be save…☆13Oct 24, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- code-snippets☆14Apr 9, 2026Updated 7 months ago
- This project is for a Data Analytics Internship.☆15Dec 23, 2022Updated 3 years ago
- This project aims to conduct an analysis of costumers behavior and perception of the brand, by implementing different marketing analytics…☆13May 7, 2024Updated 2 years ago
- This repository provides various web scraping projects in Jupyter notebooks for both learning and data-related workshopes☆14Oct 21, 2022Updated 4 years ago
- My solutions to exercises from various SQL learning courses and platforms☆12Jun 23, 2021Updated 5 years ago
- A streamlit app to show the diff between normal and t distribution☆11Mar 31, 2023Updated 3 years ago
- A t-sne implementation on GOT dataset☆13Jan 4, 2024Updated 2 years ago
- Automated extraction of specific information from invoices, achieving over 95% accuracy.☆13Jul 14, 2023Updated 3 years ago
- The goal of this project is to analyse the impact of Covid-19 on the Aviation industry through data engineering processes using technolog…☆13Jun 26, 2022Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- pandas I/O functions☆14Jan 23, 2023Updated 3 years ago
- simple viz tools to visualize matrix linear transformation☆18Apr 15, 2023Updated 3 years ago
- Tableau Projects for data analysis, data analytics and data visualaization on different data sets☆16Jun 18, 2020Updated 6 years ago
- Picarch is a Python project for face detection and image similarity search using insightface and PostgreSQL.☆14Apr 8, 2025Updated last year
- Analyze market research data to uncover key insights into financial behaviors across demographic segments. This Jupyter Notebook explores…☆13Aug 28, 2023Updated 3 years ago
- This is Project Repository For Password Generator Project In Web Development 2.0 - iNeuron☆12Mar 14, 2024Updated 2 years ago
- Repository for Spark using Python material. It is popularly known as PySpark.☆20Aug 18, 2021Updated 5 years ago
- 🐍🗺️ This Python script empowers you to scrape data from Google Maps, enabling extraction of valuable information like addresses, review…☆13Aug 5, 2023Updated 3 years ago
- ☆20Jan 29, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This project provides Inventory Management using Power BI, extremely useful for Warehouse/ In-plant Inventory Managers to effectively con…☆15Feb 18, 2024Updated 2 years ago
- An API based NLP application created using Tkinter and OOP☆16Dec 3, 2022Updated 3 years ago
- Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake developme…☆12Feb 26, 2020Updated 6 years ago
- This project would demonstrate the following capabilities: 1. Extraction Loading and Transformation of S&P 500 data and company fundament…☆14Sep 26, 2021Updated 5 years ago
- ☆15Jan 2, 2024Updated 2 years ago
- Welcome to the Financial Reporting & Analysis with Power BI repository! This project showcases a comprehensive financial reporting and ad…☆14Feb 10, 2024Updated 2 years ago
- ☆33Sep 16, 2026Updated last month
- INSAID Assignment to create a ML model to detect fraud transactions for a financial company.☆16Nov 19, 2022Updated 3 years ago
- ☆16Sep 19, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Find all ExcelR Data Analyst Assignment Solution Here 1. Advanced Excel 2. MySQL 3. Python 4. Tableau 5. Power BI☆17Mar 3, 2024Updated 2 years ago
- A posenet demo built using ml5.js☆17Feb 7, 2023Updated 3 years ago
- Indago is a web-based job tracking application that allows job seekers to easily keep track of their job search progress.☆11Dec 8, 2024Updated last year
- ☆14Aug 27, 2026Updated 2 months ago
- Repo which holds the materials for the EMR Zero To Hero☆28May 7, 2022Updated 4 years ago
- Complete Azure Data Factory CICD Process Via Azure Pipeline☆31Jan 31, 2024Updated 2 years ago
- Generates and updates a human-readable description for a Postman Collection using the OpenAI API, based on the collection ID provided as …☆14Mar 30, 2023Updated 3 years ago
Are these results useful?