mowbraysuburbs / Spotify_ETL
Using an ETL pipeline to investigate the change in hip-hop/rap genre over time
☆8Updated last year
Related projects ⓘ
Alternatives and complementary repositories for Spotify_ETL
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…☆21Updated 2 years ago
- A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousin…☆14Updated 3 years ago
- ☆27Updated last year
- ☆30Updated last year
- ☆86Updated 2 years ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆21Updated last year
- Here I will be exploring various tools and methods that are used in data engineering process with Python.☆22Updated 3 years ago
- I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…☆29Updated last year
- Learning from multiple companies in Silicon Valley. Netflix, Facebook, Google, Startups☆16Updated 6 years ago
- Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development☆21Updated 5 years ago
- This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…☆21Updated last year
- an end-to-end data pipeline extracting music listening habits and producing an insightful dashboard☆14Updated 7 months ago
- PySpark Cheatsheet☆35Updated last year
- reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.☆12Updated last year
- Classwork projects and home works done through Udacity data engineering nano degree☆74Updated 11 months ago
- ☆23Updated last year
- An end-to-end data engineering pipeline to create a dashboard for the latest content on the r/Stocks subreddit☆19Updated 2 years ago
- Course Material Data Engineering on AWS Course☆28Updated 2 months ago
- Data pipeline that scrapes Rust cheater Steam profiles☆51Updated 2 years ago
- Build & Learn Data Engineering,Machine Learning over Kubernetes. No Shortcut approach.☆58Updated last year
- This is the repo of the Weather app from my YouTube video☆13Updated last year
- Databricks Certified Associate Spark Developer preparation toolkit to setup single node Standalone Spark Cluster along with material in t…☆28Updated 7 months ago
- A simple pipeline utilising cron, Postgres, AWS EC2, and Metabase☆10Updated 4 months ago
- Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand☆42Updated last year
- This is code depository for my upcoming session. Will update details post the session☆40Updated last year
- ☆14Updated 7 months ago
- Final Project of the MLOps Zoomcamp hosted by DataTalksClub.☆25Updated last year
- The goal of this project is to offer an AWS EMR template using Spot Fleet and On-Demand Instances that you can use quickly. Just focus on…☆26Updated 2 years ago
- Data Quest - Data Engineer Learning and Projects☆24Updated 5 years ago
- Code for my "Efficient Data Processing in SQL" book.☆50Updated 3 months ago