In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data from the Spotify API, transform into desired format and load it into an AWS data store.
☆25May 6, 2023Updated 3 years ago
Alternatives and similar repositories for spotify-data-engineering-project
Users that are interested in spotify-data-engineering-project are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project involves an ETL (Extract, Transform, Load) process to analyze sleep data exported from Apple Health☆29Apr 29, 2023Updated 3 years ago
- A data engineering project with Airflow, dbt, Terrafrom, GCP and much more!☆26Nov 8, 2022Updated 3 years ago
- ☆19May 27, 2023Updated 3 years ago
- I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…☆29May 2, 2023Updated 3 years ago
- ☆21Jan 13, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Contains spark dataframe solutions of leetcode questions☆24Dec 13, 2022Updated 3 years ago
- ☆173May 20, 2022Updated 4 years ago
- Base Kafka Producer, consumer, flask api and PySpark Structured streaming Job☆11Oct 20, 2021Updated 4 years ago
- Integrating with Spotify API and extracting Data. Deploying code on AWS Lambda for Data Extraction. Adding trigger to run the extraction …☆12Jul 5, 2023Updated 2 years ago
- A repo to track data engineering projects☆13Nov 11, 2022Updated 3 years ago
- DataTalks.Club's Data Engineering Zoomcamp Project☆11May 7, 2023Updated 3 years ago
- ☆40Jul 11, 2023Updated 2 years ago
- YouTube tutorial project☆107Oct 17, 2023Updated 2 years ago
- Spotify data pipeline: Extract, transform, and analyze using AWS, Lambda, Glue, Athena, and S3.☆13Jun 27, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A batch Data Pipeline that retrieves data from a user purchase table and a movie review table and is transformed to form a user behaviour…☆18Aug 14, 2025Updated 10 months ago
- Ultimate guide for mastering Spark Performance Tuning and Optimization concepts and for preparing for Data Engineering interviews☆233Dec 31, 2025Updated 5 months ago
- ☆17Apr 1, 2025Updated last year
- Data pipeline that scrapes Rust cheater Steam profiles☆54Feb 13, 2022Updated 4 years ago
- Practice your pandas skills!☆11Dec 10, 2019Updated 6 years ago
- ☆16Jul 15, 2023Updated 2 years ago
- Data Engineering Project in GCP☆22Mar 29, 2023Updated 3 years ago
- Airflow POC demo : 1) env set up 2) airflow DAG 3) Spark/ML pipeline | #DE☆11Dec 19, 2022Updated 3 years ago
- Codewars solutions in Python☆39Jun 15, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This repo contains all the code used in the Python for Data Engineering Course☆366Apr 24, 2024Updated 2 years ago
- ☆146Jan 31, 2023Updated 3 years ago
- ☆23Nov 8, 2022Updated 3 years ago
- ☆214Aug 13, 2023Updated 2 years ago
- ☆15Oct 19, 2023Updated 2 years ago
- A real-time reddit data streaming pipeline for sentiment analysis of various subreddits☆148Aug 23, 2023Updated 2 years ago
- ☆10Jun 3, 2017Updated 9 years ago
- RedditR for Content Engagement and Recommendation☆18Dec 21, 2017Updated 8 years ago
- My personal collection of dotfiles☆12May 26, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Pyspark Spotify ETL☆17Aug 19, 2021Updated 4 years ago
- ☆14May 14, 2019Updated 7 years ago
- Data Structures in Python☆10May 25, 2026Updated 3 weeks ago
- In this project I used ML modeling and data analysis to predict ad clicks and significantly improve ad campaign performance, resulting in…☆13Nov 6, 2023Updated 2 years ago
- class code of Ai chatbot and voice app online course☆11Jul 22, 2025Updated 10 months ago
- Ecommerce Realtime Data Pipeline (Data Modeling, Workflow Orchestration, Change Data Capture, Analytical Database and Dashboarding)☆69Mar 9, 2024Updated 2 years ago
- Azure Data Factory Cookbook_Second Edition, published by Packt☆19Feb 29, 2024Updated 2 years ago