In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data from the Spotify API, transform into desired format and load it into an AWS data store.
☆25May 6, 2023Updated 3 years ago
Alternatives and similar repositories for spotify-data-engineering-project
Users that are interested in spotify-data-engineering-project are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project involves an ETL (Extract, Transform, Load) process to analyze sleep data exported from Apple Health☆29Apr 29, 2023Updated 3 years ago
- A data engineering project with Airflow, dbt, Terrafrom, GCP and much more!☆28Nov 8, 2022Updated 3 years ago
- ☆19May 27, 2023Updated 3 years ago
- I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…☆29May 2, 2023Updated 3 years ago
- ☆21Jan 13, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Base Kafka Producer, consumer, flask api and PySpark Structured streaming Job☆11Oct 20, 2021Updated 4 years ago
- ☆176May 20, 2022Updated 4 years ago
- Integrating with Spotify API and extracting Data. Deploying code on AWS Lambda for Data Extraction. Adding trigger to run the extraction …☆12Jul 5, 2023Updated 3 years ago
- DataTalks.Club's Data Engineering Zoomcamp Project☆11May 7, 2023Updated 3 years ago
- ☆40Jul 11, 2023Updated 3 years ago
- A repo to track data engineering projects☆14Nov 11, 2022Updated 3 years ago
- YouTube tutorial project☆112Oct 17, 2023Updated 2 years ago
- 65 Articles on SQL: A Comprehensive Guide to Mastering Advanced SQL☆11Jun 7, 2023Updated 3 years ago
- Data Engineering & Analysis Project- San Francisco Eviction Data ETL Pipeline An end-to-end batch data pipeline for performing ETL on San…☆10Oct 2, 2025Updated 11 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Data from the state of data science survey released by Anaconda each year.☆17Aug 15, 2024Updated 2 years ago
- ☆26May 12, 2023Updated 3 years ago
- A batch Data Pipeline that retrieves data from a user purchase table and a movie review table and is transformed to form a user behaviour…☆18Aug 14, 2025Updated last year
- Spotify data pipeline: Extract, transform, and analyze using AWS, Lambda, Glue, Athena, and S3.☆13Jun 27, 2023Updated 3 years ago
- Data pipeline that scrapes Rust cheater Steam profiles☆53Feb 13, 2022Updated 4 years ago
- Data Engineering Project in GCP☆22Mar 29, 2023Updated 3 years ago
- ☆20Mar 9, 2023Updated 3 years ago
- ☆16Jul 15, 2023Updated 3 years ago
- ☆15Oct 19, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- This repository implements a real-time credit card fraud detection pipeline using Kafka, Spark and Cassandra. Kafka continuously produces…☆26Feb 3, 2021Updated 5 years ago
- PySpark Tutorials and Materials☆19Mar 1, 2021Updated 5 years ago
- tutorial-vending-machine-marcgibbons created by GitHub Classroom☆10May 22, 2019Updated 7 years ago
- DataTalks.Club's Data Engineering Zoomcamp Project☆25Jul 14, 2022Updated 4 years ago
- Airflow POC demo : 1) env set up 2) airflow DAG 3) Spark/ML pipeline | #DE☆11Dec 19, 2022Updated 3 years ago
- This repo contains all the code used in the Python for Data Engineering Course☆382Apr 24, 2024Updated 2 years ago
- In this project I used ML modeling and data analysis to predict ad clicks and significantly improve ad campaign performance, resulting in…☆12Nov 6, 2023Updated 2 years ago
- A project portfolio to accompany my resume☆30Sep 5, 2023Updated 3 years ago
- Pipeline that extracts data from Crinacle's Headphone and InEarMonitor databases and finalizes data for a Metabase Dashboard. The dashboa…☆270Jan 1, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆216Aug 13, 2023Updated 3 years ago
- ☆23Nov 8, 2022Updated 3 years ago
- This repository include the Roadmap for Cloud Data Engineering☆59Aug 3, 2026Updated last month
- ☆16May 29, 2023Updated 3 years ago
- This project contains my solution for all the data structures and algorithms on Algo Expert, Hackerrank and Leetcode. This repository is …☆10Jan 24, 2021Updated 5 years ago
- Repository containing projects and summaries of my studies in the field of Data Engineering.☆59May 22, 2026Updated 3 months ago
- Sample Faust project to process tweets in real-time☆13Mar 29, 2021Updated 5 years ago