sidharth1805 / Spotify_etlView external linksLinks
☆147Jan 31, 2023Updated 3 years ago
Alternatives and similar repositories for Spotify_etl
Users that are interested in Spotify_etl are comparing it to the libraries listed below
Sorting:
- ☆168May 20, 2022Updated 3 years ago
- I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…☆29May 2, 2023Updated 2 years ago
- Integrating with Spotify API and extracting Data. Deploying code on AWS Lambda for Data Extraction. Adding trigger to run the extraction …☆11Jul 5, 2023Updated 2 years ago
- Pipeline that extracts data from Crinacle's Headphone and InEarMonitor databases and finalizes data for a Metabase Dashboard. The dashboa…☆245Jan 1, 2023Updated 3 years ago
- ☆212Aug 13, 2023Updated 2 years ago
- This project introduces PySpark, a powerful open-source framework for distributed data processing. We explore its architecture, component…☆37Sep 26, 2024Updated last year
- A data engineering project with Kafka, Spark Streaming, dbt, Docker, Airflow, Terraform, GCP and much more!☆837Apr 16, 2022Updated 3 years ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆25May 6, 2023Updated 2 years ago
- Repository for Data Engineering Zoomcamp 2024☆14Mar 25, 2024Updated last year
- capstone project for Dataengineer.io bootcamp Public Repo☆12Feb 20, 2024Updated last year
- ☆384Jan 26, 2025Updated last year
- Data engineering project using UK Bus Open Data Service (BODS) to calculate late buses in real-time for any selected region in England. P…☆31Apr 2, 2023Updated 2 years ago
- Orchestrate Modal and OpenAI workloads with Dagster☆13Dec 11, 2024Updated last year
- A demonstration of an ELT (Extract, Load, Transform) pipeline☆31Feb 19, 2024Updated last year
- a simple machine learning pipeline built using Apache AirFlow☆15Nov 22, 2022Updated 3 years ago
- Code for "Advanced data transformations in SQL" free live workshop☆89May 5, 2025Updated 9 months ago
- ETL to scrape a real estate website, process house prices and data, and build an ML model of the house prices.☆16Jul 11, 2022Updated 3 years ago
- Machine Learning pipeline MVP on Docker and Apache Airflow☆15Dec 17, 2021Updated 4 years ago
- ☆16May 29, 2023Updated 2 years ago
- ☆19Jan 17, 2025Updated last year
- ☆19Apr 3, 2024Updated last year
- End-to-end data pipeline that ingests, processes, and stores data. It uses Apache Airflow to schedule scripts that fetch data from an API…☆20Jul 26, 2024Updated last year
- ☆19May 27, 2023Updated 2 years ago
- This project demonstrates how to use Apache Airflow to submit jobs to Apache spark cluster in different programming laguages using Python…☆48Mar 14, 2024Updated last year
- End-to-end ELT data engineering project☆22Dec 24, 2022Updated 3 years ago
- DataTalks Workshop Materials☆19Mar 18, 2024Updated last year
- Personal Data Engineering Projects☆989Feb 8, 2023Updated 3 years ago
- ☆46Jul 6, 2024Updated last year
- Pipeline that extracts data from the Spotify API to build a more detailed version of Spotify Wrapped☆48Oct 27, 2025Updated 3 months ago
- Learn the entire ETL process based on Spotify API data☆268Feb 1, 2021Updated 5 years ago
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆43Sep 26, 2023Updated 2 years ago
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…☆23May 14, 2022Updated 3 years ago
- This project involves an ETL (Extract, Transform, Load) process to analyze sleep data exported from Apple Health☆29Apr 29, 2023Updated 2 years ago
- Example end to end data engineering project.☆1,384Dec 8, 2022Updated 3 years ago
- An SQL data cleaning project☆51Nov 16, 2022Updated 3 years ago
- Projects and studies regarding Data Engineering Area☆21May 27, 2024Updated last year
- ☆19Feb 25, 2022Updated 3 years ago
- Solution to all projects of Udacity's Data Engineering Nanodegree: Data Modeling with Postgres & Cassandra, Data Warehouse with Redshift,…☆57Oct 20, 2022Updated 3 years ago
- Example projects built on MotherDuck☆42Updated this week