On-car / spotify-end-to-end-data-engineering--projectLinks
Integrating with Spotify API and extracting Data. Deploying code on AWS Lambda for Data Extraction. Adding trigger to run the extraction automatically Writing transformation function. Building automated trigger on transformation function. Store files on S3 properly. Building Analytics Tables on data files using Glue and Athena.
☆10Updated last year
Alternatives and similar repositories for spotify-end-to-end-data-engineering--project
Users that are interested in spotify-end-to-end-data-engineering--project are comparing it to the libraries listed below
Sorting:
- This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow or…☆14Updated last month
- ☆64Updated last week
- ☆30Updated 5 months ago
- YouTube tutorial project☆103Updated last year
- This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…☆21Updated 2 years ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆22Updated 2 years ago
- ☆19Updated last year
- In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …☆30Updated last year
- ☆12Updated 2 years ago
- ☆89Updated 2 years ago
- ☆19Updated last year
- Snowflake - Build and Architect Data Pipelines using AWS, published by Packt☆21Updated 2 years ago
- This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…☆98Updated 10 months ago
- ☆15Updated 2 years ago
- DataTalks Workshop Materials☆18Updated last year
- GitHub repository related to the course Mastering Elastic Map Reduce for Data Engineers☆24Updated 2 years ago
- Databricks ML in Action, Published by Packt☆30Updated 3 weeks ago
- Saturn Cloud starter code for LLM Zoomcamp☆11Updated 11 months ago
- ☆28Updated last year
- ☆11Updated last year
- ☆12Updated last week
- ☆21Updated last year
- Generative AI with Amazon Bedrock, published by Packt☆25Updated 10 months ago
- Databricks Certified Associate Spark Developer preparation toolkit to setup single node Standalone Spark Cluster along with material in t…☆30Updated last year
- PySpark Cheatsheet☆36Updated 2 years ago
- This repo is for the Linkedin Learning course: Hands-On Introduction: Data Engineering☆57Updated 9 months ago
- ☆13Updated last month
- Classwork projects and home works done through Udacity data engineering nano degree☆9Updated 3 years ago
- Azure Data Engineering Cookbook, published by Packt☆59Updated 2 years ago
- Git Repository☆140Updated 3 months ago