On-car / spotify-end-to-end-data-engineering--project
Integrating with Spotify API and extracting Data. Deploying code on AWS Lambda for Data Extraction. Adding trigger to run the extraction automatically Writing transformation function. Building automated trigger on transformation function. Store files on S3 properly. Building Analytics Tables on data files using Glue and Athena.
☆10Updated last year
Alternatives and similar repositories for spotify-end-to-end-data-engineering--project
Users that are interested in spotify-end-to-end-data-engineering--project are comparing it to the libraries listed below
Sorting:
- ☆12Updated 2 years ago
- This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow or…☆14Updated 3 weeks ago
- This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…☆21Updated last year
- ☆13Updated 2 weeks ago
- DataTalks Workshop Materials☆18Updated last year
- ☆65Updated 2 weeks ago
- YouTube tutorial project☆102Updated last year
- ☆16Updated last year
- In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …☆29Updated last year
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆22Updated 2 years ago
- ☆21Updated last year
- ☆11Updated last year
- ☆30Updated 5 months ago
- ☆19Updated last year
- Road to Azure Data Engineer Part-II: DP-201 - Designing an Azure Data Solution☆19Updated 4 years ago
- ☆28Updated last year
- An end-to-end data engineering pipeline that fetches real-time YouTube analytics and streams them through Kafka for processing with ksqlD…☆11Updated last year
- ☆18Updated 4 months ago
- ☆40Updated 10 months ago
- Snowflake - Build and Architect Data Pipelines using AWS, published by Packt☆21Updated 2 years ago
- 😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS☆45Updated 5 years ago
- Databricks ML in Action, Published by Packt☆30Updated last week
- GitHub repository related to the course Mastering Elastic Map Reduce for Data Engineers☆24Updated 2 years ago
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆25Updated 2 years ago
- ☆29Updated 7 months ago
- Built a Data Pipeline for a Retail store using AWS services that collects data from its transactional database (OLTP) in Snowflake and tr…☆9Updated last year
- Saturn Cloud starter code for LLM Zoomcamp☆11Updated 10 months ago
- Foundational Training on MlFlow and Data Science on Databricks.☆17Updated 2 years ago
- ☆25Updated 3 years ago
- code snippet for analytics sessions☆34Updated 2 years ago