On-car / spotify-end-to-end-data-engineering--projectLinks
Integrating with Spotify API and extracting Data. Deploying code on AWS Lambda for Data Extraction. Adding trigger to run the extraction automatically Writing transformation function. Building automated trigger on transformation function. Store files on S3 properly. Building Analytics Tables on data files using Glue and Athena.
☆10Updated last year
Alternatives and similar repositories for spotify-end-to-end-data-engineering--project
Users that are interested in spotify-end-to-end-data-engineering--project are comparing it to the libraries listed below
Sorting:
- ☆65Updated last month
- This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow or…☆15Updated 2 months ago
- ☆30Updated 6 months ago
- code snippet for analytics sessions☆35Updated 3 years ago
- ☆12Updated 2 years ago
- YouTube tutorial project☆103Updated last year
- ☆12Updated last month
- This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…☆21Updated 2 years ago
- Content related to Mastering Postgresql along with videos.☆16Updated 3 years ago
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…☆22Updated 3 years ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆23Updated 2 years ago
- Databricks ML in Action, Published by Packt☆30Updated last month
- In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …☆32Updated last year
- ☆13Updated last month
- ☆15Updated 3 years ago
- Glue ETL job or EMR Spark that gets from data catalog, modifies and uploads to S3 and Data Catalog☆11Updated last year
- ☆21Updated last year
- DataTalks Workshop Materials☆19Updated last year
- ☆33Updated last year
- an end-to-end data pipeline extracting music listening habits and producing an insightful dashboard☆17Updated last year
- ☆11Updated last year
- ☆83Updated 9 months ago
- An end-to-end data engineering pipeline that fetches real-time YouTube analytics and streams them through Kafka for processing with ksqlD…☆12Updated last year
- ☆18Updated 5 months ago
- GitHub repository related to the course Mastering Elastic Map Reduce for Data Engineers☆24Updated 2 years ago
- ☆30Updated last week
- ☆16Updated 2 years ago
- ☆40Updated 11 months ago
- ☆11Updated last year
- ☆19Updated 2 years ago