On-car / spotify-end-to-end-data-engineering--projectLinks
Integrating with Spotify API and extracting Data. Deploying code on AWS Lambda for Data Extraction. Adding trigger to run the extraction automatically Writing transformation function. Building automated trigger on transformation function. Store files on S3 properly. Building Analytics Tables on data files using Glue and Athena.
☆11Updated 2 years ago
Alternatives and similar repositories for spotify-end-to-end-data-engineering--project
Users that are interested in spotify-end-to-end-data-engineering--project are comparing it to the libraries listed below
Sorting:
- This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow or…☆17Updated last month
- This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…☆22Updated 2 years ago
- ☆30Updated 9 months ago
- ☆12Updated 5 months ago
- ☆12Updated 2 years ago
- ☆68Updated last month
- Content related to Mastering Postgresql along with videos.☆19Updated 4 years ago
- Financial Risk Assessment System☆24Updated 9 months ago
- ☆20Updated 7 months ago
- ☆13Updated 3 months ago
- Generative AI with Amazon Bedrock, published by Packt☆26Updated last year
- An end-to-end data engineering pipeline that fetches real-time YouTube analytics and streams them through Kafka for processing with ksqlD…☆12Updated 2 years ago
- YouTube tutorial project☆106Updated last year
- ☆18Updated last year
- ☆29Updated last year
- End-to-End deployment of E-commerce customers segmentation using Clustering Machine learning algorithms in Google Cloud Platform and MLOp…☆18Updated last year
- An end-to-end MLOps pipeline(CI/CD/CT/CM) project for training, versioning, deploying, and monitoring machine learning models using FastA…☆19Updated last year
- ☆18Updated 4 months ago
- ☆19Updated last year
- ☆16Updated 2 years ago
- E2E MLOps with Databricks☆14Updated 9 months ago
- Saturn Cloud starter code for LLM Zoomcamp☆11Updated last year
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆42Updated last year
- ☆16Updated 2 years ago
- Snowflake - Build and Architect Data Pipelines using AWS, published by Packt☆23Updated 2 years ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆24Updated 2 years ago
- Foundational Training on MlFlow and Data Science on Databricks.☆17Updated 2 years ago
- Road to Azure Data Engineer Part-II: DP-201 - Designing an Azure Data Solution☆19Updated 5 years ago
- This is code depository for my upcoming session. Will update details post the session☆40Updated 2 years ago
- ☆24Updated 9 months ago