On-car / spotify-end-to-end-data-engineering--projectLinks
Integrating with Spotify API and extracting Data. Deploying code on AWS Lambda for Data Extraction. Adding trigger to run the extraction automatically Writing transformation function. Building automated trigger on transformation function. Store files on S3 properly. Building Analytics Tables on data files using Glue and Athena.
☆11Updated 2 years ago
Alternatives and similar repositories for spotify-end-to-end-data-engineering--project
Users that are interested in spotify-end-to-end-data-engineering--project are comparing it to the libraries listed below
Sorting:
- ☆12Updated 2 months ago
- This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow or…☆16Updated this week
- ☆68Updated this week
- ☆12Updated 2 years ago
- ☆17Updated 3 months ago
- ☆30Updated 7 months ago
- Learn AWS Automation with boto3, Python, and Lambda Functions, by Packt Publishing☆17Updated last month
- Foundational Training on MlFlow and Data Science on Databricks.☆17Updated 2 years ago
- ☆17Updated 5 months ago
- E2E MLOps with Databricks☆14Updated 8 months ago
- YouTube tutorial project☆105Updated last year
- An end to end ML project. Using MLflow for experiment tracking and model registry. Prefect for workflow orchestration. S3 for artifacts s…☆12Updated 2 years ago
- my personal working directory of milvus projects☆17Updated last year
- This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…☆22Updated 2 years ago
- An end-to-end MLOps pipeline(CI/CD/CT/CM) project for training, versioning, deploying, and monitoring machine learning models using FastA…☆18Updated last year
- An end-to-end data engineering pipeline that fetches real-time YouTube analytics and streams them through Kafka for processing with ksqlD…☆14Updated last year
- ☆19Updated last year
- Machine Learning Model and Deployment for Classification of Mango Varieties☆10Updated 2 years ago
- Generative AI with Amazon Bedrock, published by Packt☆26Updated last year
- Resources for the free AWS Data Engineering course on youtube☆101Updated 3 years ago
- GitHub repository related to the course Mastering Elastic Map Reduce for Data Engineers☆24Updated 3 years ago
- Recohut - Learn data engineering, data science☆98Updated last year
- Road to Azure Data Engineer Part-II: DP-201 - Designing an Azure Data Solution☆20Updated 4 years ago
- Saturn Cloud starter code for LLM Zoomcamp☆11Updated last year
- ☆14Updated 8 months ago
- ☆28Updated last year
- ☆18Updated last year
- Datastructure for data science☆22Updated last year
- ☆15Updated 2 years ago
- ☆71Updated 7 months ago