Generate synthetic Spotify music stream dataset to create dashboards. Spotify API generates fake event data emitted to Kafka. Spark consumes and processes Kafka data, saving it to the Datalake. Airflow orchestrates the pipeline. dbt moves data to Snowflake, transforms it, and creates dashboards.
☆72Dec 17, 2023Updated 2 years ago
Alternatives and similar repositories for spotify-stream-analytics
Users that are interested in spotify-stream-analytics are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…☆21Aug 12, 2025Updated 11 months ago
- Simple project using pyflink, kafka and postgre containerized using Docker☆11Aug 26, 2024Updated last year
- AskFAST is a chatbot designed to handle admission-related queries for FAST. It’s your go-to AI assistant for all things admission at FAST…☆11Aug 5, 2024Updated last year
- ⚙️ Airflow data pipeline with Terraform, GCP BigQuery, dbt, Soda and Looker Studio.☆26Oct 19, 2023Updated 2 years ago
- ☆15Apr 14, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This repository contains the capstone project carried out as part of Machine Learning Zoomcamp course☆10Dec 26, 2022Updated 3 years ago
- This repository contains notebooks, homework, projects and notes done during Machine Learning Zoomcamp course.☆13Nov 13, 2024Updated last year
- "#8WeekSQLChallenge : Solutions for a thrilling project that offers weekly SQL case studies! Engaged in real-world data analysis with int…☆20Aug 30, 2023Updated 2 years ago
- Public data and analytics for our open course☆34Mar 22, 2024Updated 2 years ago
- Local development environment for python data projects, with Docker☆23Dec 14, 2022Updated 3 years ago
- This repo consists of all important concepts for data engineers.☆11Jun 2, 2026Updated last month
- A custom end-to-end analytics platform for customer churn☆10May 15, 2025Updated last year
- Testing Spark Structured Streaming anf Kafka with real data from traffic sensors☆17Nov 11, 2022Updated 3 years ago
- Here I will be exploring various tools and methods that are used in data engineering process with Python.☆21Jan 4, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand☆55Sep 30, 2023Updated 2 years ago
- Code test for data engineering candidates☆47Mar 27, 2024Updated 2 years ago
- Data Augmentation with Python, published by Packt☆37Oct 28, 2024Updated last year
- Candace's Data Engineering Zoomcamp files and notes☆18Jul 4, 2023Updated 3 years ago
- ☆15Oct 19, 2023Updated 2 years ago
- 네이버 쇼핑 리뷰 데이터를 통해 감성 분석하기(GRU, LSTM)☆10Sep 27, 2021Updated 4 years ago
- Code for my "Efficient Data Processing in SQL" book.☆63Aug 6, 2024Updated last year
- A platform and cloud-based service for data sharing based on the Delta Sharing protocol.☆21Jun 12, 2024Updated 2 years ago
- 📦 Starting box for Vagrant. Inside box Ubuntu 20.04 LTS with Git, Docker and Docker compose.☆19May 5, 2022Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- The goal of this project is to analyse the impact of Covid-19 on the Aviation industry through data engineering processes using technolog…☆13Jun 26, 2022Updated 4 years ago
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆29Apr 12, 2023Updated 3 years ago
- ☆21Nov 4, 2023Updated 2 years ago
- (Python, PySpark)☆11Nov 15, 2020Updated 5 years ago
- A simple and easy to use Data Quality (DQ) tool built with Python.☆51Sep 7, 2023Updated 2 years ago
- 개인 공부☆13Apr 1, 2023Updated 3 years ago
- Para entender e aprender um pouco sobre o Apache Kafka.https://www.youtube.com/channel/UC3pevgVzUWKo5CoWdhDsoHw☆15Updated this week
- Set of Jupyter notebooks demonstrating Learning to Rank integrated with Solr and Elasticsearch☆17Jun 19, 2022Updated 4 years ago
- ☆23Feb 5, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Case Study's from Danny Ma's Serious SQL Course☆19Aug 4, 2022Updated 3 years ago
- Coursera, Big Data Essentials: HDFS, MapReduce and Spark RDD☆12Jun 18, 2019Updated 7 years ago
- ☆22Oct 21, 2024Updated last year
- ☆16May 29, 2023Updated 3 years ago
- ☆12Jul 8, 2024Updated 2 years ago
- ☆23Sep 25, 2024Updated last year
- Apache Spark 3 for Data Engineering and Analytics with Python , By Packt publishing☆24Jul 23, 2023Updated 2 years ago