Generate synthetic Spotify music stream dataset to create dashboards. Spotify API generates fake event data emitted to Kafka. Spark consumes and processes Kafka data, saving it to the Datalake. Airflow orchestrates the pipeline. dbt moves data to Snowflake, transforms it, and creates dashboards.
☆72Dec 17, 2023Updated 2 years ago
Alternatives and similar repositories for spotify-stream-analytics
Users that are interested in spotify-stream-analytics are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…☆21Aug 12, 2025Updated last year
- Simple project using pyflink, kafka and postgre containerized using Docker☆12Aug 26, 2024Updated 2 years ago
- ⚙️ Airflow data pipeline with Terraform, GCP BigQuery, dbt, Soda and Looker Studio.☆26Oct 19, 2023Updated 2 years ago
- Implementation of a Q&A Chatbot with RAG using the Data Engineering Community WhatsApp group messages.☆10Jan 17, 2025Updated last year
- Local development environment for python data projects, with Docker☆22Dec 14, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This Power BI project provides insights into customer orders and product tracking using interactive dashboards. It visualizes order statu…☆10Aug 15, 2025Updated last year
- ☆17Apr 19, 2024Updated 2 years ago
- ☆12Sep 9, 2023Updated 2 years ago
- ☆14Jan 12, 2017Updated 9 years ago
- This is a capstone project associated with MLOps Zoomcamp. The end goal of the project is to build an end-to-end machine learning projec…☆13Sep 8, 2022Updated 3 years ago
- Testing Spark Structured Streaming anf Kafka with real data from traffic sensors☆17Nov 11, 2022Updated 3 years ago
- ☆11Aug 10, 2023Updated 3 years ago
- The goal of this project is to build an ETL pipeline. The data would be processed as a batch (monthly) between 2018-01 and 2021-02.☆14Mar 26, 2022Updated 4 years ago
- Here I will be exploring various tools and methods that are used in data engineering process with Python.☆21Jan 4, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand☆55Sep 30, 2023Updated 2 years ago
- Hallucination-Aware Multimodal Benchmark for Gastrointestinal Image Analysis with Large Vision Language Models☆23Oct 12, 2025Updated 10 months ago
- Candace's Data Engineering Zoomcamp files and notes☆18Jul 4, 2023Updated 3 years ago
- ☆15Oct 19, 2023Updated 2 years ago
- 네이버 쇼핑 리뷰 데이터를 통해 감성 분석하기(GRU, LSTM)☆10Sep 27, 2021Updated 4 years ago
- ☆14Aug 28, 2024Updated 2 years ago
- SQL scripts that demonstrate various features and concepts.☆14Aug 14, 2026Updated 2 weeks ago
- Code for my "Efficient Data Processing in SQL" book.☆63Aug 6, 2024Updated 2 years ago
- A platform and cloud-based service for data sharing based on the Delta Sharing protocol.☆21Jun 12, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 📦 Starting box for Vagrant. Inside box Ubuntu 20.04 LTS with Git, Docker and Docker compose.☆19May 5, 2022Updated 4 years ago
- Building Recommender System with the Two-Tower Architecture☆19Aug 10, 2021Updated 5 years ago
- An AWS Data Engineering End-to-End Project (Glue, Lambda, Kinesis, Redshift, QuickSight, Athena, EC2, S3)☆17Sep 20, 2023Updated 2 years ago
- The goal of this project is to analyse the impact of Covid-19 on the Aviation industry through data engineering processes using technolog…☆13Jun 26, 2022Updated 4 years ago
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆30Apr 12, 2023Updated 3 years ago
- An open and introductory book for the Python API of Apache Spark (pyspark) 📚📖☆12Sep 19, 2025Updated 11 months ago
- (Python, PySpark)☆10Nov 15, 2020Updated 5 years ago
- A simple and easy to use Data Quality (DQ) tool built with Python.☆51Sep 7, 2023Updated 2 years ago
- 개인 공부☆13Apr 1, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Set of Jupyter notebooks demonstrating Learning to Rank integrated with Solr and Elasticsearch☆17Jun 19, 2022Updated 4 years ago
- ☆23Feb 5, 2024Updated 2 years ago
- Apache Hadoop - Docker distribution based on CentOS 7 and Oracle Java 8☆13Feb 20, 2018Updated 8 years ago
- Case Study's from Danny Ma's Serious SQL Course☆19Aug 4, 2022Updated 4 years ago
- ☆23Oct 21, 2024Updated last year
- ☆16Feb 17, 2020Updated 6 years ago
- ☆16May 29, 2023Updated 3 years ago