Generate synthetic Spotify music stream dataset to create dashboards. Spotify API generates fake event data emitted to Kafka. Spark consumes and processes Kafka data, saving it to the Datalake. Airflow orchestrates the pipeline. dbt moves data to Snowflake, transforms it, and creates dashboards.
☆72Dec 17, 2023Updated 2 years ago
Alternatives and similar repositories for spotify-stream-analytics
Users that are interested in spotify-stream-analytics are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16Dec 22, 2024Updated last year
- ☆12May 27, 2024Updated 2 years ago
- velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…☆20Aug 12, 2025Updated last year
- Simple project using pyflink, kafka and postgre containerized using Docker☆12Aug 26, 2024Updated 2 years ago
- ⚙️ Airflow data pipeline with Terraform, GCP BigQuery, dbt, Soda and Looker Studio.☆26Oct 19, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This repository contains the capstone project carried out as part of Machine Learning Zoomcamp course☆10Dec 26, 2022Updated 3 years ago
- This repository contains notebooks, homework, projects and notes done during Machine Learning Zoomcamp course.☆13Nov 13, 2024Updated last year
- A custom end-to-end analytics platform for customer churn☆10May 15, 2025Updated last year
- This Power BI project provides insights into customer orders and product tracking using interactive dashboards. It visualizes order statu…☆10Aug 15, 2025Updated last year
- Autonomous UAV-Based Maritime SAR using onboard YOLOv8/v11 for real-time swimmer detection and precision life buoy deployment. Combines G…☆16Aug 7, 2026Updated 2 months ago
- Local development environment for python data projects, with Docker☆22Dec 14, 2022Updated 3 years ago
- This project is for demonstrating knowledge of Data Engineering tools and concepts and also learning in the process☆43Dec 1, 2022Updated 3 years ago
- Conversion of audio files to text using whisper from OpenAI with a simple tkinter GUI☆10Apr 13, 2023Updated 3 years ago
- ☆14Jan 12, 2017Updated 9 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆10Nov 17, 2021Updated 4 years ago
- Implementation of a Q&A Chatbot with RAG using the Data Engineering Community WhatsApp group messages.☆10Jan 17, 2025Updated last year
- Examples of Apache Flink® v2.1 applications showcasing the DataStream API, Table API in Java and Python, and Flink SQL, featuring AWS, Gi…☆10Jan 13, 2026Updated 9 months ago
- Customize the MLflow Review App. Change the UI for your subject matter experts, and deploy on Databricks Apps!☆11Nov 3, 2025Updated 11 months ago
- pyflink Table API and FLink SQL on Kafka☆12Dec 16, 2024Updated last year
- This repo consists of all important concepts for data engineers.☆11Jun 2, 2026Updated 4 months ago
- A simple and easy to use Data Quality (DQ) tool built with Python.☆51Sep 7, 2023Updated 3 years ago
- ☆17Apr 19, 2024Updated 2 years ago
- Ease With Data☆11Mar 19, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This project provides a practical example of building production-ready data pipelines and working with real-world streaming data sources,…☆12Apr 5, 2026Updated 6 months ago
- The goal of this project is to build an ETL pipeline. The data would be processed as a batch (monthly) between 2018-01 and 2021-02.☆14Mar 26, 2022Updated 4 years ago
- Data Science Intern at Data Glacier☆12Jun 30, 2022Updated 4 years ago
- ☆13Mar 20, 2025Updated last year
- This project is built for personal purposes. Currently, I am enahancing it with an interactive bot that can recommend and help you improv…☆26Jul 27, 2026Updated 3 months ago
- Candace's Data Engineering Zoomcamp files and notes☆18Jul 4, 2023Updated 3 years ago
- ☆14Mar 1, 2026Updated 8 months ago
- This repo is for the Linkedin Learning course: Apache PySpark by Example☆17Jul 11, 2023Updated 3 years ago
- Hallucination-Aware Multimodal Benchmark for Gastrointestinal Image Analysis with Large Vision Language Models☆26Oct 12, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Code test for data engineering candidates☆48Mar 27, 2024Updated 2 years ago
- Spark application to consume kafka events generated by a python producer.☆12Aug 7, 2021Updated 5 years ago
- Analysis of New York State Police Department Arrests dataset. Created Dimensional Model for the provided dataset. Using Alteryx and Talen…☆19Sep 19, 2022Updated 4 years ago
- DevOps☆16May 17, 2021Updated 5 years ago
- An R-based command line tool designed to prepare climate inputs for WEPP, which has been extended to perform other general functions such…☆14Jan 7, 2026Updated 9 months ago
- In this article, you will learn how to set up a real-time data processing and analytics environment using Docker, MySQL, Redpanda, MinIO,…☆11Jun 27, 2023Updated 3 years ago
- AI Assistant you can video call☆23Mar 23, 2026Updated 7 months ago