dorianbg / lambda-architecture-demo
Developing a Lambda Architecture pipeline using Apache Kafka, Spark Structured Streaming, Redshift, S3, Python
☆23Updated 4 years ago
Alternatives and similar repositories for lambda-architecture-demo:
Users that are interested in lambda-architecture-demo are comparing it to the libraries listed below
- Sentiment Analysis of a Twitter Topic with Spark Structured Streaming☆55Updated 6 years ago
- Airflow training for the crunch conf☆105Updated 6 years ago
- Data models, build data warehouses and data lakes, automate data pipelines, and worked with massive datasets.☆13Updated 5 years ago
- Making Machine Learning Simple and Scalable with Python, Jupyter Notebook, TensorFlow, Keras, Apache Kafka and KSQL☆95Updated 6 years ago
- code, labs and lectures for the course☆46Updated last year
- Repository used for Spark Trainings☆53Updated last year
- ☆32Updated 11 months ago
- ☆148Updated 6 years ago
- Workshop for Spark and Databricks☆54Updated 5 years ago
- A repository for a PySpark Cookbook by Tomasz Drabas and Denny Lee☆60Updated 6 years ago
- 🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python☆84Updated 5 years ago
- Guide on creating an API for serving your ML model☆65Updated 2 years ago
- PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.☆46Updated last year
- Spark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.☆20Updated 6 years ago
- Repo that relates to the Medium blog 'Keeping your ML model in shape with Kafka, Airflow' and MLFlow'☆119Updated last year
- Code to build a simple analytics data pipeline with Python☆102Updated 7 years ago
- Udacity Data Engineering Nanodegree Projects☆11Updated 5 years ago
- Capturing model drift and handling its response - Example webinar☆107Updated 5 years ago
- Using Kafka-Python to illustrate a ML production pipeline☆110Updated 2 years ago
- Twitter Sentiment Analysis using Spark and Kafka☆114Updated 5 years ago
- [Video]AWS Certified Machine Learning-Specialty (ML-S) Guide☆121Updated last month
- Udacity Data Pipeline Exercises☆15Updated 4 years ago
- Just a boilerplate for PySpark and Flask☆35Updated 6 years ago
- Business Data Analysis by HiPIC of CalStateLA☆20Updated 6 years ago
- AWS Big Data Certification☆25Updated last month
- Guide for applying Unit Testing in data-driven projects☆19Updated 4 years ago
- Ingest tweets with Kafka. Use Spark to track popular hashtags and trendsetters for each hashtag☆29Updated 8 years ago
- Machine Learning model training & scalable deployment with Flask, Nginx & Gunicorn wrapped in a Docker Container☆21Updated 2 years ago
- Amazon Redshift Cookbook, Published by Packt☆15Updated 2 years ago
- ☆18Updated 3 years ago