dorianbg / lambda-architecture-demo
Developing a Lambda Architecture pipeline using Apache Kafka, Spark Structured Streaming, Redshift, S3, Python
☆24Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for lambda-architecture-demo
- Workshop for Spark and Databricks☆54Updated 4 years ago
- A code-based tutorial for production level data streaming with PySpark plus Optimus for data cleaning, Confluent Kafka, & Apache Drill u…☆26Updated 5 years ago
- This is part of the Artificial Intelligence live course, hosted by Packtpub. In this repository, you can find information to build your e…☆16Updated 5 years ago
- AWS Big Data Certification☆25Updated last year
- MLFlow Spark Summit 2019 Presentation☆67Updated 5 years ago
- code, labs and lectures for the course☆45Updated last year
- ☆8Updated 5 years ago
- Repository used for Spark Trainings☆53Updated last year
- Deep Learning with Apache Spark and Deep Cognition☆58Updated 6 years ago
- ☆32Updated 8 months ago
- Sentiment Analysis of a Twitter Topic with Spark Structured Streaming☆55Updated 5 years ago
- Code to build a simple analytics data pipeline with Python☆102Updated 7 years ago
- Guide on creating an API for serving your ML model☆65Updated 2 years ago
- Just a boilerplate for PySpark and Flask☆35Updated 6 years ago
- Simple alert system implemented in Kafka and Python☆94Updated 6 years ago
- 🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python☆83Updated 5 years ago
- Code for my presentation: Using PySpark to Process Boat Loads of Data☆20Updated 7 years ago
- Python Machine Learning (ML) project that demonstrates the archetypal ML workflow within a Jupyter notebook, with automated model deploym…☆60Updated last year
- Code supporting Data Science articles at The Marketing Technologist, Floryn Tech Blog, and Pythom.nl☆70Updated last year
- Capturing model drift and handling its response - Example webinar☆106Updated 5 years ago
- Airflow training for the crunch conf☆105Updated 6 years ago
- Machine Learning and Data Analysis Case Studies using Spark.☆72Updated 3 years ago
- PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.☆46Updated last year
- Use Kafka and Apache Spark streaming to perform click stream analytics☆76Updated 4 years ago
- How to build an awesome data engineering team☆99Updated 5 years ago
- Partly lecture and partly a hands-on tutorial and workshop, this is a three part series on how to get started with MLflow. In this four p…☆38Updated 3 years ago
- ☆37Updated 8 years ago
- A simple Spark TDD example☆26Updated 7 years ago
- ☆39Updated 7 years ago