daddydrac / PySpark-Confluent-Kafka-Apache-Drill-
A code-based tutorial for production level data streaming with PySpark plus Optimus for data cleaning, Confluent Kafka, & Apache Drill using Docker and Cassandra (NoSQL DB) for storage; This allows for for fast feature engineering and data cleaning.
☆26Updated 5 years ago
Alternatives and similar repositories for PySpark-Confluent-Kafka-Apache-Drill-:
Users that are interested in PySpark-Confluent-Kafka-Apache-Drill- are comparing it to the libraries listed below
- Pyspark in Google Colab: A simple machine learning (Linear Regression) model☆36Updated 5 years ago
- Deep Learning with Apache Spark and Deep Cognition☆59Updated 6 years ago
- Guide on creating an API for serving your ML model☆65Updated 2 years ago
- My presentation at ODSC India 2018 about Deep Learning with Apache Spark☆27Updated 6 years ago
- ☆18Updated 6 years ago
- code, labs and lectures for the course☆46Updated last year
- Workshop for Spark and Databricks☆54Updated 5 years ago
- My competitions approach☆18Updated 3 years ago
- Blog post on ETL pipelines with Airflow☆23Updated 4 years ago
- This repository hosts the code/projects/demos/slides for Big Data technologies under Apache Hadoop and Apache Spark umbrella.☆42Updated 2 years ago
- Repository used for Spark Trainings☆53Updated last year
- Data analysis using numpy, pandas, matplotlib, seaborn, sqlite3, data wrangling☆31Updated 5 years ago
- PySpark Code for Hands-on Learners☆116Updated 5 years ago
- Content for Applied ML Workshop @ DataHack Summit 2019☆25Updated 5 years ago
- Python Machine Learning (ML) project that demonstrates the archetypal ML workflow within a Jupyter notebook, with automated model deploym…☆62Updated 2 years ago
- Machine Learning and Data Analysis Case Studies using Spark.☆72Updated 4 years ago
- ☆26Updated 5 years ago
- Projects from Udacity Data Streaming Nanodegree☆15Updated last year
- Program assignments for the Deep Learning Specialization at Coursera by Andrew Ng☆51Updated 7 years ago
- Repository for medium article☆22Updated last year
- ☆16Updated 4 years ago
- Partly lecture and partly a hands-on tutorial and workshop, this is a three part series on how to get started with MLflow. In this four p…☆39Updated 4 years ago
- Code for my presentation: Using PySpark to Process Boat Loads of Data☆20Updated 7 years ago
- Frank Kane's Taming Big Data with Apache Spark and Python, published by Packt☆122Updated 2 years ago
- Follow the Lumiata Tech Blog on Medium!☆21Updated last year
- Large-scale Graph Mining with Spark☆40Updated 6 years ago
- An introductory IBM Developer Code Pattern on how to use PixieDust to visualize customer data☆14Updated 5 years ago
- Sentiment Analysis of a Twitter Topic with Spark Structured Streaming☆55Updated 6 years ago
- MLFlow Spark Summit 2019 Presentation☆67Updated 5 years ago
- How to use Python to understand data and transform the data into a tidy format ready to be used for modelling and visualisation.☆37Updated 5 years ago