ahujaraman / live_log_analyzer_spark
Spark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.
☆20Updated 5 years ago
Related projects: ⓘ
- Counting Tweets Per User in Real-Time☆41Updated 7 years ago
- Sentiment Analysis of a Twitter Topic with Spark Structured Streaming☆54Updated 5 years ago
- This repository hosts the code/projects/demos/slides for Big Data technologies under Apache Hadoop and Apache Spark umbrella.☆42Updated 2 years ago
- Realtime social media data analytics with Apache Spark, Python, Kafka, Pandas, etc☆52Updated 8 years ago
- Contains source files used in the Spark with Python course☆18Updated 5 years ago
- Real-time fraud detection in venmo payments.☆27Updated 7 years ago
- Learn to build a data pipeline with Airflow to automate wrangling data - An Udacity Data Engineer Nano Degree Project☆8Updated 5 years ago
- All my projects on Big Data are provided☆27Updated 7 years ago
- 🛠️ My solutions to Datacamp Projects☆9Updated 5 years ago
- Course on Udemy by Jose Portilla☆96Updated 6 years ago
- ☆19Updated 6 years ago
- Ingest tweets with Kafka. Use Spark to track popular hashtags and trendsetters for each hashtag☆29Updated 8 years ago
- My solutions for the Udacity Data Engineering Nanodegree☆33Updated 4 years ago
- Educational notes,Hands on problems w/ solutions for hadoop ecosystem☆86Updated 5 years ago
- Repository used for Spark Trainings☆53Updated last year
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆53Updated last year
- Various data stream/batch process demo with Apache Scala Spark 🚀☆11Updated 4 years ago
- My presentation at ODSC India 2018 about Deep Learning with Apache Spark☆27Updated 6 years ago
- ☆37Updated 7 years ago
- Projects submitted as part of working through udacity's data engineering nanodegree.☆9Updated 4 years ago
- Code to build a simple analytics data pipeline with Python☆102Updated 7 years ago
- The demo of using Kafka, Spark, Hive, Cassandra, etc by using Docker. It produces the production ready environment for any kinds of big d…☆30Updated 4 years ago
- Here's how to get DataQuest's Data Engineering Track missions' content to work on your localhost. Using data from my Valenbisi ARIMA mode…☆16Updated 6 years ago
- Twitter Sentiment Analysis using Spark and Kafka☆113Updated 5 years ago
- Udacity Data Engineering Nanodegree Projects☆11Updated 5 years ago
- Apache Spark Interview Question and Answers☆20Updated 3 years ago
- Processing tweets using Spark Streaming and identifying top trending hashtags using a real-time simple dashboard☆42Updated 2 years ago
- Just a boilerplate for PySpark and Flask☆35Updated 6 years ago
- Apache Spark using SQL☆14Updated 3 years ago
- code, labs and lectures for the course☆44Updated last year