ghaughian / mongo-kafka-spark
A Realtime Analytics Engine using Kafka, Spark & MongoDB
☆16Updated 7 years ago
Related projects ⓘ
Alternatives and complementary repositories for mongo-kafka-spark
- Docker container for Kafka - Spark Streaming - Cassandra☆97Updated 5 years ago
- Somes examples with spark streaming using python☆15Updated 7 years ago
- Sentiment Analysis of a Twitter Topic with Spark Structured Streaming☆55Updated 5 years ago
- Updated repository☆157Updated 2 years ago
- Simple learning project pushing CSV data into Kafka then indexing the data in ElasticSearch☆19Updated 9 years ago
- Used Spark core python, Spark sql, Spark MLlib, Spark Streaming☆46Updated 3 years ago
- Final Project for IoT: Big Data Processing and Analytics class. Analyzing U.S nationwide temperature from IoT sensors in real-time☆67Updated 7 years ago
- Example of using Airflow to schedule downloading data form S3 and launching spark jobs☆15Updated 8 years ago
- This is a simple streaming application that utilises Kafka and Python☆45Updated 5 years ago
- Code to build a simple analytics data pipeline with Python☆102Updated 7 years ago
- Use Airflow to move data from multiple MySQL databases to BigQuery☆99Updated 4 years ago
- Simple alert system implemented in Kafka and Python☆94Updated 6 years ago
- 🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python☆83Updated 5 years ago
- Ingest tweets with Kafka. Use Spark to track popular hashtags and trendsetters for each hashtag☆29Updated 8 years ago
- Real-time report dashboard with Apache Kafka, Apache Spark Streaming and Node.js☆49Updated last year
- PySpark Code for Hands-on Learners☆114Updated 5 years ago
- Twitter Sentiment Analysis using Spark and Kafka☆114Updated 5 years ago
- Just a boilerplate for PySpark and Flask☆35Updated 6 years ago
- Quickly set up a POC environment for Kafka+Spark☆16Updated 7 years ago
- ☆148Updated 6 years ago
- Docker compose files for various kafka stacks☆33Updated 6 years ago
- Use Kafka and Apache Spark streaming to perform click stream analytics☆76Updated 4 years ago
- Example to implement machine learning microservice with gRPC and Docker in Python☆81Updated 2 years ago
- Apache Spark (Scala, PySpark, SparkR) Code, Tricks, and References☆70Updated 5 years ago
- Apche Spark Structured Streaming with Kafka using Python(PySpark)☆41Updated 5 years ago
- Flask app to push/pull on Kafka over HTTP☆41Updated 9 years ago
- Real time stock data pipeline --play with Kafka, Cassandra, Spark, Redis, Node.js, Zookeeper☆81Updated 7 years ago
- Spark 2.0 Python Machine Learning examples☆97Updated 5 years ago
- Code examples on Apache Spark using python☆104Updated 2 years ago
- pyspark-cassandra is a Python port of the awesome @datastax Spark Cassandra connector. Compatible w/ Spark 2.0, 2.1, 2.2, 2.3 and 2.4☆69Updated 3 weeks ago