apssouza22 / big-data-pipeline-lambda-arch
A full big data pipeline (Lambda Architecture) with Spark, Kafka, HDFS and Cassandra.
☆176Updated last year
Alternatives and similar repositories for big-data-pipeline-lambda-arch:
Users that are interested in big-data-pipeline-lambda-arch are comparing it to the libraries listed below
- How to build an awesome data engineering team☆100Updated 5 years ago
- This is the central repository for all materials related to Kafka Streams : Real-time Stream Processing! Book by Prashant Pandey.☆164Updated 4 years ago
- Educational notes,Hands on problems w/ solutions for hadoop ecosystem☆87Updated 6 years ago
- Supporting repository for the blog post at https://medium.com/@stephane.maarek/how-to-use-apache-kafka-to-transform-a-batch-pipeline-into…☆242Updated last year
- Spark Examples☆125Updated 3 years ago
- ( These solutions tested on 4 node Hortonwork cluster on my laptop. Do not test on your production environment until you test... :)☆21Updated 4 years ago
- Use Kafka and Apache Spark streaming to perform click stream analytics☆76Updated 5 years ago
- Apache Spark 3 - Structured Streaming Course Material☆121Updated last year
- Example Code for Kafka Tutorials @ Learning Journal☆177Updated 7 years ago
- Simple demo implementation of Lambda and Kappa architectures using Python, Docker, Kafka, Spark and Cassandra☆39Updated 7 years ago
- Repository used for Spark Trainings☆53Updated last year
- Kafka Connect connector to stream data in real time from Twitter.☆126Updated 2 years ago
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆43Updated 2 years ago
- Apache Spark 3 - Structured Streaming Course Material☆45Updated 4 years ago
- ☆246Updated 5 years ago
- ☆75Updated 4 years ago
- Hadoop tutorial Files. For detailed Tutorials visit www.youtube.com/learningjournalin☆26Updated 7 years ago
- Building Big Data Pipelines with Apache Beam, published by Packt☆86Updated 2 years ago
- Maven quick start for building Kafka Connect connectors.☆145Updated 4 years ago
- Real-world Spark pipelines examples☆83Updated 7 years ago
- Apche Spark Structured Streaming with Kafka using Python(PySpark)☆41Updated 5 years ago
- Spark on Kubernetes using Helm☆34Updated 4 years ago
- Apache Spark Course Material☆88Updated last year
- Interactive Notebooks that support the book☆40Updated 4 years ago
- ☆148Updated 6 years ago
- ☆53Updated 7 months ago
- Code and Notebooks for Spark Tutorials for Learning Journal @ Youtube☆56Updated 4 years ago
- This repository contains code for Spark Streaming☆21Updated 4 years ago
- Databricks - Apache Spark™ - 2X Certified Developer☆266Updated 4 years ago
- Simple repo to demonstrate how to submit a spark job to EMR from Airflow☆33Updated 4 years ago