apssouza22 / big-data-pipeline-lambda-arch
A full big data pipeline (Lambda Architecture) with Spark, Kafka, HDFS and Cassandra.
☆172Updated last year
Related projects ⓘ
Alternatives and complementary repositories for big-data-pipeline-lambda-arch
- This is the central repository for all materials related to Kafka Streams : Real-time Stream Processing! Book by Prashant Pandey.☆162Updated 4 years ago
- How to build an awesome data engineering team☆99Updated 5 years ago
- Supporting repository for the blog post at https://medium.com/@stephane.maarek/how-to-use-apache-kafka-to-transform-a-batch-pipeline-into…☆241Updated 11 months ago
- Maven quick start for building Kafka Connect connectors.☆145Updated 3 years ago
- Apache Spark 3 - Structured Streaming Course Material☆119Updated last year
- Materials (slides and code) for Kafka and Kafka Streams Workshops☆61Updated 5 months ago
- Real-world Spark pipelines examples☆83Updated 6 years ago
- Simple demo implementation of Lambda and Kappa architectures using Python, Docker, Kafka, Spark and Cassandra☆38Updated 6 years ago
- Learn the Confluent Schema Registry & REST Proxy☆187Updated 8 months ago
- ☆74Updated 4 years ago
- Example Code for Kafka Tutorials @ Learning Journal☆176Updated 6 years ago
- Apache Spark 3 - Structured Streaming Course Material☆43Updated 4 years ago
- This repository contains code for Spark Streaming☆21Updated 3 years ago
- Simple stream processing pipeline☆92Updated 5 months ago
- Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines☆123Updated 2 years ago
- Spark Structured Streaming / Kafka / Cassandra / Elastic☆184Updated last year
- Apache Spark examples exclusively in Java☆98Updated last year
- Spark Examples☆124Updated 2 years ago
- An example Apache Beam project.☆111Updated 7 years ago
- Apache Spark Course Material☆85Updated last year
- Learn Kafka Streams with several examples!☆759Updated 2 years ago
- Developing a Lambda Architecture pipeline using Apache Kafka, Spark Structured Streaming, Redshift, S3, Python☆24Updated 4 years ago
- 📚 Tech blogs & talks by companies that run Apache Flink in production☆156Updated last week
- One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)☆119Updated 3 years ago
- Kafka Connect connector to stream data in real time from Twitter.☆126Updated last year
- Hadoop tutorial Files. For detailed Tutorials visit www.youtube.com/learningjournalin☆26Updated 6 years ago
- Get a stream of issues and pull requests for your chosen GitHub repository☆449Updated last year
- Use Kafka and Apache Spark streaming to perform click stream analytics☆76Updated 4 years ago
- ☆36Updated 4 years ago
- Building Big Data Pipelines with Apache Beam, published by Packt☆83Updated last year