apssouza22 / big-data-pipeline-lambda-archLinks
A hybrid Big Data pipeline architecture that combines a real-time streaming layer with a batch layer to process large datasets(Lambda Architecture)
☆188Updated 4 months ago
Alternatives and similar repositories for big-data-pipeline-lambda-arch
Users that are interested in big-data-pipeline-lambda-arch are comparing it to the libraries listed below
Sorting:
- Supporting repository for the blog post at https://medium.com/@stephane.maarek/how-to-use-apache-kafka-to-transform-a-batch-pipeline-into…☆247Updated 2 years ago
- This is the central repository for all materials related to Kafka Streams : Real-time Stream Processing! Book by Prashant Pandey.☆172Updated 5 years ago
- A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python,…☆209Updated 6 years ago
- Apache Spark Course Material☆96Updated 2 years ago
- Spark Examples☆126Updated 3 years ago
- Kafka Streams Example - Some aggregates on fake stock data☆212Updated 2 years ago
- Educational notes,Hands on problems w/ solutions for hadoop ecosystem☆87Updated 7 years ago
- Learn the Confluent Schema Registry & REST Proxy☆196Updated last year
- How to build an awesome data engineering team☆101Updated 6 years ago
- Example Code for Kafka Tutorials @ Learning Journal☆178Updated 8 years ago
- ☆44Updated 5 years ago
- ☆65Updated last year
- One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)☆120Updated 4 years ago
- This repository contains code for Spark Streaming☆26Updated 4 years ago
- Building Big Data Pipelines with Apache Beam, published by Packt☆89Updated 2 years ago
- This project contains examples which demonstrate how to deploy analytic models to mission-critical, scalable production environments leve…☆906Updated 2 years ago
- Databricks - Apache Spark™ - 2X Certified Developer☆265Updated 5 years ago
- Apache Spark 3 - Structured Streaming Course Material☆46Updated 5 years ago
- Maven quick start for building Kafka Connect connectors.☆147Updated 4 years ago
- Kafka Connect connector to stream data in real time from Twitter.☆127Updated 3 years ago
- ☆248Updated 6 years ago
- Data Stream Development with Apache Spark, Kafka and Spring Boot by Packt Publishing☆60Updated 2 years ago
- Simple demo implementation of Lambda and Kappa architectures using Python, Docker, Kafka, Spark and Cassandra☆40Updated 7 years ago
- Real-Time Data Processing Pipeline & Visualization with Docker, Spark, Kafka and Cassandra☆85Updated 8 years ago
- Source code for James Lee's Aparch Spark with Java course☆122Updated 4 years ago
- Different ways to process data into Cassandra in realtime with technologies such as Kafka, Spark, Akka, Flink☆31Updated 3 years ago
- Fully reproducible, Dockerized, step-by-step, demo on how to stream tables from Postgres to Kafka/KSQL back to Postgres. Detailed blog p…☆152Updated 4 years ago
- Complete high-quality practice tests of 50 questions each will help you master your Confluent Certified Developer for Apache Kafka (CCDAK…☆92Updated 2 years ago
- Apache Spark 3 - Structured Streaming Course Material☆126Updated 2 years ago
- Apche Spark Structured Streaming with Kafka using Python(PySpark)☆40Updated 6 years ago