apssouza22 / big-data-pipeline-lambda-archLinks
A full big data pipeline (Lambda Architecture) with Spark, Kafka, HDFS and Cassandra.
☆179Updated 3 weeks ago
Alternatives and similar repositories for big-data-pipeline-lambda-arch
Users that are interested in big-data-pipeline-lambda-arch are comparing it to the libraries listed below
Sorting:
- Databricks - Apache Spark™ - 2X Certified Developer☆266Updated 4 years ago
- Apache Spark 3 - Structured Streaming Course Material☆45Updated 4 years ago
- Supporting repository for the blog post at https://medium.com/@stephane.maarek/how-to-use-apache-kafka-to-transform-a-batch-pipeline-into…☆244Updated last year
- Apache Spark 3 - Structured Streaming Course Material☆121Updated last year
- How to build an awesome data engineering team☆100Updated 5 years ago
- One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)☆120Updated 3 years ago
- Complete high-quality practice tests of 50 questions each will help you master your Confluent Certified Developer for Apache Kafka (CCDAK…☆89Updated last year
- Simple stream processing pipeline☆102Updated last year
- Real-world Spark pipelines examples☆83Updated 7 years ago
- ☆58Updated 10 months ago
- Kafka Streams Example - Some aggregates on fake stock data☆209Updated last year
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆44Updated 2 years ago
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆46Updated last year
- Spark and Hive docker containers sharing a common MySQL metastore☆26Updated 5 years ago
- This is the central repository for all materials related to Kafka Streams : Real-time Stream Processing! Book by Prashant Pandey.☆166Updated 4 years ago
- Apache Spark examples exclusively in Java☆101Updated 2 years ago
- Spark Examples☆125Updated 3 years ago
- Real-Time Data Processing Pipeline & Visualization with Docker, Spark, Kafka and Cassandra☆85Updated 8 years ago
- Docker with Airflow and Spark standalone cluster☆259Updated last year
- Maven quick start for building Kafka Connect connectors.☆146Updated 4 years ago
- Learn the Confluent Schema Registry & REST Proxy☆191Updated last year
- ☆310Updated 6 years ago
- Apche Spark Structured Streaming with Kafka using Python(PySpark)☆40Updated 6 years ago
- The demo of using Kafka, Spark, Hive, Cassandra, etc by using Docker. It produces the production ready environment for any kinds of big d…☆34Updated 5 years ago
- Educational notes,Hands on problems w/ solutions for hadoop ecosystem☆87Updated 6 years ago
- ☆150Updated 7 years ago
- Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no addition…☆414Updated 4 years ago
- Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines☆133Updated 2 years ago
- Materials (slides and code) for Kafka and Kafka Streams Workshops☆62Updated last year
- Repository used for Spark Trainings☆53Updated 2 years ago