apssouza22 / big-data-pipeline-lambda-archLinks
A full big data pipeline (Lambda Architecture) with Spark, Kafka, HDFS and Cassandra.
☆180Updated 2 months ago
Alternatives and similar repositories for big-data-pipeline-lambda-arch
Users that are interested in big-data-pipeline-lambda-arch are comparing it to the libraries listed below
Sorting:
- This is the central repository for all materials related to Kafka Streams : Real-time Stream Processing! Book by Prashant Pandey.☆166Updated 5 years ago
- Apache Spark 3 - Structured Streaming Course Material☆46Updated 4 years ago
- Supporting repository for the blog post at https://medium.com/@stephane.maarek/how-to-use-apache-kafka-to-transform-a-batch-pipeline-into…☆245Updated last year
- A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python,…☆209Updated 6 years ago
- Apache Spark Course Material☆94Updated 2 years ago
- Spark Examples☆125Updated 3 years ago
- How to build an awesome data engineering team☆100Updated 5 years ago
- Databricks - Apache Spark™ - 2X Certified Developer☆265Updated 5 years ago
- ☆59Updated last year
- Educational notes,Hands on problems w/ solutions for hadoop ecosystem☆87Updated 6 years ago
- Learn the Confluent Schema Registry & REST Proxy☆193Updated last year
- Apache Spark 3 - Structured Streaming Course Material☆122Updated 2 years ago
- ( These solutions tested on 4 node Hortonwork cluster on my laptop. Do not test on your production environment until you test... :)☆21Updated 5 years ago
- Fully reproducible, Dockerized, step-by-step, demo on how to stream tables from Postgres to Kafka/KSQL back to Postgres. Detailed blog p…☆152Updated 3 years ago
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆44Updated 2 years ago
- O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian☆221Updated 2 years ago
- If you are planning or preparing for Apache Kafka Certification then this is the right place for you.There are many Apache Kafka Certific…☆38Updated 5 years ago
- Example Code for Kafka Tutorials @ Learning Journal☆177Updated 7 years ago
- Complete high-quality practice tests of 50 questions each will help you master your Confluent Certified Developer for Apache Kafka (CCDAK…☆89Updated 2 years ago
- Maven quick start for building Kafka Connect connectors.☆148Updated 4 years ago
- Materials (slides and code) for Kafka and Kafka Streams Workshops☆62Updated last year
- Spark on Kubernetes using Helm☆34Updated 5 years ago
- Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…☆90Updated 3 years ago
- Source code for James Lee's Aparch Spark with Java course☆121Updated 4 years ago
- 📚 Tech blogs & talks by companies that run Apache Flink in production☆173Updated 2 months ago
- Apache Spark examples exclusively in Java☆102Updated 2 years ago
- This project contains examples which demonstrate how to deploy analytic models to mission-critical, scalable production environments leve…☆868Updated last year
- Simple stream processing pipeline☆103Updated last year
- Apche Spark Structured Streaming with Kafka using Python(PySpark)☆40Updated 6 years ago
- One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)☆121Updated 4 years ago