Alternatives and similar repositories for kafka-spark-project:

Users that are interested in kafka-spark-project are comparing it to the libraries listed below

• apssouza22 / big-data-pipeline-lambda-arch
  A full big data pipeline (Lambda Architecture) with Spark, Kafka, HDFS and Cassandra.
  ☆176Updated last year
• Wittline / uber-expenses-tracking
  The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such …
  ☆120Updated 2 years ago
• nburkett / ShowPulse_Ticketmaster
  A data pipeline with Kafka, Spark Streaming, dbt, Docker, Airflow, and GCP!
  ☆11Updated last year
• rodrigo-arenas / kafkaml-anomaly-detection
  Project for real-time anomaly detection using Kafka and python
  ☆58Updated 2 years ago
• convoy-js / nest-convoy
  [WIP] An opinionated framework for building distributed domain driven systems using microservices architecture
  ☆22Updated 3 years ago
• dbusteed / kafka-spark-streaming-example
  ☆37Updated 5 years ago
• alonsomedo / os-data-stack
  Building a Data Pipeline with an Open Source Stack
  ☆50Updated 9 months ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆99Updated 9 months ago
• ankurchavda / Python-Interview-Questions
  ☆15Updated 2 years ago
• airscholar / e2e-data-engineering
  An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Ka…
  ☆238Updated last month
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆142Updated 4 years ago
• irahardianto / multitenant-microservices-demo
  Full Isolation in Multi-Tenant SaaS with Kubernetes + Istio
  ☆67Updated 5 years ago
• airscholar / FlinkCommerce
  This repository contains an Apache Flink application for real-time sales analytics built using Docker Compose to orchestrate the necessar…
  ☆43Updated last year
• pyjaime / docker-airflow-spark
  Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks
  ☆23Updated 3 years ago
• haiphucnguyen / BigDataDemo
  The demo of using Kafka, Spark, Hive, Cassandra, etc by using Docker. It produces the production ready environment for any kinds of big d…
  ☆32Updated 5 years ago
• wowhy / ts-microservice-demo
  Demo for microservices / nestjs + kafka + agenda
  ☆39Updated 2 years ago
• guidok91 / spark-movies-etl
  Spark data pipeline that processes movie ratings data.
  ☆28Updated this week
• HamzaG737 / data-engineering-project
  End to end data engineering project with kafka, airflow, spark, postgres and docker.
  ☆86Updated last week
• airscholar / changecapture-e2e
  This project shows how to capture changes from postgres database and stream them into kafka
  ☆36Updated 10 months ago
• dogukannulu / csv_extract_airflow_docker
  Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.
  ☆35Updated last year
• yennanliu / DE-100-days
  data engineering 100 days 🤖 🧲 🦾 | #DE
  ☆40Updated last year
• hiejulia / Data-pipeline-project
  Data pipeline project
  ☆32Updated last month
• LearningJournal / Spark-Streaming-In-Python
  Apache Spark 3 - Structured Streaming Course Material
  ☆121Updated last year
• josephmachado / beginner_de_project
  Beginner data engineering project - batch edition
  ☆509Updated 2 months ago
• Itchimonji / healthchecks-with-nestjs-app
  Nx workspace dummy to show how to monitor a NestJS application
  ☆38Updated 3 years ago
• elleFlorio / kafka-streams-playground
  Simple application implementing Change Data Capture using Kafka Streams.
  ☆20Updated 5 years ago
• jnst / x-nestjs-grpc
  eXample Nest.js + gRPC
  ☆33Updated 2 years ago
• ysfesr / Building-Data-LakeHouse
  Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data
  ☆45Updated last year
• thanhtinhpas1 / ViSpeech
  A Node.js CQRS and Event Sourcing Microservice Example Using Nest.js, Event Store, and Swagger
  ☆34Updated 2 years ago
• datastax / kafka-examples
  Examples of using the DataStax Apache Kafka Connector.
  ☆46Updated last year