A hybrid Big Data pipeline architecture that combines a real-time streaming layer with a batch layer to process large datasets(Lambda Architecture)
☆191Mar 17, 2026Updated 6 months ago
Alternatives and similar repositories for big-data-pipeline-lambda-arch
Users that are interested in big-data-pipeline-lambda-arch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆10May 1, 2023Updated 3 years ago
- Developing a Lambda Architecture pipeline using Apache Kafka, Spark Structured Streaming, Redshift, S3, Python☆22Mar 8, 2020Updated 6 years ago
- Kafka in a Container☆14Dec 30, 2021Updated 4 years ago
- Goal: create a Spring Boot application that handles users using Event Sourcing. So, whenever a user is created, updated, or deleted, an e…☆26Jul 25, 2026Updated 2 months ago
- InfluxDB 2 Connector for Kafka☆13Mar 6, 2020Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Pipelines Example Applications☆13Nov 5, 2019Updated 6 years ago
- ☆24Aug 8, 2021Updated 5 years ago
- Built a stream processing data pipeline to get data from disparate systems into a dashboard using Kafka as an intermediary.☆29Aug 14, 2023Updated 3 years ago
- This repository is a working ETL framework which utilizes user data from Spotify API using ➲Python for Extraction and Transformation ➲SQL…☆13Apr 16, 2023Updated 3 years ago
- Docker example with kafka connect and sink☆12Feb 12, 2018Updated 8 years ago
- ☆13Jul 16, 2018Updated 8 years ago
- Simple wrapper around the Keycloak Admin API☆11Jun 24, 2022Updated 4 years ago
- Setting up macOS the fast-way. Docs available at https://i3p9.github.io/mac-setup/☆12Oct 15, 2023Updated 2 years ago
- Supervisor trees for Go☆10Nov 4, 2017Updated 8 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Quickly set up a POC environment for Kafka+Spark☆14Oct 10, 2017Updated 9 years ago
- 🖼️ Full Stack Cloud SSR with Next.js, Tailwind, and AWS workshop by Nader Dabit with inclusion of deploy on AWS through a…☆20Mar 5, 2023Updated 3 years ago
- A minimal, browseable, read-only, memory-based filesystem in Go.☆12Jul 10, 2019Updated 7 years ago
- In this project I have built etl pipline which scraps the trending repository based on month,week and day LIVE extract other related info…☆12Sep 9, 2023Updated 3 years ago
- Example repo to create end to end tests for data pipeline.☆25Jun 14, 2024Updated 2 years ago
- ☆19Apr 17, 2025Updated last year
- Distributed Programming Assignments in Golang☆12Sep 13, 2016Updated 10 years ago
- Activator showing integration of AspectJ to monitor the ActorSystem☆14May 31, 2017Updated 9 years ago
- Streamdata.io Stock Market Data Streaming To AWS S3 Data Lake Using Lambda Serverless☆11Jul 14, 2018Updated 8 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆13Mar 16, 2023Updated 3 years ago
- Simple Doodle Classifier written in python☆13May 19, 2018Updated 8 years ago
- solr-logstash☆43Mar 29, 2016Updated 10 years ago
- A Slack ChatOps bot☆13Apr 9, 2025Updated last year
- Architecture Katas☆13Dec 2, 2020Updated 5 years ago
- Batch-clip multiple web pages from a text file.☆21Jul 22, 2019Updated 7 years ago
- A barebones go client for interacting with Confluent's KSQL Server☆13Feb 3, 2020Updated 6 years ago
- ☆11Jul 21, 2023Updated 3 years ago
- Modern React testing: Jest and Enzyme☆11Jan 9, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Using Istio Across Private and Public Clusters☆14Apr 20, 2019Updated 7 years ago
- Terraform Installer for CEPH on Oracle Cloud Infrastructure☆11Aug 10, 2018Updated 8 years ago
- wasmCloud project templates - use with 'wash new'☆13Dec 27, 2023Updated 2 years ago
- Dockerfiles maintained by Trivadis Platform Factory☆12Mar 13, 2020Updated 6 years ago
- Dokumentation für die Europace Plattform Autorisierung☆12Nov 27, 2025Updated 10 months ago
- Event listener provider for Keycloak that writes to Kafka☆12Jun 11, 2019Updated 7 years ago
- a plugin based grpc framework☆16May 3, 2019Updated 7 years ago