A hybrid Big Data pipeline architecture that combines a real-time streaming layer with a batch layer to process large datasets(Lambda Architecture)
☆191Mar 17, 2026Updated 6 months ago
Alternatives and similar repositories for big-data-pipeline-lambda-arch
Users that are interested in big-data-pipeline-lambda-arch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆14May 3, 2022Updated 4 years ago
- Goal: create a Spring Boot application that handles users using Event Sourcing. So, whenever a user is created, updated, or deleted, an e…☆26Jul 25, 2026Updated last month
- ☆12Sep 6, 2018Updated 8 years ago
- Built a stream processing data pipeline to get data from disparate systems into a dashboard using Kafka as an intermediary.☆29Aug 14, 2023Updated 3 years ago
- ☆13Sep 11, 2020Updated 6 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆13Jul 16, 2018Updated 8 years ago
- ☆16Mar 15, 2024Updated 2 years ago
- This application receives messages from a mqtt broker and sends the messages to a kafka cluster. Topic mapping is configurable.☆30Dec 25, 2025Updated 8 months ago
- Setting up macOS the fast-way. Docs available at https://i3p9.github.io/mac-setup/☆12Oct 15, 2023Updated 2 years ago
- NoSQL extract, transform, load (ETL) toolkit with Python☆16Updated this week
- Quickly set up a POC environment for Kafka+Spark☆14Oct 10, 2017Updated 8 years ago
- 🖼️ Full Stack Cloud SSR with Next.js, Tailwind, and AWS workshop by Nader Dabit with inclusion of deploy on AWS through a…☆20Mar 5, 2023Updated 3 years ago
- ☆12Jun 9, 2021Updated 5 years ago
- A minimal, browseable, read-only, memory-based filesystem in Go.☆12Jul 10, 2019Updated 7 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- This repository contains an Apache Flink application for real-time sales analytics built using Docker Compose to orchestrate the necessar…☆52Dec 4, 2023Updated 2 years ago
- ☆18May 31, 2023Updated 3 years ago
- A mod for Parkitect. Ride your favorite coasters and attractions with this cam!☆13Sep 8, 2017Updated 9 years ago
- A Realtime Analytics Engine using Kafka, Spark & MongoDB☆15Feb 28, 2017Updated 9 years ago
- Docker Big Data Tools: This docker-compose file is configured to run multiple nodes. This is a Hadoop Cluster that contains the necessary…☆31Jul 6, 2021Updated 5 years ago
- domain driven design in Go☆14Aug 18, 2020Updated 6 years ago
- 🌟 An end-to-end full-stack data science project, including modelling, MLOps, and data storytelling. ✨☆16Aug 30, 2025Updated last year
- Example repo to create end to end tests for data pipeline.☆25Jun 14, 2024Updated 2 years ago
- ☆16Sep 13, 2016Updated 10 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Activator showing integration of AspectJ to monitor the ActorSystem☆14May 31, 2017Updated 9 years ago
- My Insight Data Engineering Fellowship project. I implemented a big data processing pipeline based on lambda architecture, that aggrega…☆507Aug 24, 2022Updated 4 years ago
- This is an example project that shows one way to build a RESTful Java web app around Titan, Cassandra, and Elasticsearch.☆35Feb 3, 2016Updated 10 years ago
- Multi-tenant Application with Laravel and Postgres☆15Aug 9, 2019Updated 7 years ago
- Recommendation engine in Java. Based on an ALS algorithm (Apache Spark). Train a new model after N seconds.☆16Apr 21, 2023Updated 3 years ago
- Architecture Katas☆13Dec 2, 2020Updated 5 years ago
- Batch-clip multiple web pages from a text file.☆21Jul 22, 2019Updated 7 years ago
- Dot notation object for Python☆11Apr 13, 2026Updated 5 months ago
- scikit-learn: machine learning in Python☆14Jun 11, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Terraform Installer for CEPH on Oracle Cloud Infrastructure☆11Aug 10, 2018Updated 8 years ago
- StarCraft 2 Data Pipeline with Airflow, DuckDB and Streamlit☆17Mar 14, 2024Updated 2 years ago
- Dokumentation für die Europace Plattform Autorisierung☆12Nov 27, 2025Updated 9 months ago
- Go & React Template☆12Oct 13, 2023Updated 2 years ago
- A Data Engineering Project that implements an ETL data pipeline using Dagster, Apache Spark, Streamlit, MinIO, Metabase, Dbt, Polars, Doc…☆25Nov 19, 2024Updated last year
- Course code for Machine Learning with Scala Packt Publishing Course☆15Apr 13, 2016Updated 10 years ago
- Showcase real time analytics using Storm, Node.js, Redis, Socket.io and twitter streaming api☆32Dec 16, 2012Updated 13 years ago