π‘ Real-time data pipeline with Kafka, Flink, Iceberg, Trino, MinIO, and Superset. Ideal for learning data systems.
β66Jan 18, 2025Updated last year
Alternatives and similar repositories for real-time-data-pipeline
Users that are interested in real-time-data-pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Local Environment to Practice Data Engineeringβ144Dec 30, 2024Updated last year
- Building Data Lakehouse by open source technology. Support end to end data pipeline, from source data on AWS S3 to Lakehouse, visualize aβ¦β40Dec 15, 2025Updated 4 months ago
- Run an open-source data LakeHouse locally using Docker Composeβ12May 31, 2024Updated last year
- β14Dec 28, 2023Updated 2 years ago
- Files for the Docker and Kubernetes on Google Cloud Hands-On labsβ11Mar 14, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Bonus Credits β’ AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- β22Jul 18, 2024Updated last year
- β11Nov 26, 2024Updated last year
- Azure DP 900 notesβ10Jan 23, 2022Updated 4 years ago
- β12Mar 6, 2021Updated 5 years ago
- Feature demos, integration guides & hands-on labs/projects using Kpow, Flex, Kafka, Flink, Iceberg & moreβ51Apr 12, 2026Updated last week
- β10Nov 2, 2023Updated 2 years ago
- trino monitoring with JMX metrics through Prometheus and Grafanaβ17Aug 14, 2024Updated last year
- A tool to learn JSON schema from collection of documents and generate Create table statement for Redshiftβ22Jul 12, 2025Updated 9 months ago
- Local AWS - a lightweight AWS service emulatorβ43Apr 12, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Short Range Ultrasonic Radar - A simple radar using the ultrasonic sensor, this radar works by measuring a range from 3cm to 40 cm as nonβ¦β19Nov 11, 2024Updated last year
- In this project I have built etl pipline which scraps the trending repository based on month,week and day LIVE extract other related infoβ¦β12Sep 9, 2023Updated 2 years ago
- β10Apr 2, 2024Updated 2 years ago
- β16Apr 8, 2024Updated 2 years ago
- β10Oct 7, 2024Updated last year
- Automate data collection from Spotify's worldwide ranking in 50+ countriesβ24May 3, 2020Updated 5 years ago
- β26Sep 28, 2023Updated 2 years ago
- Let's learn Beam, processing Movie Lens 20m datas. Get top three genres for each userβ14Aug 26, 2018Updated 7 years ago
- End-to-End deployment of E-commerce customers segmentation using Clustering Machine learning algorithms in Google Cloud Platform and MLOpβ¦β19Jun 5, 2024Updated last year
- Managed Database hosting by DigitalOcean β’ AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- β20Mar 13, 2025Updated last year
- Ops files for https//github.com/meta-llama/llama-stackβ17Jun 28, 2025Updated 9 months ago
- Sample application showcasing the use of Dapr to build microservices based appsβ15Feb 4, 2026Updated 2 months ago
- Sample code and documentation for very basic things that I can't remember but want to aggregate in one placeβ13Nov 7, 2021Updated 4 years ago
- 10gen M101J coursewareβ15Apr 15, 2013Updated 13 years ago
- Kubernetes object tree editorβ15Oct 25, 2025Updated 5 months ago
- β17Feb 7, 2026Updated 2 months ago
- Terragrunt friendly module to create AWS API Gateway (V1) w\Optional WAF, many stages/api keys/usage plans using the OpenAPI 3.x spec. πΊβ¦β11Feb 13, 2026Updated 2 months ago
- Agentkube - Run Kubernetes Like Never Beforeβ38Mar 1, 2026Updated last month
- Managed Database hosting by DigitalOcean β’ AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Analyse Spotify playlists, albums and artists.β35Nov 15, 2022Updated 3 years ago
- β14Dec 24, 2025Updated 3 months ago
- Trino On K8S Via Helm & Metastore Workshop Querying Delta Tablesβ12Jan 27, 2025Updated last year
- An example Terraform repo that utilizes the upstream EKS blueprints project from AWS Integration and Automation.β14May 11, 2022Updated 3 years ago
- En este repositorio habra una gran variedad de ejercicios tecnicos realizados en pythonβ12Feb 16, 2025Updated last year
- An open source and enterprise-grade implementation of the orchestrator-worker pattern from Anthropic's paper, "How we built our multi-ageβ¦β25Oct 9, 2025Updated 6 months ago
- β10Feb 27, 2025Updated last year