Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline
☆77Feb 15, 2023Updated 3 years ago
Alternatives and similar repositories for delta-architecture
Users that are interested in delta-architecture are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- DeltaOMS is a solution that help build a centralized repository of Delta Transaction logs and associated operational metrics/statistics f…☆41Nov 27, 2023Updated 2 years ago
- Code for Apache Hudi, Apache Iceberg and Delta Lake analysis☆10Feb 2, 2024Updated 2 years ago
- Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…☆71Aug 27, 2025Updated last year
- Traditionally, engineers were needed to implement business logic via data pipelines before business users can start using it. Using this …☆12Sep 16, 2026Updated last week
- This project showcases the integration of multi-source flood data using a full-fledged Apache Hadoop Ecosystem. The system is designed to…☆17May 28, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- This repo demonstrates how to use AWS application auto-scaling to implement custom-scaling in your Kinesis Data Analytics for Apache Flin…☆19Feb 21, 2025Updated last year
- Scala API for Apache Spark SQL high-order functions☆15Aug 4, 2023Updated 3 years ago
- Framework for simpler Spark Pipelines☆12Updated this week
- Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…☆26Jun 7, 2021Updated 5 years ago
- A custom extractor designed to read parquet for Azure Data Lake Analytics☆13Feb 13, 2018Updated 8 years ago
- Azure Data Architecture Guide☆34Jan 19, 2018Updated 8 years ago
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆444Jun 22, 2026Updated 3 months ago
- A custom end-to-end analytics platform for customer churn☆10May 15, 2025Updated last year
- Spark and Delta Lake Workshop☆22Jun 14, 2022Updated 4 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A dynamic data completeness and accuracy library at enterprise scale for Apache Spark☆30May 13, 2026Updated 4 months ago
- A series of workshop modules introducing Feast feature store.☆18May 31, 2022Updated 4 years ago
- Notebooks Python Machine Learning☆20Feb 6, 2020Updated 6 years ago
- A Proof Generator for Entailments, Tautologies, and Semantic Equivalences in First-order Logic☆43Jan 5, 2026Updated 8 months ago
- Poetry plugin for creating docker images. 🏗☆18Sep 21, 2026Updated last week
- ☆64Nov 8, 2019Updated 6 years ago
- Sample processing code using Spark 2.1+ and Scala☆51Jun 28, 2020Updated 6 years ago
- The Internals of Delta Lake☆186Jun 18, 2026Updated 3 months ago
- Read Delta tables without any Spark☆47Mar 8, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Plot live-stats as graph from ApacheSpark application using Lightning-viz☆18Jul 3, 2017Updated 9 years ago
- An Inventory Optimization Solution How-To Guide☆45Mar 6, 2020Updated 6 years ago
- An IoT Edge Module that generates sample data using [Bogus](https://github.com/bchavez/Bogus)☆10Dec 8, 2022Updated 3 years ago
- Learn Kubeflow with Arrikto☆15Jan 4, 2022Updated 4 years ago
- Extensible streaming ingestion pipeline on top of Apache Spark☆47Jul 17, 2025Updated last year
- ☆36Aug 24, 2022Updated 4 years ago
- Crash course in Scala☆22Apr 14, 2020Updated 6 years ago
- Hướng dẫn tạo một hệ thống Log Remote dùng chung cho nhiều dự án/server☆15Feb 26, 2020Updated 6 years ago
- Accelerator to rapidly deploy customized features for your business☆57Dec 10, 2023Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆17Apr 13, 2026Updated 5 months ago
- ☆70Mar 15, 2021Updated 5 years ago
- Experiments with Ooyala's Spark Job Server☆21Dec 14, 2014Updated 11 years ago
- A sink to save Spark Structured Streaming DataFrame into Hive table☆23May 7, 2018Updated 8 years ago
- How to implement a streaming at scale solution in Azure☆233Oct 23, 2024Updated last year
- Delta Lake Examples☆11Apr 24, 2020Updated 6 years ago
- Protobuf serialization support for Apache Flink☆22Jun 1, 2021Updated 5 years ago