Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline
☆76Feb 15, 2023Updated 3 years ago
Alternatives and similar repositories for delta-architecture
Users that are interested in delta-architecture are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Docker compose and Google Colab demo to build a CDC with Delta Lake☆15Sep 7, 2022Updated 3 years ago
- Code for Apache Hudi, Apache Iceberg and Delta Lake analysis☆10Feb 2, 2024Updated 2 years ago
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆31Updated this week
- Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…☆71Aug 27, 2025Updated 7 months ago
- Traditionally, engineers were needed to implement business logic via data pipelines before business users can start using it. Using this …☆12Updated this week
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This repo demonstrates how to use AWS application auto-scaling to implement custom-scaling in your Kinesis Data Analytics for Apache Flin…☆19Feb 21, 2025Updated last year
- Scala API for Apache Spark SQL high-order functions☆14Aug 4, 2023Updated 2 years ago
- Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…☆26Jun 7, 2021Updated 4 years ago
- A custom extractor designed to read parquet for Azure Data Lake Analytics☆13Feb 13, 2018Updated 8 years ago
- Demo of using Airflow☆11Jun 24, 2022Updated 3 years ago
- A custom end-to-end analytics platform for customer churn☆11May 15, 2025Updated 11 months ago
- A real-time streaming ETL pipeline for streaming and performing sentiment analysis on Twitter data using Apache Kafka, Apache Spark and D…☆29Aug 8, 2020Updated 5 years ago
- A dynamic data completeness and accuracy library at enterprise scale for Apache Spark☆30Updated this week
- ☆10May 2, 2025Updated 11 months ago
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A Proof Generator for Entailments, Tautologies, and Semantic Equivalences in First-order Logic☆44Jan 5, 2026Updated 3 months ago
- Poetry plugin for creating docker images. 🏗☆18Apr 6, 2026Updated last week
- ☆63Nov 8, 2019Updated 6 years ago
- Sample processing code using Spark 2.1+ and Scala☆51Jun 28, 2020Updated 5 years ago
- Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines☆17Jan 21, 2020Updated 6 years ago
- Notebooks Python Machine Learning☆20Feb 6, 2020Updated 6 years ago
- The Internals of Delta Lake☆188Nov 30, 2025Updated 4 months ago
- Read Delta tables without any Spark☆47Mar 8, 2024Updated 2 years ago
- ☆12Oct 24, 2025Updated 5 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- An Inventory Optimization Solution How-To Guide☆45Mar 6, 2020Updated 6 years ago
- Extensible streaming ingestion pipeline on top of Apache Spark☆46Jul 17, 2025Updated 9 months ago
- ☆36Aug 24, 2022Updated 3 years ago
- Learn Kubeflow with Arrikto☆15Jan 4, 2022Updated 4 years ago
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆52Dec 2, 2023Updated 2 years ago
- Power a Spark Stream from anywhere in your Akka Stream Flow☆12Mar 1, 2016Updated 10 years ago
- Crash course in Scala☆22Apr 14, 2020Updated 6 years ago
- Spring Boot based sample project for the https://github.com/guylabs/angular-spring-data-rest Angular module.☆18Dec 18, 2020Updated 5 years ago
- Spark SQL DBF Library☆16Jan 2, 2015Updated 11 years ago
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆15Updated this week
- A sink to save Spark Structured Streaming DataFrame into Hive table☆23May 7, 2018Updated 7 years ago
- A minimal seed template for an Akka gRPC with Scala build☆19Jan 22, 2026Updated 2 months ago
- Data Exploration Using Spark 2.0☆14Apr 17, 2018Updated 8 years ago
- Forward messages to collaborators in East-oriented style.☆14Oct 18, 2025Updated 6 months ago
- Give your AI assistant access to your Fitbit data for personalized health insights, trend analysis, and automated tracking. Works with Cl…☆26May 27, 2025Updated 10 months ago
- TypeScript Maven Plugin☆34Mar 12, 2016Updated 10 years ago