This repo contains examples of high throughput ingestion using Apache Spark and Apache Iceberg. These examples cover IoT and CDC scenarios using best practices. The code can be deployed into any Spark compatible engine like Amazon EMR Serverless or AWS Glue. A fully local developer environment is also provided.
☆28Jul 16, 2026Updated last week
Alternatives and similar repositories for iceberg-streaming-examples
Users that are interested in iceberg-streaming-examples are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆11Jun 8, 2026Updated last month
- Sample code to collect Apache Iceberg metrics for table monitoring☆29Aug 18, 2024Updated last year
- ☆19Nov 18, 2025Updated 8 months ago
- A Python CLI application that demonstrates how you can access AWS services, such as Amazon S3 and Amazon Athena, using trusted identity p…☆13Mar 11, 2025Updated last year
- ☆15Dec 19, 2025Updated 7 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆10May 5, 2022Updated 4 years ago
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with Amazon Data Firehose and DMS☆18Feb 15, 2025Updated last year
- Sample Patterns for Amazon ECS blue/green deployments☆15Jul 8, 2026Updated 2 weeks ago
- RGCN model for real-time fraud detection☆10Jan 27, 2023Updated 3 years ago
- duckdb-etl-framework☆14Dec 20, 2024Updated last year
- Visits sessionization pipeline used for the talk☆13May 28, 2024Updated 2 years ago
- A curated list of awesome Databricks resources, including Spark☆22Jun 28, 2024Updated 2 years ago
- ☆32Jul 2, 2026Updated 3 weeks ago
- ☆10Jun 29, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆16Aug 12, 2025Updated 11 months ago
- Lambda data architecture reference project — dbt medallion models, Airflow DAGs, Superset dashboards, and Marquez lineage for Iowa retail…☆14Jul 12, 2026Updated last week
- Demo for GitHub Universe 2022☆13Jan 31, 2023Updated 3 years ago
- Kubernetes- helm deployments using Flux V2☆12Apr 29, 2024Updated 2 years ago
- A Golang application that demonstrates how to monitor a Golang service using Prometheus and Grafana. This is for Docker's official Deno L…☆15Mar 22, 2025Updated last year
- Welcome to the AWS Community Builders Dashboard repository!☆17Aug 29, 2025Updated 10 months ago
- ☆13Feb 19, 2025Updated last year
- ☆10Nov 2, 2023Updated 2 years ago
- Create EPUBs from your Readwise Reader inbox☆16Jul 8, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆21Dec 16, 2024Updated last year
- This is the reference implementation of CNOE and its toolings on AWS☆126Jul 29, 2025Updated 11 months ago
- Python Module to use the Readwise API☆21Jan 24, 2026Updated 5 months ago
- Collection of Cloud Formation Templates, Lambda Scripts and sample code required to provision an AWS Data Lake for a ReInvent Lab Exercis…☆26Apr 9, 2019Updated 7 years ago
- This repository contains the source code of the Verifiable Controls Evidence Store solution☆19Feb 19, 2025Updated last year
- Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture☆177May 22, 2026Updated 2 months ago
- Sample of a morse-code 'blinky' in different architectures☆18Oct 9, 2023Updated 2 years ago
- ☆21May 29, 2025Updated last year
- Map your python dataclasses to pyspark types☆10Feb 11, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆16Aug 23, 2025Updated 10 months ago
- Make AWS IAM policies smaller by adding wildcards to actions.☆19Updated this week
- A collection of pipelines for Scrapy☆16Apr 27, 2026Updated 2 months ago
- EMR Advisor uses Spark Event Logs to generate insights and costs/runtime recommendations using different deployment options for Amazon EM…☆16Jun 5, 2025Updated last year
- ☆25Feb 7, 2024Updated 2 years ago
- Streaming Generative AI Application on AWS☆14Jun 24, 2024Updated 2 years ago
- This repository is for demonstrating the capability to do SQL-based UPDATES, DELETES, and INSERTS directly in the Data Lake using Amazon …☆18Aug 25, 2021Updated 4 years ago