This repo contains examples of high throughput ingestion using Apache Spark and Apache Iceberg. These examples cover IoT and CDC scenarios using best practices. The code can be deployed into any Spark compatible engine like Amazon EMR Serverless or AWS Glue. A fully local developer environment is also provided.
☆31Jul 16, 2026Updated 2 months ago
Alternatives and similar repositories for iceberg-streaming-examples
Users that are interested in iceberg-streaming-examples are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Sample code to collect Apache Iceberg metrics for table monitoring☆29Aug 18, 2024Updated 2 years ago
- ☆18Nov 18, 2025Updated 10 months ago
- A Python CLI application that demonstrates how you can access AWS services, such as Amazon S3 and Amazon Athena, using trusted identity p…☆13Mar 11, 2025Updated last year
- ☆15Dec 19, 2025Updated 9 months ago
- ☆10May 5, 2022Updated 4 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with Amazon Data Firehose and DMS☆18Jul 28, 2026Updated 2 months ago
- Sample Patterns for Amazon ECS blue/green deployments☆14Jul 8, 2026Updated 3 months ago
- A curated list of awesome Databricks resources, including Spark☆22Jun 28, 2024Updated 2 years ago
- ☆33Jul 2, 2026Updated 3 months ago
- Operational Data Processing Framework developed using AWS Glue and Apache Hudi. This framework is suitable for Data Lake and Modern Data …☆24Sep 6, 2023Updated 3 years ago
- Some recipes for data engineering with Python☆25Mar 23, 2021Updated 5 years ago
- ☆18Nov 26, 2024Updated last year
- ☆10Jun 29, 2021Updated 5 years ago
- ☆16Aug 12, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Lambda data architecture reference project — dbt medallion models, Airflow DAGs, Superset dashboards, and Marquez lineage for Iowa retail…☆14Jul 12, 2026Updated 2 months ago
- ☆11Oct 19, 2023Updated 2 years ago
- Change Data Capture (CDC) from PostgreSQL to ClickHouse☆16Jul 15, 2024Updated 2 years ago
- Welcome to the AWS Community Builders Dashboard repository!☆17Aug 11, 2026Updated 2 months ago
- ☆13Feb 19, 2025Updated last year
- ☆10Nov 2, 2023Updated 2 years ago
- Create EPUBs from your Readwise Reader inbox☆16Jul 8, 2023Updated 3 years ago
- This is the reference implementation of CNOE and its toolings on AWS☆130Jul 29, 2025Updated last year
- Python Module to use the Readwise API☆21Jan 24, 2026Updated 8 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Collection of Cloud Formation Templates, Lambda Scripts and sample code required to provision an AWS Data Lake for a ReInvent Lab Exercis…☆26Apr 9, 2019Updated 7 years ago
- This repository contains the source code of the Verifiable Controls Evidence Store solution☆19Feb 19, 2025Updated last year
- Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture☆187Sep 21, 2026Updated 2 weeks ago
- ☆10Apr 2, 2024Updated 2 years ago
- Sample of a morse-code 'blinky' in different architectures☆18Oct 9, 2023Updated 3 years ago
- ☆21May 29, 2025Updated last year
- PowerShell function to indicate progress, using cli-spinner icons, during longer running tasks.☆13Mar 31, 2021Updated 5 years ago
- Application Pattern Orchestrator (APO) is an AWS Solution that helps customers to establish and manage an internal catalog of reusable, r…☆20Feb 19, 2025Updated last year
- EMR Advisor uses Spark Event Logs to generate insights and costs/runtime recommendations using different deployment options for Amazon EM…☆16Jun 5, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆25Feb 7, 2024Updated 2 years ago
- Streaming Generative AI Application on AWS☆14Jun 24, 2024Updated 2 years ago
- This repository is for demonstrating the capability to do SQL-based UPDATES, DELETES, and INSERTS directly in the Data Lake using Amazon …☆18Aug 25, 2021Updated 5 years ago
- Catch the mistakes AI coding assistants keep making. A multi-language linter for AI-generated code: duplicate code, deep nesting, magic n…☆24Aug 28, 2026Updated last month
- ☆15Jul 2, 2024Updated 2 years ago
- Research prototype for new register_template_loaders LLM plugin hook☆20Apr 7, 2025Updated last year
- Local Development of AWS Glue with Docker and Visual Studio Code☆14Nov 29, 2021Updated 4 years ago