This repo contains examples of high throughput ingestion using Apache Spark and Apache Iceberg. These examples cover IoT and CDC scenarios using best practices. The code can be deployed into any Spark compatible engine like Amazon EMR Serverless or AWS Glue. A fully local developer environment is also provided.
☆30Jul 16, 2026Updated last month
Alternatives and similar repositories for iceberg-streaming-examples
Users that are interested in iceberg-streaming-examples are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆11Jul 28, 2026Updated last month
- Sample code to collect Apache Iceberg metrics for table monitoring☆29Aug 18, 2024Updated 2 years ago
- ☆18Nov 18, 2025Updated 9 months ago
- A Python CLI application that demonstrates how you can access AWS services, such as Amazon S3 and Amazon Athena, using trusted identity p…☆13Mar 11, 2025Updated last year
- ☆15Dec 19, 2025Updated 8 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆10May 5, 2022Updated 4 years ago
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with Amazon Data Firehose and DMS☆18Jul 28, 2026Updated last month
- Sample Patterns for Amazon ECS blue/green deployments☆14Jul 8, 2026Updated last month
- RGCN model for real-time fraud detection☆11Jan 27, 2023Updated 3 years ago
- duckdb-etl-framework☆14Dec 20, 2024Updated last year
- Visits sessionization pipeline used for the talk☆13May 28, 2024Updated 2 years ago
- Operational Data Processing Framework developed using AWS Glue and Apache Hudi. This framework is suitable for Data Lake and Modern Data …☆24Sep 6, 2023Updated 2 years ago
- ☆33Jul 2, 2026Updated 2 months ago
- Some recipes for data engineering with Python☆25Mar 23, 2021Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆18Nov 26, 2024Updated last year
- ☆10Jun 29, 2021Updated 5 years ago
- ☆16Aug 12, 2025Updated last year
- Lambda data architecture reference project — dbt medallion models, Airflow DAGs, Superset dashboards, and Marquez lineage for Iowa retail…☆14Jul 12, 2026Updated last month
- ☆11Oct 19, 2023Updated 2 years ago
- Change Data Capture (CDC) from PostgreSQL to ClickHouse☆16Jul 15, 2024Updated 2 years ago
- Demo for GitHub Universe 2022☆13Jan 31, 2023Updated 3 years ago
- Welcome to the AWS Community Builders Dashboard repository!☆17Aug 11, 2026Updated 3 weeks ago
- ☆13Feb 19, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆10Nov 2, 2023Updated 2 years ago
- ☆21Dec 16, 2024Updated last year
- Python Module to use the Readwise API☆21Jan 24, 2026Updated 7 months ago
- Collection of Cloud Formation Templates, Lambda Scripts and sample code required to provision an AWS Data Lake for a ReInvent Lab Exercis…☆26Apr 9, 2019Updated 7 years ago
- This repository contains the source code of the Verifiable Controls Evidence Store solution☆19Feb 19, 2025Updated last year
- Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture☆180May 22, 2026Updated 3 months ago
- ☆10Apr 2, 2024Updated 2 years ago
- Make AWS IAM policies smaller by adding wildcards to actions.☆19Updated this week
- Application Pattern Orchestrator (APO) is an AWS Solution that helps customers to establish and manage an internal catalog of reusable, r…☆20Feb 19, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A collection of pipelines for Scrapy☆16Updated this week
- EMR Advisor uses Spark Event Logs to generate insights and costs/runtime recommendations using different deployment options for Amazon EM…☆16Jun 5, 2025Updated last year
- ☆25Feb 7, 2024Updated 2 years ago
- Streaming Generative AI Application on AWS☆14Jun 24, 2024Updated 2 years ago
- Local Development of AWS Glue with Docker and Visual Studio Code☆14Nov 29, 2021Updated 4 years ago
- This repo provides the Kubernetes Helm chart for deploying Pyspark Notebook.☆17Nov 16, 2022Updated 3 years ago
- Automate rule management for AWS Network Firewall☆19Aug 4, 2026Updated 3 weeks ago