This repo contains examples of high throughput ingestion using Apache Spark and Apache Iceberg. These examples cover IoT and CDC scenarios using best practices. The code can be deployed into any Spark compatible engine like Amazon EMR Serverless or AWS Glue. A fully local developer environment is also provided.
☆31Jul 16, 2026Updated 2 months ago
Alternatives and similar repositories for iceberg-streaming-examples
Users that are interested in iceberg-streaming-examples are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Sample code to collect Apache Iceberg metrics for table monitoring☆29Aug 18, 2024Updated 2 years ago
- ☆18Nov 18, 2025Updated 10 months ago
- A Python CLI application that demonstrates how you can access AWS services, such as Amazon S3 and Amazon Athena, using trusted identity p…☆13Mar 11, 2025Updated last year
- ☆15Dec 19, 2025Updated 9 months ago
- ☆10May 5, 2022Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with Amazon Data Firehose and DMS☆18Jul 28, 2026Updated last month
- Sample Patterns for Amazon ECS blue/green deployments☆14Jul 8, 2026Updated 2 months ago
- RGCN model for real-time fraud detection☆11Jan 27, 2023Updated 3 years ago
- duckdb-etl-framework☆14Dec 20, 2024Updated last year
- The PQC Network Scanner is a quantum‑focused network assessment tool that scans TLS/SSL certificates across enterprise environments to id…☆18Dec 25, 2025Updated 8 months ago
- Visits sessionization pipeline used for the talk☆13May 28, 2024Updated 2 years ago
- A curated list of awesome Databricks resources, including Spark☆22Jun 28, 2024Updated 2 years ago
- Step by step code samples showing how AI agent architectures evolve from simple to production ready using AWS services including Amazon B…☆28Aug 19, 2026Updated last month
- ☆33Jul 2, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Some recipes for data engineering with Python☆25Mar 23, 2021Updated 5 years ago
- ☆18Nov 26, 2024Updated last year
- ☆10Jun 29, 2021Updated 5 years ago
- ☆16Aug 12, 2025Updated last year
- Lambda data architecture reference project — dbt medallion models, Airflow DAGs, Superset dashboards, and Marquez lineage for Iowa retail…☆14Jul 12, 2026Updated 2 months ago
- ☆11Oct 19, 2023Updated 2 years ago
- Demo for GitHub Universe 2022☆13Jan 31, 2023Updated 3 years ago
- Kubernetes- helm deployments using Flux V2☆12Apr 29, 2024Updated 2 years ago
- Welcome to the AWS Community Builders Dashboard repository!☆17Aug 11, 2026Updated last month
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- NIFTY50 Data Analysis from scratch (Data Extraction & Visualization to Investment Insights)☆18May 20, 2023Updated 3 years ago
- ☆13Feb 19, 2025Updated last year
- ☆21Dec 16, 2024Updated last year
- This is the reference implementation of CNOE and its toolings on AWS☆127Jul 29, 2025Updated last year
- Python Module to use the Readwise API☆21Jan 24, 2026Updated 7 months ago
- Collection of Cloud Formation Templates, Lambda Scripts and sample code required to provision an AWS Data Lake for a ReInvent Lab Exercis…☆26Apr 9, 2019Updated 7 years ago
- Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture☆185Updated this week
- ☆10Apr 2, 2024Updated 2 years ago
- Sample of a morse-code 'blinky' in different architectures☆18Oct 9, 2023Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Map your python dataclasses to pyspark types☆10Feb 11, 2024Updated 2 years ago
- PowerShell function to indicate progress, using cli-spinner icons, during longer running tasks.☆13Mar 31, 2021Updated 5 years ago
- Make AWS IAM policies smaller by adding wildcards to actions.☆19Updated this week
- EMR Advisor uses Spark Event Logs to generate insights and costs/runtime recommendations using different deployment options for Amazon EM…☆16Jun 5, 2025Updated last year
- A collection of pipelines for Scrapy☆16Sep 3, 2026Updated 2 weeks ago
- ☆25Feb 7, 2024Updated 2 years ago
- Streaming Generative AI Application on AWS☆14Jun 24, 2024Updated 2 years ago