This repo contains examples of high throughput ingestion using Apache Spark and Apache Iceberg. These examples cover IoT and CDC scenarios using best practices. The code can be deployed into any Spark compatible engine like Amazon EMR Serverless or AWS Glue. A fully local developer environment is also provided.
☆31Jul 16, 2026Updated 3 months ago
Alternatives and similar repositories for iceberg-streaming-examples
Users that are interested in iceberg-streaming-examples are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆11Jul 28, 2026Updated 3 months ago
- Sample code to collect Apache Iceberg metrics for table monitoring☆29Aug 18, 2024Updated 2 years ago
- ☆18Updated this week
- A Python CLI application that demonstrates how you can access AWS services, such as Amazon S3 and Amazon Athena, using trusted identity p…☆13Mar 11, 2025Updated last year
- ☆15Dec 19, 2025Updated 10 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with Amazon Data Firehose and DMS☆18Jul 28, 2026Updated 3 months ago
- Transfer Family FTP/SFTP server with password authentication sample with TypeScript CDK☆11Nov 17, 2025Updated 11 months ago
- A production-ready Text-to-SQL system implementing the DRGC (Decomposition-Retrieval-Generation-Correction) framework for handling comple…☆12Feb 26, 2026Updated 8 months ago
- ☆10May 5, 2022Updated 4 years ago
- Sample Patterns for Amazon ECS blue/green deployments☆14Jul 8, 2026Updated 3 months ago
- duckdb-etl-framework☆14Dec 20, 2024Updated last year
- Visits sessionization pipeline used for the talk☆13May 28, 2024Updated 2 years ago
- Step by step code samples showing how AI agent architectures evolve from simple to production ready using AWS services including Amazon B…☆30Aug 19, 2026Updated 2 months ago
- ☆34Jul 2, 2026Updated 3 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- RGCN model for real-time fraud detection☆11Jan 27, 2023Updated 3 years ago
- Operational Data Processing Framework developed using AWS Glue and Apache Hudi. This framework is suitable for Data Lake and Modern Data …☆24Sep 6, 2023Updated 3 years ago
- Lambda data architecture reference project — dbt medallion models, Airflow DAGs, Superset dashboards, and Marquez lineage for Iowa retail…☆14Jul 12, 2026Updated 3 months ago
- Demo for GitHub Universe 2022☆13Jan 31, 2023Updated 3 years ago
- Welcome to the AWS Community Builders Dashboard repository!☆17Aug 11, 2026Updated 2 months ago
- ☆11Oct 19, 2023Updated 3 years ago
- A Golang application that demonstrates how to monitor a Golang service using Prometheus and Grafana. This is for Docker's official Deno L…☆15Mar 22, 2025Updated last year
- ☆18Nov 26, 2024Updated last year
- Change Data Capture (CDC) from PostgreSQL to ClickHouse☆16Jul 15, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆13Feb 19, 2025Updated last year
- Ruby library for using the Skype Client API☆12Jan 23, 2009Updated 17 years ago
- ☆21Dec 16, 2024Updated last year
- NIFTY50 Data Analysis from scratch (Data Extraction & Visualization to Investment Insights)☆18May 20, 2023Updated 3 years ago
- Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture☆187Sep 21, 2026Updated last month
- Application Pattern Orchestrator (APO) is an AWS Solution that helps customers to establish and manage an internal catalog of reusable, r…☆20Feb 19, 2025Updated last year
- A comprehensive AWS multi-account observability platform that aggregates, processes, and visualizes cloud infrastructure data across mult…☆19Aug 14, 2026Updated 2 months ago
- Library to connect nginx lua script to Datadog/statsd logging☆14Aug 30, 2022Updated 4 years ago
- ☆16Aug 23, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Collection of Cloud Formation Templates, Lambda Scripts and sample code required to provision an AWS Data Lake for a ReInvent Lab Exercis…☆26Apr 9, 2019Updated 7 years ago
- Streaming Generative AI Application on AWS☆14Jun 24, 2024Updated 2 years ago
- ☆13Updated this week
- Automate rule management for AWS Network Firewall☆19Updated this week
- Catch the mistakes AI coding assistants keep making. A multi-language linter for AI-generated code: duplicate code, deep nesting, magic n…☆25Updated this week
- A text-to-SQL prototype on the northwind sqlite dataset☆13Sep 24, 2024Updated 2 years ago
- Multi-agent healthcare system demonstrating clinical decision support using Amazon Bedrock AgentCore and S3 Vectors for semantic search☆11Jul 16, 2026Updated 3 months ago