This repo contains examples of high throughput ingestion using Apache Spark and Apache Iceberg. These examples cover IoT and CDC scenarios using best practices. The code can be deployed into any Spark compatible engine like Amazon EMR Serverless or AWS Glue. A fully local developer environment is also provided.
☆32Jul 16, 2026Updated 4 months ago
Alternatives and similar repositories for iceberg-streaming-examples
Users that are interested in iceberg-streaming-examples are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆11Jul 28, 2026Updated 3 months ago
- Sample code to collect Apache Iceberg metrics for table monitoring☆29Aug 18, 2024Updated 2 years ago
- ☆18Oct 28, 2026Updated 3 weeks ago
- ☆11Apr 5, 2025Updated last year
- A Python CLI application that demonstrates how you can access AWS services, such as Amazon S3 and Amazon Athena, using trusted identity p…☆13Mar 11, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆15Nov 9, 2026Updated last week
- Transfer Family FTP/SFTP server with password authentication sample with TypeScript CDK☆11Nov 17, 2025Updated last year
- Sample Patterns for Amazon ECS blue/green deployments☆15Jul 8, 2026Updated 4 months ago
- (wip) Reversi in Vim/Neovim without external dependencies☆14Nov 1, 2025Updated last year
- ☆11Nov 2, 2022Updated 4 years ago
- PoC for a Rust-based extension template for DuckDB based on the Extension C API☆10Nov 15, 2024Updated 2 years ago
- Visits sessionization pipeline used for the talk☆13May 28, 2024Updated 2 years ago
- A curated list of awesome Databricks resources, including Spark☆22Jun 28, 2024Updated 2 years ago
- RGCN model for real-time fraud detection☆11Jan 27, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- OAuth2 Authentication Terraform module for AWS S3 static websites.☆32Mar 23, 2022Updated 4 years ago
- Some recipes for data engineering with Python☆25Mar 23, 2021Updated 5 years ago
- https://k8s-novice-jp.connpass.com/event/351876/☆12May 5, 2025Updated last year
- ☆14Apr 20, 2026Updated 7 months ago
- Operational Data Processing Framework developed using AWS Glue and Apache Hudi. This framework is suitable for Data Lake and Modern Data …☆23Sep 6, 2023Updated 3 years ago
- Lambda data architecture reference project — dbt medallion models, Airflow DAGs, Superset dashboards, and Marquez lineage for Iowa retail…☆14Jul 12, 2026Updated 4 months ago
- duckdb-etl-framework☆14Dec 20, 2024Updated last year
- Rails plugin to play nice with git branching and databases.☆10Sep 15, 2010Updated 16 years ago
- ☆34Jul 2, 2026Updated 4 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Welcome to the AWS Community Builders Dashboard repository!☆17Aug 11, 2026Updated 3 months ago
- Demo for GitHub Universe 2022☆13Jan 31, 2023Updated 3 years ago
- gem tool to use git modules to manage your plugins. The original authors copy is here: http://github.com/jxl/git-rails/tree☆11Sep 6, 2008Updated 18 years ago
- ☆10Jun 29, 2021Updated 5 years ago
- ☆11Oct 19, 2023Updated 3 years ago
- Support site for book (基礎から学ぶ TinyGoの組込み開発) released in Japan☆18May 3, 2025Updated last year
- Change Data Capture (CDC) from PostgreSQL to ClickHouse☆16Jul 15, 2024Updated 2 years ago
- Unity Catalog Explorer is a TypeScript + Next.js based Web UI for the Unity Catalog OSS.☆13Jun 29, 2024Updated 2 years ago
- A port of gitnub to gtk.☆11Dec 28, 2008Updated 17 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- This is the reference implementation of CNOE and its toolings on AWS☆131Jul 29, 2025Updated last year
- ☆10Nov 2, 2023Updated 3 years ago
- Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture☆186Updated this week
- A comprehensive AWS multi-account observability platform that aggregates, processes, and visualizes cloud infrastructure data across mult…☆19Aug 14, 2026Updated 3 months ago
- EMR Advisor uses Spark Event Logs to generate insights and costs/runtime recommendations using different deployment options for Amazon EM…☆16Jun 5, 2025Updated last year
- A library for interacting with ZFS, made in the spirit of Pathname.☆14Apr 14, 2012Updated 14 years ago
- ☆13Feb 19, 2025Updated last year
Are these results useful?