aws-samples / iceberg-streaming-examplesLinks
This repo contains examples of high throughput ingestion using Apache Spark and Apache Iceberg. These examples cover IoT and CDC scenarios using best practices. The code can be deployed into any Spark compatible engine like Amazon EMR Serverless or AWS Glue. A fully local developer environment is also provided.
☆27Updated 2 months ago
Alternatives and similar repositories for iceberg-streaming-examples
Users that are interested in iceberg-streaming-examples are comparing it to the libraries listed below
Sorting:
- Sample code to collect Apache Iceberg metrics for table monitoring☆28Updated last year
- ☆11Updated 9 months ago
- Spark runtime on AWS Lambda☆109Updated 3 weeks ago
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆52Updated last year
- This repository contains the dbt-glue adapter☆132Updated this week
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆24Updated last year
- ☆18Updated last year
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆30Updated 2 years ago
- Example code for running Spark and Hive jobs on EMR Serverless.☆168Updated 8 months ago
- ☆73Updated last year
- Amazon EMR Notebook to show how to read from and write to Delta tables with Amazon EMR☆17Updated 4 months ago
- dbt / Amazon Redshift Demonstration Project☆34Updated 2 years ago
- ☆15Updated 2 months ago
- Demonstrating the capabilities of DuckDB as a transformation engine for data lakes☆30Updated 11 months ago
- Amazon Managed Workflows for Apache Airflow (MWAA) Examples repository contains example DAGs, requirements.txt, plugins, and CloudFormati…☆114Updated 2 months ago
- ☆16Updated 2 years ago
- Unity Catalog UI☆42Updated last year
- ☆32Updated last year
- ☆54Updated last month
- This repository demonstrates the construction of a state-of-the-art multimodal search engine, leveraging Amazon Titan Embeddings, Amazon …☆34Updated 2 weeks ago
- Operational Data Processing Framework developed using AWS Glue and Apache Hudi. This framework is suitable for Data Lake and Modern Data …☆23Updated 2 years ago
- Samples to help you get started with the Amazon Redshift Data API☆71Updated 2 years ago
- ☆29Updated last year
- ☆34Updated 2 years ago
- Utility functions for dbt projects running on Spark☆33Updated 7 months ago
- A guidance that provides declarative data processing capability, and workflow orchestration automation to help your business users (such …☆29Updated 3 weeks ago
- ☆12Updated last year
- Demo for GitHub Universe 2022☆13Updated 2 years ago
- ☆23Updated 7 months ago
- ☆16Updated 3 weeks ago