aws-samples / iceberg-streaming-examplesLinks
This repo contains examples of high throughput ingestion using Apache Spark and Apache Iceberg. These examples cover IoT and CDC scenarios using best practices. The code can be deployed into any Spark compatible engine like Amazon EMR Serverless or AWS Glue. A fully local developer environment is also provided.
☆25Updated last week
Alternatives and similar repositories for iceberg-streaming-examples
Users that are interested in iceberg-streaming-examples are comparing it to the libraries listed below
Sorting:
- Sample code to collect Apache Iceberg metrics for table monitoring☆28Updated 10 months ago
- ☆11Updated 7 months ago
- Operational Data Processing Framework developed using AWS Glue and Apache Hudi. This framework is suitable for Data Lake and Modern Data …☆22Updated last year
- ☆15Updated 2 years ago
- ☆32Updated last year
- aws-solutions-library-samples / guidance-for-preparing-and-validating-records-for-entity-resolution-on-awsThis Guidance demonstrates how to prepare and validate Personally Identifiable Information (PII) data, including physical address, phone,…☆9Updated 8 months ago
- dApp authentication with Amazon Cognito and Web3 proxy with Amazon API Gateway☆13Updated 11 months ago
- Unity Catalog UI☆40Updated 10 months ago
- aws-solutions-library-samples / guidance-for-using-google-tag-manager-for-server-side-website-analytics-on-awsThis Guidance helps you implement server-side tagging to collect event data and perform data analysis in near real-time.☆11Updated 5 months ago
- ☆25Updated last year
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆23Updated 10 months ago
- This Guidance demonstrates how you can extend the data governance capabilities of Amazon DataZone to other Java Database Connectivity (JD…☆13Updated 8 months ago
- This repository has a collection of utilities for Glue Crawlers. These utilities come in the form of AWS CloudFormation templates or AWS …☆19Updated 3 years ago
- dbt / Amazon Redshift Demonstration Project☆34Updated 2 years ago
- ☆16Updated 3 weeks ago
- CCCS security control profiles expressed using OSCAL☆14Updated last month
- Collection of code examples for Amazon Managed Service for Apache Flink☆60Updated last week
- Describes the concepts of lambda architecture and the actual deployment process with an example of building a serverless business intelli…☆15Updated last month
- ☆16Updated last year
- Using TypeScript and the AWS CDK, you can integrate Knowledge Bases into Amazon Bedrock to provide foundation models with contextual data…☆14Updated last year
- ☆13Updated last year
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆29Updated 2 years ago
- Demonstrating the capabilities of DuckDB as a transformation engine for data lakes☆28Updated 9 months ago
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆51Updated last year
- ☆27Updated last month
- ☆13Updated last month
- Amazon Q Business enables querying structured data using natural language, leveraging schemas and metadata. This example demonstrates an …☆15Updated 8 months ago
- The repository guides you through generating a synthetic dataset for a QA-RAG application using the Bedrock API, Python and Langchain.☆18Updated 9 months ago
- The data product processor is a library for dynamically creating and executing Apache Spark Jobs based on a declarative description of a …☆13Updated last year
- Demo for GitHub Universe 2022☆12Updated 2 years ago