aws-samples / aws-serverless-stream-ingest-transform-load
In this pattern, data records are ingested and then modified with simple transformations such as field level substitutions and data enrichment from relatively small and static data sets. A Lambda function is invoked by Kinesis Data Firehose as records are received by the delivery stream. the Lambda function then performs a simple processing job …
☆12Updated 5 years ago
Related projects: ⓘ
- This github repo contains Aurora MySQL and PostgreSQL Labs, Aurora Serverless Lab and Heterogeneous database migration with DMS Labs.☆30Updated last year
- The objective of Cloud Builders' Day repository is to provide do-it-yourself lab guides for several AWS services including but not limite…☆11Updated 4 years ago
- Cloudformation and SQL scripts used to replicate a POC environment from the "Data Lake to Data Warehouse: Enhancing Customer 360 with Ama…☆30Updated 4 years ago
- Content and Instructions for completing the "Making Things Right with AWS Lambda and AWS Config Rules" Workshop.☆22Updated 6 years ago
- ☆22Updated 4 years ago
- Sample code that reads Microsoft Excel workbook/CSV File for the details required to create a DMS task CloudFormation template☆12Updated 3 years ago
- AWS Quick Start Team☆23Updated 10 months ago
- Design pattern for orchestrating an incremental data ingestion pipeline using AWS Step Functions from an on premise location into an Amaz…☆28Updated 5 years ago
- A tool to learn JSON schema from collection of documents and generate Create table statement for Redshift☆19Updated last year
- AWS Quick Start Team☆60Updated 10 months ago
- ☆67Updated this week
- ☆26Updated last month
- Learn how to build an end-to-end streaming architecture to ingest, analyze, and visualize streaming data in near real-time☆34Updated 2 years ago
- A CLI to manage and monitor permissions in AWS Lake Formation☆25Updated last year
- Using Amazon Comprehend, Amazon Elasticsearch with Kibana, Amazon S3, Amazon Cognito to search over large number of documents.☆24Updated 4 months ago
- ☆20Updated 5 months ago
- A Java application that replays events that are stored in objects in Amazon S3 into a Amazon Kinesis stream as if they occurred in real t…☆51Updated 7 months ago
- Collection of Cloud Formation Templates, Lambda Scripts and sample code required to provision an AWS Data Lake for a ReInvent Lab Exercis…☆26Updated 5 years ago
- This GitHub project provides a series of lab exercises which help users get started using the Redshift platform.☆53Updated 3 years ago
- Repository for AWS DBS Reference Architectures - Enterprise Data Warehousing☆34Updated 5 years ago
- A self-paced workshop designed to allow you to get hands on with building a real-time data platform using serverless technologies such as…☆22Updated 5 years ago
- Sample code supporting the `Generating REST APIs from data classes in Python` blog post☆11Updated 4 months ago
- Integrating Amazon API Gateway private endpoints with on-premises networks☆12Updated 3 years ago
- Glue Python Shell Job that adds AWS Organizations account tags to Cost and Usage Reports. You can submit feedback & requests for changes…☆15Updated 3 years ago
- Automate AWS lambda functions migration across account using CloudFormation☆12Updated 4 years ago
- ☆17Updated 9 months ago
- Design best practices for building scalable ETL (Extract-Transform-Load) and ELT (Extract-Load-Transform) data processing pipelines using…☆16Updated 4 years ago
- Data Profiler for AWS Glue Data Catalog application as described in the AWS Big Data Blog post "Build an automatic data profiling and rep…☆18Updated 4 years ago
- Provision AWS infrastructure using Terraform (By HashiCorp): an example of web application logging customer data☆12Updated last year
- This repo contains a sample application composed of a web application supported by two serverless microservices. The microservices will b…☆36Updated 10 months ago