aws-samples / aws-glue-test-data-generator
AWS Glue Configurable Test Data Generator for S3 Data Lakes and DynamoDB
☆16Updated last year
Alternatives and similar repositories for aws-glue-test-data-generator:
Users that are interested in aws-glue-test-data-generator are comparing it to the libraries listed below
- Operational Data Processing Framework developed using AWS Glue and Apache Hudi. This framework is suitable for Data Lake and Modern Data …☆21Updated last year
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆20Updated 4 months ago
- ☆16Updated last year
- ☆31Updated 10 months ago
- This repo contains examples of high throughput ingestion using Apache Spark and Apache Iceberg. These examples cover IoT and CDC scenario…☆19Updated 2 months ago
- A tool to automate analytic platform evaluations. Barometer helps customers to get data points needed for service selection/service confi…☆18Updated 7 months ago
- In this repository, we show how to get started with data lineage on AWS using OpenLineage. This is an AWS Cloud Development Kit project (…☆12Updated 5 months ago
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆30Updated 4 months ago
- A collection of examples built with AWS DataOps Development Kit (DDK)☆40Updated 6 months ago
- ☆26Updated 4 years ago
- ☆17Updated last year
- CDK Constructs library to aid in building Datalakes on AWS☆21Updated last year
- ☆29Updated 7 months ago
- Guidance for Organization on AWS☆10Updated this week
- ☆53Updated last year
- A CLI to manage and monitor permissions in AWS Lake Formation☆26Updated last year
- Sample code to collect Apache Iceberg metrics for table monitoring☆23Updated 5 months ago
- Serverless Datalake architecture☆12Updated last year
- ☆13Updated 5 months ago
- Data Pipeline for CDC data from MySQL DB to Amazon OpenSearch Service through Amazon Kinesis using Amazon Data Migration Service(DMS).☆27Updated 5 months ago
- This repository has a collection of utilities for Glue Crawlers. These utilities come in the form of AWS CloudFormation templates or AWS …☆19Updated 3 years ago
- MLOps Pipeline Using SageMaker & CDK, where models are from SageMaker built-in algorithms.☆25Updated 2 months ago
- ☆26Updated 5 months ago
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆49Updated last year
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with AWS Glue Streaming and DMS☆26Updated 2 months ago
- ☆9Updated last month
- ☆13Updated 2 years ago
- A tool to learn JSON schema from collection of documents and generate Create table statement for Redshift☆19Updated 3 months ago
- ☆29Updated 10 months ago
- Using Amazon Comprehend, Amazon Elasticsearch with Kibana, Amazon S3, Amazon Cognito to search over large number of documents.☆24Updated 8 months ago