aws-samples / data-profiler-for-aws-glue-data-catalog
Data Profiler for AWS Glue Data Catalog application as described in the AWS Big Data Blog post "Build an automatic data profiling and reporting solution with Amazon EMR, AWS Glue, and Amazon QuickSight".
☆19Updated 4 years ago
Alternatives and similar repositories for data-profiler-for-aws-glue-data-catalog:
Users that are interested in data-profiler-for-aws-glue-data-catalog are comparing it to the libraries listed below
- ☆13Updated 8 months ago
- Optimizing downstream data processing with Amazon Kinesis Data Firehose and Amazon EMR running Apache Spark☆13Updated 2 years ago
- A CLI to manage and monitor permissions in AWS Lake Formation☆26Updated 2 years ago
- A tool to learn JSON schema from collection of documents and generate Create table statement for Redshift☆20Updated 6 months ago
- ☆22Updated 4 years ago
- The open source version of the Amazon EMR Management Guide. You can submit feedback & requests for changes by submitting issues in this r…☆62Updated last year
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆64Updated last year
- Learn how to build an end-to-end streaming architecture to ingest, analyze, and visualize streaming data in near real-time☆34Updated 2 years ago
- Spark ETL example processing New York taxi rides public dataset on EKS☆44Updated 2 years ago
- ☆19Updated 6 months ago
- Automatically loads new partitions in AWS Athena☆18Updated 4 years ago
- Amazon EMR on EKS Custom Image CLI☆31Updated 7 months ago
- ☆73Updated 11 months ago
- Reference Architectures for Datalakes on AWS☆79Updated 4 years ago
- Web UI for Amazon Athena☆56Updated 2 years ago
- The open source version of the Amazon Redshift Cluster Management Guide.☆48Updated last year
- Cloudformation and SQL scripts used to replicate a POC environment from the "Data Lake to Data Warehouse: Enhancing Customer 360 with Ama…☆31Updated 5 years ago
- AWS Quick Start Team☆18Updated 7 months ago
- Automated data quality suggestions and analysis with Deequ on AWS Glue☆84Updated 2 years ago
- Replication utility for AWS Glue Data Catalog☆78Updated 8 months ago
- Sample Apache Beam pipeline that can be deployed to Amazon Managed Service for Apache Flink. It reads taxi events from a Kinesis data str…☆47Updated last year
- ☆31Updated last year
- ☆23Updated 7 months ago
- Content and Instructions for completing the "Making Things Right with AWS Lambda and AWS Config Rules" Workshop.☆22Updated 7 years ago
- Operational Data Processing Framework developed using AWS Glue and Apache Hudi. This framework is suitable for Data Lake and Modern Data …☆22Updated last year
- Glue Python Shell Job that adds AWS Organizations account tags to Cost and Usage Reports. You can submit feedback & requests for changes…☆16Updated 4 years ago
- Sample code for the AWS Big Data Blog Post Building a scalable streaming data processor with Amazon Kinesis Data Streams on AWS Fargate☆37Updated 2 weeks ago
- Design pattern for orchestrating an incremental data ingestion pipeline using AWS Step Functions from an on premise location into an Amaz…☆28Updated 5 years ago
- Sample code to collect Apache Iceberg metrics for table monitoring☆26Updated 8 months ago
- ☆53Updated last year