aws-samples / data-profiler-for-aws-glue-data-catalog
Data Profiler for AWS Glue Data Catalog application as described in the AWS Big Data Blog post "Build an automatic data profiling and reporting solution with Amazon EMR, AWS Glue, and Amazon QuickSight".
☆19Updated 4 years ago
Alternatives and similar repositories for data-profiler-for-aws-glue-data-catalog:
Users that are interested in data-profiler-for-aws-glue-data-catalog are comparing it to the libraries listed below
- A CLI to manage and monitor permissions in AWS Lake Formation☆26Updated 2 years ago
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆65Updated last year
- ☆19Updated 4 months ago
- ☆24Updated 5 months ago
- Learn how to build an end-to-end streaming architecture to ingest, analyze, and visualize streaming data in near real-time☆34Updated 2 years ago
- Optimizing downstream data processing with Amazon Kinesis Data Firehose and Amazon EMR running Apache Spark☆13Updated last year
- ☆22Updated 4 months ago
- A tool to learn JSON schema from collection of documents and generate Create table statement for Redshift☆19Updated 4 months ago
- AWS Quick Start Team☆18Updated 4 months ago
- Spark ETL example processing New York taxi rides public dataset on EKS☆44Updated 2 years ago
- The open source version of the Amazon EMR Management Guide. You can submit feedback & requests for changes by submitting issues in this r…☆61Updated last year
- Sample code to collect Apache Iceberg metrics for table monitoring☆24Updated 5 months ago
- A solution describing data-processing design pattern for streaming data through Kinesis and Spark Streaming at real-time.☆38Updated 8 months ago
- ☆31Updated 11 months ago
- ☆12Updated 6 months ago
- ☆23Updated last year
- Amazon EMR on EKS Custom Image CLI☆27Updated 4 months ago
- ☆22Updated 4 years ago
- ☆66Updated 8 months ago
- ☆53Updated last year
- Apiary provides modules which can be combined to create a federated cloud data lake☆36Updated 10 months ago
- Reference Architectures for Datalakes on AWS☆79Updated 4 years ago
- Automated data quality suggestions and analysis with Deequ on AWS Glue☆84Updated 2 years ago
- Web UI for Amazon Athena☆56Updated 2 years ago
- ☆14Updated 3 years ago
- Operational Data Processing Framework developed using AWS Glue and Apache Hudi. This framework is suitable for Data Lake and Modern Data …☆21Updated last year
- Sample Apache Beam pipeline that can be deployed to Amazon Managed Service for Apache Flink. It reads taxi events from a Kinesis data str…☆46Updated last year
- This github repo contains Aurora MySQL and PostgreSQL Labs, Aurora Serverless Lab and Heterogeneous database migration with DMS Labs.☆31Updated last year
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆30Updated this week
- Amundsen Gremlin☆21Updated 2 years ago