aws-samples / data-profiler-for-aws-glue-data-catalog
Data Profiler for AWS Glue Data Catalog application as described in the AWS Big Data Blog post "Build an automatic data profiling and reporting solution with Amazon EMR, AWS Glue, and Amazon QuickSight".
☆19Updated 4 years ago
Alternatives and similar repositories for data-profiler-for-aws-glue-data-catalog:
Users that are interested in data-profiler-for-aws-glue-data-catalog are comparing it to the libraries listed below
- A CLI to manage and monitor permissions in AWS Lake Formation☆26Updated 2 years ago
- A tool to learn JSON schema from collection of documents and generate Create table statement for Redshift☆19Updated 5 months ago
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆65Updated last year
- Optimizing downstream data processing with Amazon Kinesis Data Firehose and Amazon EMR running Apache Spark☆13Updated last year
- The open source version of the Amazon EMR Management Guide. You can submit feedback & requests for changes by submitting issues in this r…☆62Updated last year
- ☆19Updated 5 months ago
- ☆69Updated 9 months ago
- ☆22Updated 5 months ago
- ☆24Updated last year
- Learn how to build an end-to-end streaming architecture to ingest, analyze, and visualize streaming data in near real-time☆34Updated 2 years ago
- Amazon EMR on EKS Custom Image CLI☆28Updated 5 months ago
- A solution describing data-processing design pattern for streaming data through Kinesis and Spark Streaming at real-time.☆38Updated 9 months ago
- This construct builds some elements for you to quickly launch an EMR Serverless application. After submitting the Emr Serverless job, you…☆11Updated this week
- Spark ETL example processing New York taxi rides public dataset on EKS☆44Updated 2 years ago
- ☆53Updated last year
- Scalable CDC Pattern Implemented using PySpark☆18Updated 5 years ago
- ☆27Updated 7 months ago
- Reference Architectures for Datalakes on AWS☆79Updated 4 years ago
- ☆12Updated 7 months ago
- In this repository, we show how to get started with data lineage on AWS using OpenLineage. This is an AWS Cloud Development Kit project (…☆12Updated 7 months ago
- ☆14Updated last month
- Sample Apache Beam pipeline that can be deployed to Amazon Managed Service for Apache Flink. It reads taxi events from a Kinesis data str…☆46Updated last year
- ☆14Updated 4 years ago
- Apiary provides modules which can be combined to create a federated cloud data lake☆36Updated 11 months ago
- ☆31Updated last year
- Enables synchronizing metadata changes (Create/Drop table/partition) from Hive Metastore to AWS Glue Data Catalog☆35Updated last year
- Automated data quality suggestions and analysis with Deequ on AWS Glue☆84Updated 2 years ago
- Web UI for Amazon Athena☆56Updated 2 years ago
- In this pattern, data records are ingested and then modified with simple transformations such as field level substitutions and data enric…☆12Updated 6 years ago
- AWS Quick Start Team☆18Updated 5 months ago