aws-samples / data-profiler-for-aws-glue-data-catalogLinks
Data Profiler for AWS Glue Data Catalog application as described in the AWS Big Data Blog post "Build an automatic data profiling and reporting solution with Amazon EMR, AWS Glue, and Amazon QuickSight".
☆20Updated 5 years ago
Alternatives and similar repositories for data-profiler-for-aws-glue-data-catalog
Users that are interested in data-profiler-for-aws-glue-data-catalog are comparing it to the libraries listed below
Sorting:
- Reference Architectures for Datalakes on AWS☆78Updated 5 years ago
- ☆73Updated last year
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆65Updated last year
- ☆21Updated last month
- ☆12Updated last year
- The open source version of the Amazon EMR Management Guide. You can submit feedback & requests for changes by submitting issues in this r…☆62Updated 2 years ago
- Replication utility for AWS Glue Data Catalog☆80Updated last year
- A CLI to manage and monitor permissions in AWS Lake Formation☆26Updated 2 years ago
- Spark ETL example processing New York taxi rides public dataset on EKS☆44Updated 2 years ago
- Automated data quality suggestions and analysis with Deequ on AWS Glue☆87Updated 2 years ago
- A Data Platform built for AWS, powered by Kubernetes.☆148Updated 2 years ago
- ☆24Updated last year
- ☆28Updated 2 months ago
- Best practices and recommendations for getting started with Amazon EMR on EKS.☆66Updated 2 months ago
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆30Updated 2 years ago
- The open source version of the Amazon Athena documentation. To submit feedback & requests for changes, submit issues in this repository, …☆83Updated 2 years ago
- The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog a…☆224Updated 5 months ago
- ☆32Updated last year
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆76Updated 6 years ago
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆52Updated last year
- This solution helps you deploy ETL jobs on data lake using CDK Pipelines.☆69Updated 3 years ago
- ☆24Updated 10 months ago
- A solution describing data-processing design pattern for streaming data through Kinesis and Spark Streaming at real-time.☆38Updated last year
- Example applications in Java, Python and SQL for Kinesis Data Analytics, demonstrating sources, sinks, and operators.☆146Updated last year
- An open-source framework that simplifies implementation of data solutions.☆141Updated last week
- ☆22Updated 5 years ago
- Optimizing downstream data processing with Amazon Kinesis Data Firehose and Amazon EMR running Apache Spark☆14Updated 2 years ago
- This GitHub project provides a series of lab exercises which help users get started using the Redshift platform.☆53Updated 4 years ago
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆38Updated 6 months ago
- Sample Apache Flink application that can be deployed to Kinesis Analytics for Java. It reads taxi events from a Kinesis data stream, proc…☆86Updated last year