aws-samples / aws-dbs-refarch-datalake
Reference Architectures for Datalakes on AWS
☆79Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for aws-dbs-refarch-datalake
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆65Updated last year
- ☆66Updated 5 months ago
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆76Updated 6 years ago
- This GitHub project provides a series of lab exercises which help users get started using the Redshift platform.☆53Updated 3 years ago
- The open source version of the Amazon EMR Management Guide. You can submit feedback & requests for changes by submitting issues in this r…☆61Updated last year
- Replication utility for AWS Glue Data Catalog☆74Updated 3 months ago
- The open source version of the AWS Glue docs. You can submit feedback & requests for changes by submitting issues in this repo or by maki…☆199Updated last year
- Automated data quality suggestions and analysis with Deequ on AWS Glue☆83Updated last year
- A workshop demonstrating the capabilities of S3, Athena, Glue, Kinesis, and Quicksight.☆159Updated 4 years ago
- Sample Apache Flink application that can be deployed to Kinesis Analytics for Java. It reads taxi events from a Kinesis data stream, proc…☆85Updated last year
- A packaged Data Lake solution, that builds a highly functional Data Lake, with a data catalog queryable via Elasticsearch☆73Updated 3 years ago
- A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.☆330Updated 7 months ago
- The open source version of the Amazon Redshift Cluster Management Guide.☆48Updated last year
- ☆156Updated 8 months ago
- As customers move from building data lakes and analytics on AWS to building machine learning solutions, one of their biggest challenges i…☆61Updated 5 years ago
- Samples to help you get started with the Amazon Redshift Data API☆71Updated last year
- Design pattern for orchestrating an incremental data ingestion pipeline using AWS Step Functions from an on premise location into an Amaz…☆28Updated 5 years ago
- ☆53Updated 7 years ago
- A solutions that automatically configures the AWS services necessary to easily capture, store, process, and deliver streaming data. This …☆92Updated 3 weeks ago
- CloudFormation templates and scripts to setup the AWS services for the workshop, Athena & Redshift Spectrum queries☆175Updated 4 years ago
- ☆34Updated last year
- ☆85Updated last year
- ☆53Updated last year
- Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the…☆238Updated last month
- Sample code for the AWS Big Data Blog Post Building a scalable streaming data processor with Amazon Kinesis Data Streams on AWS Fargate☆35Updated 3 months ago
- In this workshop you will launch an Amazon Redshift cluster in your AWS account and load sample data ~ 100GB using TPCH dataset. You will…☆25Updated 5 years ago
- ☆32Updated 2 years ago
- ☆50Updated 2 years ago
- Enables synchronizing metadata changes (Create/Drop table/partition) from Hive Metastore to AWS Glue Data Catalog☆33Updated 11 months ago