A deployable reference implementation intended to address pain points around conceptualizing data lake architectures that automatically configures the core AWS services necessary to easily tag, search, share, and govern specific subsets of data across a business or with other external businesses.
☆401Jun 3, 2024Updated last year
Alternatives and similar repositories for aws-data-lake-solution
Users that are interested in aws-data-lake-solution are comparing it to the libraries listed below
Sorting:
- As customers move from building data lakes and analytics on AWS to building machine learning solutions, one of their biggest challenges i…☆63Nov 28, 2018Updated 7 years ago
- A workshop demonstrating the capabilities of S3, Athena, Glue, Kinesis, and Quicksight.☆158Mar 24, 2020Updated 5 years ago
- Enterprise-grade, production-hardened, serverless data lake on AWS☆479Oct 1, 2025Updated 5 months ago
- Configure an LDAPS Endpoint for Simple AD☆14Aug 29, 2017Updated 8 years ago
- Collection of Cloud Formation Templates, Lambda Scripts and sample code required to provision an AWS Data Lake for a ReInvent Lab Exercis…☆26Apr 9, 2019Updated 6 years ago
- Data Lake as Code, featuring ChEMBL and OpenTargets☆173Nov 20, 2023Updated 2 years ago
- S3 Snapshot script to run from command-line or scheduled in Lambda.☆28May 7, 2019Updated 6 years ago
- Reference Architectures for Datalakes on AWS☆78May 13, 2020Updated 5 years ago
- AWS Glue Libraries are additions and enhancements to Spark for ETL operations.☆695Jan 13, 2026Updated last month
- The Automated Data Analytics on AWS solution provides an end-to-end data platform for ingesting, transforming, managing and querying data…☆91Sep 25, 2024Updated last year
- A packaged Data Lake solution, that builds a highly functional Data Lake, with a data catalog queryable via Elasticsearch☆73Dec 27, 2020Updated 5 years ago
- AWS Glue code samples☆1,536Nov 5, 2025Updated 3 months ago
- This reference architecture demonstrates the use of AWS Step Functions to orchestrate an Extract Transfer Load (ETL) workflow with AWS La…☆24Jun 16, 2020Updated 5 years ago
- ☆157Feb 29, 2024Updated 2 years ago
- This solution combines Amazon Pinpoint with Amazon SageMaker to help automate the process of collecting customer data, predicting custom…☆17Dec 17, 2020Updated 5 years ago
- The Automated Account Configuration is a sample solution to enable operational scale for AWS customers by automating repeatable steps req…☆14Jul 26, 2023Updated 2 years ago
- ☆22Jul 14, 2020Updated 5 years ago
- Repository for AWS DBS Reference Architectures - Enterprise Data Warehousing☆35Jan 17, 2019Updated 7 years ago
- Source code for the post, 'Getting Started with Data Analysis on AWS, using S3, Glue, Amazon Athena, and QuickSight'☆29Dec 22, 2020Updated 5 years ago
- Code samples related to "Harmonize, Search, and Analyze Loosely Coupled Datasets on AWS" (https://aws.amazon.com/blogs/big-data/harmonize…☆22Jun 4, 2019Updated 6 years ago
- A page escalation system using AWS Lambda, Step Functions, and API Gateway.☆26May 12, 2018Updated 7 years ago
- Generative AI Application Builder on AWS facilitates the development, rapid experimentation, and deployment of generative artificial inte…☆324Updated this week
- CloudFormation templates and scripts to setup the AWS services for the workshop, Athena & Redshift Spectrum queries☆176Apr 28, 2020Updated 5 years ago
- A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.☆345Mar 29, 2024Updated last year
- ☆250Mar 1, 2024Updated 2 years ago
- Amazon Redshift Advanced Monitoring☆272Oct 28, 2025Updated 4 months ago
- The Amazon Athena Query Federation SDK allows you to customize Amazon Athena with your own data sources and code.☆605Updated this week
- A solution describing data-processing design pattern for streaming data through Kinesis and Spark Streaming at real-time.☆39Jun 11, 2024Updated last year
- ☆15Jul 2, 2024Updated last year
- Amazon Redshift Database Loader implemented in AWS Lambda☆596Jul 16, 2024Updated last year
- Amazon SageMaker workshops: Introduction, TensorFlow in SageMaker, and more☆391Jan 14, 2026Updated last month
- ☆49Oct 13, 2020Updated 5 years ago
- [Deprecated] This solution helps customers reduce operational complexity and enables administrators to quickly create manual, event-based…☆14Mar 8, 2023Updated 2 years ago
- ☆14Jun 18, 2025Updated 8 months ago
- ☆12Aug 31, 2023Updated 2 years ago
- ☆14Nov 22, 2023Updated 2 years ago
- pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoD…☆4,107Updated this week
- AWS BikeNow Demo is a sample web application that demonstrates the breadth and depth of database, analytics, and AI/ML services on AWS.☆23Jun 13, 2023Updated 2 years ago
- A Lambda function that builds an on-demand, scalable Amazon Elasticsearch cluster to solve a specific problem or to do analysis.☆48Jan 14, 2026Updated last month