A deployable reference implementation intended to address pain points around conceptualizing data lake architectures that automatically configures the core AWS services necessary to easily tag, search, share, and govern specific subsets of data across a business or with other external businesses.
☆398Jun 3, 2024Updated 2 years ago
Alternatives and similar repositories for aws-data-lake-solution
Users that are interested in aws-data-lake-solution are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- As customers move from building data lakes and analytics on AWS to building machine learning solutions, one of their biggest challenges i…☆62Nov 28, 2018Updated 7 years ago
- Collection of Cloud Formation Templates, Lambda Scripts and sample code required to provision an AWS Data Lake for a ReInvent Lab Exercis…☆26Apr 9, 2019Updated 7 years ago
- A packaged Data Lake solution, that builds a highly functional Data Lake, with a data catalog queryable via Elasticsearch☆73Dec 27, 2020Updated 5 years ago
- Enterprise-grade, production-hardened, serverless data lake on AWS☆485Sep 4, 2026Updated last month
- Configure an LDAPS Endpoint for Simple AD☆14Aug 29, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A workshop demonstrating the capabilities of S3, Athena, Glue, Kinesis, and Quicksight.☆158Mar 24, 2020Updated 6 years ago
- Data Lake as Code, featuring ChEMBL and OpenTargets☆173Nov 20, 2023Updated 2 years ago
- Reference Architectures for Datalakes on AWS☆77May 13, 2020Updated 6 years ago
- AWS Glue code samples☆1,540Oct 26, 2026Updated last week
- AWS Glue Libraries are additions and enhancements to Spark for ETL operations.☆702Oct 24, 2026Updated last week
- S3 Snapshot script to run from command-line or scheduled in Lambda.☆27May 7, 2019Updated 7 years ago
- The Automated Data Analytics on AWS solution provides an end-to-end data platform for ingesting, transforming, managing and querying data…☆90Sep 25, 2024Updated 2 years ago
- ☆157Feb 29, 2024Updated 2 years ago
- This solution combines Amazon Pinpoint with Amazon SageMaker to help automate the process of collecting customer data, predicting custom…☆17Dec 17, 2020Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Code samples related to "Harmonize, Search, and Analyze Loosely Coupled Datasets on AWS" (https://aws.amazon.com/blogs/big-data/harmonize…☆22Jun 4, 2019Updated 7 years ago
- ☆250Mar 1, 2024Updated 2 years ago
- A page escalation system using AWS Lambda, Step Functions, and API Gateway.☆26May 12, 2018Updated 8 years ago
- A cloud service that perform facial analysis, object detection and face searches on videos. - Now found at https://github.com/awslabs/med…☆21May 31, 2018Updated 8 years ago
- Amazon Redshift Advanced Monitoring☆262Oct 28, 2025Updated last year
- This reference architecture demonstrates the use of AWS Step Functions to orchestrate an Extract Transfer Load (ETL) workflow with AWS La…☆24Jun 16, 2020Updated 6 years ago
- ☆22Jul 14, 2020Updated 6 years ago
- Lab Instructions for Data Engineering Immersion Day☆200Jan 26, 2026Updated 9 months ago
- A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.☆347Mar 29, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A solution describing data-processing design pattern for streaming data through Kinesis and Spark Streaming at real-time.☆39Jun 11, 2024Updated 2 years ago
- dApp authentication with Amazon Cognito and Web3 proxy with Amazon API Gateway☆15Aug 5, 2024Updated 2 years ago
- Amazon Redshift Database Loader implemented in AWS Lambda☆595Jul 16, 2024Updated 2 years ago
- Source code for the post, 'Getting Started with Data Analysis on AWS, using S3, Glue, Amazon Athena, and QuickSight'☆29Dec 22, 2020Updated 5 years ago
- ☆13Oct 11, 2024Updated 2 years ago
- Repository for AWS DBS Reference Architectures - Enterprise Data Warehousing☆35Jan 17, 2019Updated 7 years ago
- A collection of examples built with AWS DataOps Development Kit (DDK)☆41Mar 23, 2026Updated 7 months ago
- Replication utility for AWS Glue Data Catalog☆81Aug 8, 2024Updated 2 years ago
- Design pattern for orchestrating an incremental data ingestion pipeline using AWS Step Functions from an on premise location into an Amaz…☆30Jul 24, 2019Updated 7 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- AWS re:Invent 2018 DEV372 "Infrastructure is Code" demo☆15Sep 8, 2020Updated 6 years ago
- CloudFormation templates and scripts to setup the AWS services for the workshop, Athena & Redshift Spectrum queries☆177Apr 28, 2020Updated 6 years ago
- A UI that simplifies testing with Amazon Kinesis Streams and Firehose. Create and save record templates, and easily send data to Amazon K…☆210Sep 21, 2026Updated last month
- An automated reference implementation that assists with setting up corss account roles for easy federation of users from one AWS master a…☆55Mar 28, 2018Updated 8 years ago
- The Amazon Athena Query Federation SDK allows you to customize Amazon Athena with your own data sources and code.☆615Oct 26, 2026Updated last week
- 🌉 Reference implementation for granting cross-account AWS Glue Data Catalog access from Amazon Athena☆30Jul 25, 2022Updated 4 years ago
- The Automated Account Configuration is a sample solution to enable operational scale for AWS customers by automating repeatable steps req…☆14Jul 26, 2023Updated 3 years ago