Enterprise-grade, production-hardened, serverless data lake on AWS
☆479Oct 1, 2025Updated 5 months ago
Alternatives and similar repositories for data-lakes-on-aws
Users that are interested in data-lakes-on-aws are comparing it to the libraries listed below
Sorting:
- An open source development framework to help you build data workflows and modern data architecture on AWS.☆271Feb 9, 2026Updated 3 weeks ago
- ☆157Feb 29, 2024Updated 2 years ago
- A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficie…☆249Feb 27, 2026Updated last week
- An open-source framework that simplifies implementation of data solutions.☆146Dec 2, 2025Updated 3 months ago
- A Data Platform built for AWS, powered by Kubernetes.☆147Jul 24, 2023Updated 2 years ago
- This solution helps you deploy Data Lake Infrastructure on AWS using CDK Pipelines.☆100Aug 12, 2022Updated 3 years ago
- Data Lake as Code, featuring ChEMBL and OpenTargets☆173Nov 20, 2023Updated 2 years ago
- pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoD…☆4,107Updated this week
- This solution helps you deploy ETL jobs on data lake using CDK Pipelines.☆69Aug 9, 2022Updated 3 years ago
- A deployable reference implementation intended to address pain points around conceptualizing data lake architectures that automatically c…☆401Jun 3, 2024Updated last year
- AWS Glue code samples☆1,537Nov 5, 2025Updated 4 months ago
- A collection of examples built with AWS DataOps Development Kit (DDK)☆43Jan 7, 2026Updated last month
- CDK Constructs library to aid in building Datalakes on AWS☆22May 2, 2023Updated 2 years ago
- AWS Glue Libraries are additions and enhancements to Spark for ETL operations.☆696Jan 13, 2026Updated last month
- Lab Instructions for Data Engineering Immersion Day☆197Jan 26, 2026Updated last month
- 🐋 Docker image for AWS Glue Spark/Python☆23Sep 5, 2023Updated 2 years ago
- A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.☆345Mar 29, 2024Updated last year
- The Automated Data Analytics on AWS solution provides an end-to-end data platform for ingesting, transforming, managing and querying data…☆91Sep 25, 2024Updated last year
- A CLI to manage and monitor permissions in AWS Lake Formation☆25Feb 8, 2023Updated 3 years ago
- ☆22Jul 14, 2020Updated 5 years ago
- CLI for building Docker images in SageMaker Studio using AWS CodeBuild.☆58Apr 18, 2022Updated 3 years ago
- ☆16Jun 14, 2023Updated 2 years ago
- ☆89Nov 6, 2023Updated 2 years ago
- Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the…☆245Jan 24, 2026Updated last month
- Automated data quality suggestions and analysis with Deequ on AWS Glue☆91Dec 29, 2022Updated 3 years ago
- ☆20Aug 10, 2021Updated 4 years ago
- A workshop demonstrating the capabilities of S3, Athena, Glue, Kinesis, and Quicksight.☆158Mar 24, 2020Updated 5 years ago
- ☆11Oct 11, 2022Updated 3 years ago
- ☆15Feb 12, 2026Updated 3 weeks ago
- The aws-codeseeder project enables builders to easily "seed" python code to AWS CodeBuild for remote execution in their cloud environment…☆44Jan 12, 2026Updated last month
- The Amazon Athena Query Federation SDK allows you to customize Amazon Athena with your own data sources and code.☆605Feb 24, 2026Updated last week
- A solutions that automatically configures the AWS services necessary to easily capture, store, process, and deliver streaming data. This …☆94Feb 3, 2025Updated last year
- This is a collecton of Amazon CDK projects to show how to directly ingest streaming data from Amazon Mananged Service for Apache Kafka (M…☆15Sep 10, 2024Updated last year
- This Guidance, with the sample code, can be used to deploy a carbon data lake to the AWS Cloud using an AWS Cloud Development Kit (AWS CD…☆23Jan 8, 2025Updated last year
- Collection of Cloud Formation Templates, Lambda Scripts and sample code required to provision an AWS Data Lake for a ReInvent Lab Exercis…☆26Apr 9, 2019Updated 6 years ago
- ☆72Jun 3, 2024Updated last year
- A browser for open-data-registry: https://github.com/awslabs/open-data-registry☆42Feb 12, 2026Updated 3 weeks ago
- This Guidance helps customers design a resilient batch process application using AWS services☆18Updated this week
- In this pattern, data records are ingested and then modified with simple transformations such as field level substitutions and data enric…☆14Nov 21, 2018Updated 7 years ago