Enterprise-grade, production-hardened, serverless data lake on AWS
☆484Sep 4, 2026Updated 2 months ago
Alternatives and similar repositories for data-lakes-on-aws
Users that are interested in data-lakes-on-aws are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficie…☆257Jun 21, 2026Updated 4 months ago
- An open source development framework to help you build data workflows and modern data architecture on AWS.☆270Feb 9, 2026Updated 8 months ago
- A Data Platform built for AWS, powered by Kubernetes.☆147Jul 24, 2023Updated 3 years ago
- ☆157Feb 29, 2024Updated 2 years ago
- A collection of examples built with AWS DataOps Development Kit (DDK)☆40Mar 23, 2026Updated 7 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆20Aug 10, 2021Updated 5 years ago
- An open-source framework that simplifies implementation of data solutions.☆147Dec 2, 2025Updated 11 months ago
- Data Lake as Code, featuring ChEMBL and OpenTargets☆173Nov 20, 2023Updated 2 years ago
- This solution helps you deploy Data Lake Infrastructure on AWS using CDK Pipelines.☆101Aug 12, 2022Updated 4 years ago
- CDK Constructs library to aid in building Datalakes on AWS☆22May 2, 2023Updated 3 years ago
- pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoD…☆4,121Updated this week
- A deployable reference implementation intended to address pain points around conceptualizing data lake architectures that automatically c…☆398Jun 3, 2024Updated 2 years ago
- This solution helps you deploy ETL jobs on data lake using CDK Pipelines.☆69Aug 9, 2022Updated 4 years ago
- A CLI to manage and monitor permissions in AWS Lake Formation☆26Feb 8, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- AWS Glue code samples☆1,540Updated this week
- This is a collecton of Amazon CDK projects to show how to directly ingest streaming data from Amazon Mananged Service for Apache Kafka (M…☆16Jul 28, 2026Updated 3 months ago
- ☆89Nov 6, 2023Updated 3 years ago
- AWS Glue Libraries are additions and enhancements to Spark for ETL operations.☆702Oct 30, 2026Updated last week
- ☆12Jul 24, 2026Updated 3 months ago
- Automated data quality suggestions and analysis with Deequ on AWS Glue☆94Dec 29, 2022Updated 3 years ago
- A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.☆347Mar 29, 2024Updated 2 years ago
- CLI for building Docker images in SageMaker Studio using AWS CodeBuild.☆60Apr 18, 2022Updated 4 years ago
- ☆22Jul 14, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Lab Instructions for Data Engineering Immersion Day☆200Jan 26, 2026Updated 9 months ago
- ☆54Oct 3, 2023Updated 3 years ago
- Operational Data Processing Framework developed using AWS Glue and Apache Hudi. This framework is suitable for Data Lake and Modern Data …☆23Sep 6, 2023Updated 3 years ago
- Framework to enforce long term health of your AWS Data Lake by providing visibility into operational, data quality and business metrics.☆31Aug 19, 2021Updated 5 years ago
- ☆16Jun 14, 2023Updated 3 years ago
- The aws-codeseeder project enables builders to easily "seed" python code to AWS CodeBuild for remote execution in their cloud environment…☆42Jan 12, 2026Updated 9 months ago
- ☆71May 8, 2026Updated 5 months ago
- ☆15Feb 12, 2026Updated 8 months ago
- ☆20Sep 13, 2022Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆53Oct 31, 2023Updated 3 years ago
- Replication utility for AWS Glue Data Catalog☆81Aug 8, 2024Updated 2 years ago
- In this pattern, data records are ingested and then modified with simple transformations such as field level substitutions and data enric…☆14Nov 21, 2018Updated 7 years ago
- Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the…☆248Oct 31, 2026Updated last week
- The Automated Data Analytics on AWS solution provides an end-to-end data platform for ingesting, transforming, managing and querying data…☆90Sep 25, 2024Updated 2 years ago
- Build DataOps platform with Apache Airflow and dbt on AWS☆59Jun 1, 2021Updated 5 years ago
- This Guidance demonstrates how you can extend the data governance capabilities of Amazon DataZone to other Java Database Connectivity (JD…☆13Jul 28, 2026Updated 3 months ago