Enterprise-grade, production-hardened, serverless data lake on AWS
☆481Oct 1, 2025Updated 8 months ago
Alternatives and similar repositories for data-lakes-on-aws
Users that are interested in data-lakes-on-aws are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficie…☆254Jun 9, 2026Updated last week
- An open source development framework to help you build data workflows and modern data architecture on AWS.☆271Feb 9, 2026Updated 4 months ago
- A Data Platform built for AWS, powered by Kubernetes.☆147Jul 24, 2023Updated 2 years ago
- ☆157Feb 29, 2024Updated 2 years ago
- An open-source framework that simplifies implementation of data solutions.☆146Dec 2, 2025Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This solution helps you deploy Data Lake Infrastructure on AWS using CDK Pipelines.☆101Aug 12, 2022Updated 3 years ago
- pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoD…☆4,107Updated this week
- ☆20Aug 10, 2021Updated 4 years ago
- This solution helps you deploy ETL jobs on data lake using CDK Pipelines.☆69Aug 9, 2022Updated 3 years ago
- A deployable reference implementation intended to address pain points around conceptualizing data lake architectures that automatically c…☆399Jun 3, 2024Updated 2 years ago
- Data Lake as Code, featuring ChEMBL and OpenTargets☆173Nov 20, 2023Updated 2 years ago
- ☆88Nov 6, 2023Updated 2 years ago
- A collection of examples built with AWS DataOps Development Kit (DDK)☆43Mar 23, 2026Updated 2 months ago
- AWS Glue code samples☆1,534Jun 8, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- CLI for building Docker images in SageMaker Studio using AWS CodeBuild.☆59Apr 18, 2022Updated 4 years ago
- CDK Constructs library to aid in building Datalakes on AWS☆22May 2, 2023Updated 3 years ago
- ☆16Jun 14, 2023Updated 3 years ago
- Operational Data Processing Framework developed using AWS Glue and Apache Hudi. This framework is suitable for Data Lake and Modern Data …☆24Sep 6, 2023Updated 2 years ago
- ☆22Jul 14, 2020Updated 5 years ago
- AWS Glue Libraries are additions and enhancements to Spark for ETL operations.☆699Apr 24, 2026Updated last month
- A CLI to manage and monitor permissions in AWS Lake Formation☆25Feb 8, 2023Updated 3 years ago
- Lab Instructions for Data Engineering Immersion Day☆198Jan 26, 2026Updated 4 months ago
- The Automated Data Analytics on AWS solution provides an end-to-end data platform for ingesting, transforming, managing and querying data…☆91Sep 25, 2024Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Automated data quality suggestions and analysis with Deequ on AWS Glue☆91Dec 29, 2022Updated 3 years ago
- A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.☆345Mar 29, 2024Updated 2 years ago
- ☆54Oct 3, 2023Updated 2 years ago
- Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the…☆246May 19, 2026Updated 3 weeks ago
- The aws-codeseeder project enables builders to easily "seed" python code to AWS CodeBuild for remote execution in their cloud environment…☆43Jan 12, 2026Updated 5 months ago
- ☆12Aug 9, 2024Updated last year
- ☆14Feb 26, 2024Updated 2 years ago
- 🐋 Docker image for AWS Glue Spark/Python☆23Sep 5, 2023Updated 2 years ago
- The Amazon Athena Query Federation SDK allows you to customize Amazon Athena with your own data sources and code.☆611Jun 9, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Bring your own data Labs: Build a serverless data pipeline based on your own data☆44May 22, 2023Updated 3 years ago
- A tool to learn JSON schema from collection of documents and generate Create table statement for Redshift☆22Jul 12, 2025Updated 11 months ago
- Amazon Redshift Utils contains utilities, scripts and view which are useful in a Redshift environment☆2,808Sep 3, 2025Updated 9 months ago
- ☆71May 8, 2026Updated last month
- Amazon Redshift Advanced Monitoring☆270Oct 28, 2025Updated 7 months ago
- Snapshot manager for Amazon Kinesis Data Analytics for Apache Flink helps the users to generate a snapshot on a periodic basis.☆19Aug 30, 2023Updated 2 years ago
- ☆11Oct 11, 2022Updated 3 years ago