aws-solutions-library-samples / data-lakes-on-aws
Enterprise-grade, production-hardened, serverless data lake on AWS
☆449Updated last month
Alternatives and similar repositories for data-lakes-on-aws:
Users that are interested in data-lakes-on-aws are comparing it to the libraries listed below
- An open source development framework to help you build data workflows and modern data architecture on AWS.☆263Updated 2 weeks ago
- A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficie…☆241Updated 2 weeks ago
- A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.☆340Updated last year
- Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the…☆243Updated this week
- The open source version of the AWS Glue docs. You can submit feedback & requests for changes by submitting issues in this repo or by maki…☆198Updated last year
- ☆88Updated last year
- ☆158Updated last year
- ☆73Updated 11 months ago
- An open-source framework that simplifies implementation of data solutions.☆131Updated this week
- Data Lake as Code, featuring ChEMBL and OpenTargets☆170Updated last year
- AWS Glue Libraries are additions and enhancements to Spark for ETL operations.☆671Updated last year
- ☆18Updated 3 years ago
- A deployable reference implementation intended to address pain points around conceptualizing data lake architectures that automatically c…☆401Updated 11 months ago
- Lab Instructions for Data Engineering Immersion Day☆189Updated 2 months ago
- Example code for running Spark and Hive jobs on EMR Serverless.☆163Updated 3 months ago
- ☆74Updated last year
- A Data Platform built for AWS, powered by Kubernetes.☆148Updated last year
- This repository contains the dbt-glue adapter☆116Updated 2 weeks ago
- This solution helps you deploy Data Lake Infrastructure on AWS using CDK Pipelines.☆94Updated 2 years ago
- The Amazon Athena Query Federation SDK allows you to customize Amazon Athena with your own data sources and code.☆576Updated this week
- AWS Step Functions is an orchestration service for reliably executing multi-step processes using visual workflows. This repository includ…☆247Updated 5 months ago
- Amazon Managed Workflows for Apache Airflow (MWAA) Examples repository contains example DAGs, requirements.txt, plugins, and CloudFormati…☆115Updated 5 months ago
- ☆73Updated last year
- A best practices guide for using AWS EMR. The guide will cover best practices on the topics of cost, performance, security, operational e…☆106Updated last month
- Step Functions Data Science SDK for building machine learning (ML) workflows and pipelines on AWS☆290Updated 2 weeks ago
- A workshop demonstrating the capabilities of S3, Athena, Glue, Kinesis, and Quicksight.☆157Updated 5 years ago
- A UI that simplifies testing with Amazon Kinesis Streams and Firehose. Create and save record templates, and easily send data to Amazon K…☆206Updated 6 months ago
- Automated data quality suggestions and analysis with Deequ on AWS Glue☆84Updated 2 years ago
- A packaged Data Lake solution, that builds a highly functional Data Lake, with a data catalog queryable via Elasticsearch☆73Updated 4 years ago
- Step Functions Workflows. Learn more at the website: https://serverlessland.com/workflows.☆246Updated 2 months ago