aws-samples / aws-mwaa-openlineageLinks
In this repository, we show how to get started with data lineage on AWS using OpenLineage. This is an AWS Cloud Development Kit project (CDK) which deploys a pre-configured demo environment for evaluating and experiencing OpenLineage firsthand.
☆13Updated 11 months ago
Alternatives and similar repositories for aws-mwaa-openlineage
Users that are interested in aws-mwaa-openlineage are comparing it to the libraries listed below
Sorting:
- ☆73Updated last year
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆51Updated last year
- Build, Test and Deploy ETL solutions using AWS Glue and AWS CDK based CI/CD pipelines☆42Updated 2 years ago
- Sample code to collect Apache Iceberg metrics for table monitoring☆28Updated 10 months ago
- Amazon Managed Workflows for Apache Airflow (MWAA) Examples repository contains example DAGs, requirements.txt, plugins, and CloudFormati…☆116Updated last week
- ☆32Updated last year
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆23Updated 10 months ago
- An open-source framework that simplifies implementation of data solutions.☆139Updated this week
- ☆158Updated last year
- A CLI to manage and monitor permissions in AWS Lake Formation☆26Updated 2 years ago
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆38Updated 5 months ago
- ☆12Updated 11 months ago
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with AWS Glue Streaming and DMS☆32Updated 5 months ago
- A collection of examples built with AWS DataOps Development Kit (DDK)☆42Updated 3 weeks ago
- A guidance that provides declarative data processing capability, and workflow orchestration automation to help your business users (such …☆29Updated last year
- Source code for the post, 'Getting Started with Data Analysis on AWS, using S3, Glue, Amazon Athena, and QuickSight'☆28Updated 4 years ago
- This solution helps you deploy ETL jobs on data lake using CDK Pipelines.☆68Updated 2 years ago
- The Automated Data Analytics on AWS solution provides an end-to-end data platform for ingesting, transforming, managing and querying data…☆89Updated 9 months ago
- This solution helps you deploy Data Lake Infrastructure on AWS using CDK Pipelines.☆93Updated 2 years ago
- A solutions that automatically configures the AWS services necessary to easily capture, store, process, and deliver streaming data. This …☆93Updated 5 months ago
- Automated data quality suggestions and analysis with Deequ on AWS Glue☆86Updated 2 years ago
- ☆11Updated 11 months ago
- ☆26Updated 11 months ago
- Spark runtime on AWS Lambda☆108Updated 9 months ago
- Example code for running Spark and Hive jobs on EMR Serverless.☆166Updated 6 months ago
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆64Updated last year
- This repository contains the dbt-glue adapter☆127Updated this week
- Best practices and recommendations for getting started with Amazon EMR on EKS.☆64Updated 3 weeks ago
- A Data Platform built for AWS, powered by Kubernetes.☆148Updated last year
- This solution helps you deploy ETL processes and data storage resources to create an Insurance Lake using Amazon S3 buckets for storage, …☆27Updated last week