garystafford / emr-demo

Related projects ⓘ

Alternatives and complementary repositories for emr-demo

• dacort / modern-data-lake-storage-layers
  Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work
  ☆47Updated 2 years ago
• aws-samples / dbt-glue
  This repository contains the dbt-glue adapter
  ☆99Updated this week
• garystafford / tickit-data-lake-demo
  Resources for video demonstrations and blog posts related to DataOps on AWS
  ☆170Updated 2 years ago
• aws-samples / amazon-deequ-glue
  Automated data quality suggestions and analysis with Deequ on AWS Glue
  ☆83Updated last year
• garystafford / aws-airflow-demo
  Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…
  ☆41Updated 2 years ago
• soyelherein / pyspark-cicd-template
  PySpark data-pipeline testing and CICD
  ☆28Updated 4 years ago
• aws-samples / dataops-platform-airflow-dbt
  Build DataOps platform with Apache Airflow and dbt on AWS
  ☆51Updated 3 years ago
• jaehyeon-kim / dbt-on-aws
  dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats
  ☆25Updated last year
• aws-samples / emr-serverless-samples
  Example code for running Spark and Hive jobs on EMR Serverless.
  ☆151Updated 2 weeks ago
• astronomer / airflow-dbt-demo
  A repository of sample code to accompany our blog post on Airflow and dbt.
  ☆166Updated last year
• NAVEENKUMARMURUGAN / Pyspark-ETL-Framework
  ☆14Updated 5 years ago
• aws-samples / amazon-mwaa-examples
  Amazon Managed Workflows for Apache Airflow (MWAA) Examples repository contains example DAGs, requirements.txt, plugins, and CloudFormati…
  ☆106Updated last month
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆72Updated last year
• astronomer / airflow-provider-great-expectations
  Great Expectations Airflow operator
  ☆159Updated last week
• shravan-kuchkula / udacity-data-eng-proj-1
  Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…
  ☆89Updated 2 years ago
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆166Updated last year
• aws-samples / spark-on-aws-lambda
  Spark runtime on AWS Lambda
  ☆93Updated last month
• aws-samples / pyflink-getting-started
  ☆53Updated 11 months ago
• garystafford / streaming-sales-generator
  Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python
  ☆43Updated last year
• aws-samples / redshift-etl-automation-with-dbt
  ☆34Updated last year
• jamesweakley / snowflake-rbgm
  Rules based grant management for Snowflake
  ☆40Updated 5 years ago
• akashmehta10 / profiling_pyspark
  ☆25Updated last year
• aws-samples / amazon-eks-apache-spark-etl-sample
  Spark ETL example processing New York taxi rides public dataset on EKS
  ☆44Updated last year
• idealo / terraform-emr-pyspark
  Quickstart PySpark with Anaconda on AWS/EMR using Terraform
  ☆47Updated 10 months ago
• delta-io / delta-docs
  Delta Lake Documentation
  ☆46Updated 4 months ago
• mehd-io / pyspark-boilerplate-mehdio
  Pyspark boilerplate for running prod ready data pipeline
  ☆28Updated 3 years ago
• venkatra / dbt_hacks
  A bunch of hacks developed around dbt
  ☆48Updated 4 years ago
• marclamberti / airflow-eks-helm-chart
  Airflow helm chart for AWS EKS
  ☆18Updated 3 years ago
• konosp / dbt-airflow-docker-compose
  Execution of DBT models using Apache Airflow through Docker Compose
  ☆112Updated last year