Alternatives and similar repositories for emr-on-eks

Users that are interested in emr-on-eks are comparing it to the libraries listed below

• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• datastacktv / kubeflow-introduction
  Code examples for the Introduction to Kubeflow course
  ☆14Updated 4 years ago
• richardanaya / spark_delta_lake
  ☆16Updated 5 years ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆33Updated 2 years ago
• jwplayer / sparksteps
  CLI tool to launch Spark jobs on AWS EMR
  ☆67Updated last year
• tomaszdudek7 / airflow_project
  scaffold of Apache Airflow executing Docker containers
  ☆86Updated 2 years ago
• tikal-fuseday / delta-architecture
  Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline
  ☆75Updated 2 years ago
• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆96Updated 4 years ago
• stwind / airflow-on-kubernetes
  Bare minimal Airflow on Kubernetes (Local, EKS, AKS)
  ☆53Updated 5 years ago
• zero323 / pyspark-asyncactions
  Asynchronous actions for PySpark
  ☆47Updated 3 years ago
• airflow-plugins / Getting-Started
  A Getting Started Guide for developing and using Airflow Plugins
  ☆93Updated 6 years ago
• jrderuiter / airflow-fs
  Composable filesystem hooks and operators for Apache Airflow.
  ☆17Updated 4 years ago
• Flowminder / pytest-airflow
  pytest support for airflow
  ☆12Updated 4 years ago
• mfcabrera / hooqu
  hooqu is a library built on top of Pandas-like Dataframes for defining "unit tests for data". This is a spiritual port of Apache Deequ to…
  ☆29Updated 10 months ago
• tubular / sparkly
  Helpers & syntactic sugar for PySpark.
  ☆62Updated 2 years ago
• godatadriven / airflow-training-skeleton
  Skeleton project for Apache Airflow training participants to work on.
  ☆17Updated 5 years ago
• idealo / terraform-emr-pyspark
  Quickstart PySpark with Anaconda on AWS/EMR using Terraform
  ☆47Updated 9 months ago
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆48Updated last year
• vincentclaes / datajob
  Build and deploy a serverless data pipeline on AWS with no effort.
  ☆111Updated 2 years ago
• michaelosthege / fairflow
  Functional Airflow DAG definitions.
  ☆38Updated 8 years ago
• aws-samples / amazon-kinesis-analytics-streaming-etl
  Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics
  ☆65Updated last year
• tokern / lakecli
  A CLI to manage and monitor permissions in AWS Lake Formation
  ☆25Updated 2 years ago
• dacort / modern-data-lake-storage-layers
  Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work
  ☆47Updated 3 years ago
• Aiven-Labs / python-fake-data-producer-for-apache-kafka
  The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and …
  ☆85Updated last year
• dask-contrib / dask-snowflake
  Dask integration for Snowflake
  ☆30Updated 2 months ago
• garystafford / emr-demo
  Project files for the post: Running PySpark Applications on Amazon EMR: Methods for Interacting with PySpark on Amazon Elastic MapReduce.
  ☆38Updated 3 years ago
• MrPowers / gill
  An example PySpark project with pytest
  ☆17Updated 8 years ago
• astronomer / airflow-testing-guide
  ☆23Updated 4 years ago
• malexer / pytest-spark
  pytest plugin to run the tests with support of pyspark
  ☆87Updated 4 months ago
• MrPowers / bebe
  Filling in the Spark function gaps across APIs
  ☆50Updated 4 years ago