Alternatives and similar repositories for emr-on-eks

Users that are interested in emr-on-eks are comparing it to the libraries listed below

• jwplayer / sparksteps
  CLI tool to launch Spark jobs on AWS EMR
  ☆67Updated last year
• datastacktv / kubeflow-introduction
  Code examples for the Introduction to Kubeflow course
  ☆14Updated 4 years ago
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• Aiven-Labs / python-fake-data-producer-for-apache-kafka
  The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and …
  ☆86Updated last year
• dacort / modern-data-lake-storage-layers
  Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work
  ☆47Updated 3 years ago
• vincentclaes / datajob
  Build and deploy a serverless data pipeline on AWS with no effort.
  ☆111Updated 2 years ago
• malexer / pytest-spark
  pytest plugin to run the tests with support of pyspark
  ☆86Updated 2 months ago
• tomaszdudek7 / airflow_project
  scaffold of Apache Airflow executing Docker containers
  ☆86Updated 2 years ago
• kawadia / pyspark.test
  Example unit tests for Apache Spark Python scripts using the py.test framework
  ☆84Updated 9 years ago
• airflow-plugins / Getting-Started
  A Getting Started Guide for developing and using Airflow Plugins
  ☆93Updated 6 years ago
• MrPowers / ceja
  PySpark phonetic and string matching algorithms
  ☆39Updated last year
• Netflix / metaflow-tools
  Deployment tools/scripts for Metaflow!
  ☆56Updated 2 years ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆33Updated 2 years ago
• msukmanowsky / pyspark-testing
  Unit and integration testing with PySpark can be tough to figure out, let's make that easier.
  ☆23Updated 9 years ago
• MrPowers / gill
  An example PySpark project with pytest
  ☆16Updated 7 years ago
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆48Updated last year
• Flowminder / pytest-airflow
  pytest support for airflow
  ☆12Updated 4 years ago
• jrderuiter / airflow-fs
  Composable filesystem hooks and operators for Apache Airflow.
  ☆17Updated 4 years ago
• idealo / terraform-emr-pyspark
  Quickstart PySpark with Anaconda on AWS/EMR using Terraform
  ☆47Updated 7 months ago
• dominodatalab / domino-research
  Projects developed by Domino's R&D team
  ☆78Updated 3 years ago
• ronald-smith-angel / owl-data-sanitizer
  A pyspark lib to validate data quality
  ☆18Updated 2 years ago
• quiltdata / t4
  T4 is now in production as Quilt 3
  ☆64Updated 6 years ago
• bryanyang0528 / ksql-python
  A python wrapper for the KSQL REST API.
  ☆158Updated 2 years ago
• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆95Updated 4 years ago
• zero323 / pyspark-asyncactions
  Asynchronous actions for PySpark
  ☆47Updated 3 years ago
• elyra-ai / airflow-notebook
  This repository is no longer maintained.
  ☆15Updated 3 years ago
• mozilla / emr-bootstrap-spark
  AWS bootstrap scripts for Mozilla's flavoured Spark setup.
  ☆47Updated 5 years ago
• jwills / de4ml
  Supporting materials/code examples for my course in data engineering for machine learning.
  ☆38Updated 2 years ago
• godatadriven / airflow-training-skeleton
  Skeleton project for Apache Airflow training participants to work on.
  ☆17Updated 5 years ago
• PowerDataHub / terraform-aws-airflow
  Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker…
  ☆84Updated 2 years ago