Alternatives and similar repositories for spark-on-k8s:

Users that are interested in spark-on-k8s are comparing it to the libraries listed below

• carlosbtech / deltalake-architecture
  ☆15Updated 10 months ago
• Guilherme-Silveira / bigdata-docker
  ☆23Updated last year
• rogeriomm / labtools-k8s
  Complete data engineering pipeline running on Minikube Kubernetes, Argo CD, Spark, Trino, S3, Delta lake, Postgres+ Debezium CDC, MySQL,…
  ☆28Updated last month
• A3Data / pyspark-notebook-helm
  This repo provides the Kubernetes Helm chart for deploying Pyspark Notebook.
  ☆17Updated 2 years ago
• luanmorenomaciel / big-data-on-k8s
  ☆22Updated 3 years ago
• andresionek91 / airflow-fargate-cdk
  Deploy of Airflow 2.0 using ECS Fargate and AWS CDK.
  ☆14Updated 3 years ago
• luanmorenomaciel / de-apache-spark
  Data Engineering com Apache Spark
  ☆43Updated 3 years ago
• camposvinicius / aws-etl
  This is an ETL application on AWS with general open sales and customer data that you can find here: https://github.com/camposvinicius/dat…
  ☆17Updated 3 years ago
• raizen-analytics / data-engineering-test
  ☆23Updated last year
• Guilherme-Silveira / bigdata-k8s
  ☆61Updated 11 months ago
• ROM-mm / spark-setup
  Instalador autonomo do Apache Spark para Sistemas linux: based(Debian,RHEL)
  ☆13Updated 2 months ago
• otacilio-psf / spark-dev-env-docker
  Spark development environment for kubernetes, spark-submit and jupyter notebook
  ☆19Updated 3 years ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆74Updated last year
• webysther / aws-glue-docker
  🐋 Docker image for AWS Glue Spark/Python
  ☆23Updated last year
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆46Updated 2 years ago
• astronomer / airflow-example-dags
  Sample Airflow DAGs
  ☆62Updated 2 years ago
• himewel / cartolafc
  Football scouts from Cartola FC at a data lake with data warehouse and dashboard
  ☆17Updated 2 years ago
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆63Updated 2 years ago
• sarahmk125 / airflow-docker-metrics
  ☆43Updated 2 years ago
• neylsoncrepalde / docker-airflow
  Docker Apache Airflow
  ☆31Updated 3 years ago
• panovvv / hadoop-hive-spark-docker
  Base Docker image with just essentials: Hadoop, Hive and Spark.
  ☆68Updated 4 years ago
• brianamaral / covid-news
  A data engineering personal project for applying some of my skills
  ☆19Updated 3 years ago
• amommendes / helm-hive-metastore
  ☆40Updated 4 years ago
• fabiogjardim / bigdata_docker
  Big Data Ecosystem Docker
  ☆402Updated last year
• tiagotxm / yt-spark-no-kubernetes
  ☆10Updated this week
• ifood / ifood-data-engineering-test
  ☆20Updated 3 years ago
• danilo-ml / airflow
  ☆15Updated last month
• quintoandar / hive-metastore-client
  A client for connecting and running DDLs on hive metastore.
  ☆55Updated 11 months ago
• engenharia-de-dados / dataeng
  ☆37Updated 6 months ago
• neylsoncrepalde / kafka-exercise
  An exercise running Kafka, Kafka Connect, PostgreSQL, Superset and AWS S3
  ☆21Updated 3 years ago