Alternatives and similar repositories for big-data-on-k8s

Users that are interested in big-data-on-k8s are comparing it to the libraries listed below

• luanmorenomaciel / de-apache-spark
  Data Engineering com Apache Spark
  ☆42Updated 4 years ago
• carlosbtech / deltalake-architecture
  ☆17Updated last year
• Guilherme-Silveira / bigdata-docker
  ☆23Updated 2 years ago
• engenharia-de-dados / dataeng
  ☆40Updated last year
• Guilherme-Silveira / bigdata-k8s
  ☆60Updated last year
• A3Data / pyspark-notebook-helm
  This repo provides the Kubernetes Helm chart for deploying Pyspark Notebook.
  ☆17Updated 2 years ago
• otacilio-psf / spark-dev-env-docker
  Spark development environment for kubernetes, spark-submit and jupyter notebook
  ☆19Updated 3 years ago
• andresionek91 / bootcamp-engenharia-de-dados
  ☆71Updated 2 years ago
• carlosbtech / owshq-live-70-lakehouse-with-glue
  ☆36Updated 3 years ago
• camposvinicius / aws-etl
  This is an ETL application on AWS with general open sales and customer data that you can find here: https://github.com/camposvinicius/dat…
  ☆18Updated 3 years ago
• ROM-mm / spark-setup
  Instalador autonomo do Apache Spark para Sistemas linux: based(Debian,RHEL)
  ☆13Updated 9 months ago
• TeoMeWhy / gc-bricks
  ☆43Updated 3 years ago
• raizen-analytics / data-engineering-test
  ☆24Updated last year
• ifood / ifood-data-engineering-test
  ☆23Updated 4 years ago
• rogeriomm / labtools-k8s
  Complete data engineering pipeline running on Minikube Kubernetes, Argo CD, Spark, Trino, S3, Delta lake, Postgres+ Debezium CDC, MySQL,…
  ☆28Updated 4 months ago
• gbieul / spyrk-cluster
  Spyrk-cluster is a data mini-lab, considering the main technologies used these days. It's useful to either understand how to configure a …
  ☆29Updated 4 years ago
• fabiogjardim / mds
  Modern Data Stack
  ☆62Updated 2 months ago
• anneglienke / 101_upsert-delta
  This repository exemplifies a simple ELT process using delta to perform upsert and remove data files that aren't in the latest state of t…
  ☆107Updated 3 years ago
• nickrvieira / docker-spark-datahackers
  ☆33Updated 4 years ago
• pltoledo / edc-mod3-igti
  ☆18Updated 4 years ago
• cassiobolba / Python
  Repository to place/show my python apps
  ☆20Updated 3 years ago
• neylsoncrepalde / kafka-exercise
  An exercise running Kafka, Kafka Connect, PostgreSQL, Superset and AWS S3
  ☆21Updated 4 years ago
• alanceloth / Retail_Data_Pipeline
  Retail data pipeline using Airflow, Dbt, Soda, GCP (GCS and BigQuery) and Metabase
  ☆38Updated last year
• A3Data / rony
  Data Engineering made simple - An opinionated Data Engineering framework
  ☆65Updated last year
• andresionek91 / IngestaoMercadoBitcoin
  Script para ingestão de dados do Mercado Bitcoin
  ☆11Updated 2 years ago
• andresionek91 / Criando-Lambda-Functions-para-Ingerir-Dados-de-APIs
  Criando Lambda Functions para Ingerir Dados de APIs com AWS CDK
  ☆13Updated 3 years ago
• camposvinicius / gcp-etl
  This is a pipeline of an ETL application in GCP with open airport code data, which you can find here: https://datahub.io/core/airport-cod…
  ☆14Updated 3 years ago
• TeoMeWhy / lago-mago
  Projeto de construção de datalake do zero
  ☆100Updated last year
• andresionek91 / airflow-autoscaling-ecs
  Airflow Deployment on AWS ECS Fargate Using Cloudformation
  ☆204Updated 3 years ago
• atgmello / engenharia-dados-aceleracao
  Notas das aulas da Aceleração Dev #4 da DIO sobre Engenharia de Dados, ministrado pela Everis.
  ☆13Updated 4 years ago