Alternatives and similar repositories for big-data-on-k8s

Users that are interested in big-data-on-k8s are comparing it to the libraries listed below

• luanmorenomaciel / de-apache-spark
  Data Engineering com Apache Spark
  ☆42Updated 4 years ago
• Guilherme-Silveira / bigdata-docker
  ☆23Updated 2 years ago
• carlosbtech / deltalake-architecture
  ☆17Updated last year
• A3Data / pyspark-notebook-helm
  This repo provides the Kubernetes Helm chart for deploying Pyspark Notebook.
  ☆17Updated 2 years ago
• Guilherme-Silveira / bigdata-k8s
  ☆62Updated last year
• engenharia-de-dados / dataeng
  ☆40Updated last year
• otacilio-psf / spark-dev-env-docker
  Spark development environment for kubernetes, spark-submit and jupyter notebook
  ☆19Updated 3 years ago
• camposvinicius / aws-etl
  This is an ETL application on AWS with general open sales and customer data that you can find here: https://github.com/camposvinicius/dat…
  ☆18Updated 3 years ago
• ROM-mm / spark-setup
  Instalador autonomo do Apache Spark para Sistemas linux: based(Debian,RHEL)
  ☆13Updated 9 months ago
• andresionek91 / bootcamp-engenharia-de-dados
  ☆71Updated 2 years ago
• raizen-analytics / data-engineering-test
  ☆24Updated last year
• rogeriomm / labtools-k8s
  Complete data engineering pipeline running on Minikube Kubernetes, Argo CD, Spark, Trino, S3, Delta lake, Postgres+ Debezium CDC, MySQL,…
  ☆29Updated 4 months ago
• ifood / ifood-data-engineering-test
  ☆23Updated 4 years ago
• anneglienke / challenge_DE_Germany_2022Q1
  This repository contains a Python script that pulls market sentiment data from SentiCrypt API and push it to Stitch Import API.
  ☆34Updated 2 years ago
• carlosbtech / owshq-live-70-lakehouse-with-glue
  ☆36Updated 3 years ago
• TeoMeWhy / gc-bricks
  ☆44Updated 3 years ago
• neylsoncrepalde / kafka-exercise
  An exercise running Kafka, Kafka Connect, PostgreSQL, Superset and AWS S3
  ☆21Updated 4 years ago
• andresionek91 / Criando-Lambda-Functions-para-Ingerir-Dados-de-APIs
  Criando Lambda Functions para Ingerir Dados de APIs com AWS CDK
  ☆13Updated 3 years ago
• nickrvieira / docker-spark-datahackers
  ☆33Updated 4 years ago
• garystafford / tickit-data-lake-demo
  Resources for video demonstrations and blog posts related to DataOps on AWS
  ☆182Updated 3 years ago
• cassiobolba / Python
  Repository to place/show my python apps
  ☆20Updated 3 years ago
• fabiogjardim / mds
  Modern Data Stack
  ☆62Updated last month
• andresionek91 / airflow-autoscaling-ecs
  Airflow Deployment on AWS ECS Fargate Using Cloudformation
  ☆204Updated 3 years ago
• alanceloth / Retail_Data_Pipeline
  Retail data pipeline using Airflow, Dbt, Soda, GCP (GCS and BigQuery) and Metabase
  ☆38Updated last year
• fabiogjardim / bigdata_docker
  Big Data Ecosystem Docker
  ☆423Updated 2 years ago
• anneglienke / 101_upsert-delta
  This repository exemplifies a simple ELT process using delta to perform upsert and remove data files that aren't in the latest state of t…
  ☆106Updated 3 years ago
• neylsoncrepalde / edc-mod1-exercise-igti
  Exercícios do módulo 1 - Bootcamp EDC - IGTI 2021
  ☆49Updated 2 years ago
• andresionek91 / bootcamp-turma-6
  Conteúdo das aulas da turma 6 do bootcamp de engenharia de dados da How
  ☆12Updated 4 years ago
• oliveiraJessica / workshop-spark
  Código para workshops Spark com ambiente de desenvolvimento em docker
  ☆27Updated 3 years ago
• tiagotxm / yt-spark-no-kubernetes
  ☆13Updated 7 months ago