Renien / docker-spark-livy

Related projects ⓘ

Alternatives and complementary repositories for docker-spark-livy

• dsynkov / spark-livy-on-airflow-workspace
  A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.
  ☆39Updated 3 years ago
• NAVEENKUMARMURUGAN / Pyspark-ETL-Framework
  ☆14Updated 5 years ago
• Wittline / apache-spark-docker
  Dockerizing an Apache Spark Standalone Cluster
  ☆43Updated 2 years ago
• indiacloudtv / structuredstreamingkafkapyspark
  Apche Spark Structured Streaming with Kafka using Python(PySpark)
  ☆41Updated 5 years ago
• dsaidgovsg / airflow-pipeline
  An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR
  ☆172Updated 11 months ago
• cartershanklin / hive-scd-examples
  How to manage Slowly Changing Dimensions with Apache Hive
  ☆55Updated 5 years ago
• sylvesterdj / LearningScala
  ☆11Updated 5 years ago
• panovvv / bigdata-docker-compose
  Hadoop, Hive, Spark, Zeppelin and Livy: all in one Docker-compose file.
  ☆161Updated 3 years ago
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆257Updated last month
• sdesilva26 / docker-spark
  Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines
  ☆123Updated 2 years ago
• PierreKieffer / docker-spark-yarn-cluster
  Docker multi-nodes Hadoop cluster with Spark 2.4.1 on Yarn
  ☆50Updated 3 years ago
• josephmachado / spark_submit_airflow
  Simple repo to demonstrate how to submit a spark job to EMR from Airflow
  ☆32Updated 4 years ago
• ekampf / PySpark-Boilerplate
  A boilerplate for writing PySpark Jobs
  ☆393Updated 9 months ago
• YotpoLtd / metorikku
  A simplified, lightweight ETL Framework based on Apache Spark
  ☆584Updated 9 months ago
• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆244Updated last year
• LearningJournal / SparkProgrammingInScala
  Apache Spark Course Material
  ☆85Updated last year
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆111Updated 2 months ago
• akashmehta10 / cdc_pyspark_hive
  ☆22Updated last year
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆53Updated last year
• teamclairvoyant / apache-airflow-cloudera-csd
  CSD for Apache Airflow
  ☆20Updated 5 years ago
• TomLous / medium-spark-k8s
  Spark on Kubernetes using Helm
  ☆34Updated 4 years ago
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆178Updated 11 months ago
• rockthejvm / spark-optimization
  The official repository for the Rock the JVM Spark Optimization with Scala course
  ☆55Updated 11 months ago
• Wittline / docker-livy
  Dockerizing and Consuming an Apache Livy environment
  ☆11Updated 2 years ago
• agile-lab-dev / DataQuality
  DataQuality for BigData
  ☆141Updated 10 months ago
• sparkbyexamples / spark-examples
  Spark Examples
  ☆123Updated 2 years ago
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆96Updated last year