brunocfnba / docker-spark-cluster
Set up a 3 node spark cluster using docker containers
☆34Updated 7 years ago
Alternatives and similar repositories for docker-spark-cluster:
Users that are interested in docker-spark-cluster are comparing it to the libraries listed below
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆174Updated last year
- Docker container for Kafka - Spark Streaming - Cassandra☆97Updated 5 years ago
- Demonstration of using Apache Spark to build robust ETL pipelines while taking advantage of open source, general purpose cluster computin…☆24Updated last year
- pyspark-cassandra is a Python port of the awesome @datastax Spark Cassandra connector. Compatible w/ Spark 2.0, 2.1, 2.2, 2.3 and 2.4☆69Updated 5 months ago
- ☆72Updated 4 years ago
- ☆198Updated last year
- Python API for Deequ☆41Updated 4 years ago
- Apache Spark docker container image (Standalone mode)☆35Updated 4 years ago
- Docker image for Jupyter notebooks with PySpark☆27Updated 6 years ago
- Filling in the Spark function gaps across APIs☆50Updated 3 years ago
- A Spark cluster setup running on Docker containers☆60Updated 5 years ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆53Updated last year
- Just a boilerplate for PySpark and Flask☆35Updated 6 years ago
- Examples for Deep Learning/Feature Store/Spark/Flink/Hive/Kafka jobs and Jupyter notebooks on Hops☆117Updated last year
- ☆30Updated 2 years ago
- Machine Learning Pipeline Stages for Spark (exposed in Scala/Java + Python)☆74Updated last year
- spark on kubernetes☆105Updated 2 years ago
- This project describes how to write full ETL data pipeline using spark.☆15Updated 2 years ago
- Repository used for Spark Trainings☆53Updated last year
- Dockerizing an Apache Spark Standalone Cluster☆43Updated 2 years ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆97Updated 2 years ago
- ☆63Updated 5 years ago
- Spark on Kubernetes using Helm☆34Updated 4 years ago
- A library that provides useful extensions to Apache Spark and PySpark.☆220Updated this week
- Cheatsheet for Spark DataFrame☆91Updated 5 years ago
- Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.☆75Updated 11 months ago
- Docker multi-nodes Hadoop cluster with Spark 2.4.1 on Yarn☆51Updated 4 years ago
- Spark Structured Streaming / Kafka / Cassandra / Elastic☆183Updated 2 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 5 years ago
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 5 years ago