testdrivenio / spark-docker-swarm
running apache spark with docker swarm
☆34Updated 4 years ago
Alternatives and similar repositories for spark-docker-swarm:
Users that are interested in spark-docker-swarm are comparing it to the libraries listed below
- A Spark cluster setup running on Docker containers☆60Updated 5 years ago
- Apache Spark docker container image (Standalone mode)☆35Updated 4 years ago
- spark on kubernetes☆105Updated 2 years ago
- A Spark metrics sink that pushes to InfluxDb☆51Updated 4 years ago
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 5 years ago
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆174Updated last year
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆82Updated 5 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 5 years ago
- Spark and Hive docker containers sharing a common MySQL metastore☆26Updated 4 years ago
- Ambari stack service for installing and managing Apache Airflow on HDP cluster☆59Updated 6 years ago
- Example for an airflow plugin☆49Updated 8 years ago
- Spark on Kubernetes infrastructure Docker images repo☆37Updated 2 years ago
- Data validation library for PySpark 3.0.0☆33Updated 2 years ago
- Minikube for big data with Scala and Spark☆15Updated 5 years ago
- Docker image to submit Spark applications☆38Updated 7 years ago
- Airflow workflow management platform chef cookbook.☆71Updated 5 years ago
- Spark functions to run popular phonetic and string matching algorithms☆60Updated 3 years ago
- Real-world Spark pipelines examples☆83Updated 7 years ago
- pyspark-cassandra is a Python port of the awesome @datastax Spark Cassandra connector. Compatible w/ Spark 2.0, 2.1, 2.2, 2.3 and 2.4☆69Updated 5 months ago
- ☆72Updated 4 years ago
- JSON schema parser for Apache Spark☆81Updated 2 years ago
- File compaction tool that runs on top of the Spark framework.☆59Updated 5 years ago
- docker for apache-atlas embedded-cassandra-solr☆23Updated 5 years ago
- Spark with Scala example projects☆34Updated 5 years ago
- Spark + HDFS cluster using docker compose☆47Updated 6 years ago
- 🚚 ETL for Spark and Airflow☆25Updated 7 years ago
- Vagrant project to spin up a single node VM running current versions of Hadoop, Hive and Spark☆67Updated 3 years ago
- ☆32Updated 7 years ago
- Deploy your Spark Production Cluster on Kubernetes☆47Updated 4 years ago
- Dockerized Hadoop/Minio/Hive/Presto stack☆37Updated last year