testdrivenio / spark-docker-swarmLinks
running apache spark with docker swarm
☆34Updated 4 years ago
Alternatives and similar repositories for spark-docker-swarm
Users that are interested in spark-docker-swarm are comparing it to the libraries listed below
Sorting:
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆175Updated 8 months ago
- Docker image for Apache Spark☆76Updated 6 years ago
- Some class materials for a data processing course using PySpark☆52Updated 3 years ago
- Spark package for checking data quality☆222Updated 5 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 6 years ago
- Apache (Py)Spark type annotations (stub files).☆118Updated 3 years ago
- spark on kubernetes☆104Updated 2 years ago
- Data validation library for PySpark 3.0.0☆33Updated 3 years ago
- A Spark cluster setup running on Docker containers☆61Updated 6 years ago
- An extendable Docker image for Airbnb's Superset platform, previously known as Caravel.☆114Updated 3 years ago
- ☆69Updated 4 years ago
- Spark functions to run popular phonetic and string matching algorithms☆59Updated 3 years ago
- Real-world Spark pipelines examples☆83Updated 7 years ago
- Spark data profiling utilities☆22Updated 7 years ago
- type-class based data cleansing library for Apache Spark SQL☆78Updated 6 years ago
- Docker container for Kafka - Spark Streaming - Cassandra☆97Updated 6 years ago
- A Spark metrics sink that pushes to InfluxDb☆51Updated 5 years ago
- Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)☆184Updated 2 years ago
- pyspark-cassandra is a Python port of the awesome @datastax Spark Cassandra connector. Compatible w/ Spark 2.0, 2.1, 2.2, 2.3 and 2.4☆69Updated last year
- Spark on Kubernetes infrastructure Docker images repo☆38Updated 3 years ago
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 6 years ago
- Docker image to submit Spark applications☆38Updated 8 years ago
- One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)☆120Updated 4 years ago
- Template for Spark Projects☆103Updated last year
- These are some code examples☆56Updated 6 years ago
- Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…☆62Updated last year
- Create HTML profiling reports from Apache Spark DataFrames☆197Updated 6 years ago
- Examples of Spark 2.0☆212Updated 4 years ago
- Lightweight proxy to expose the UI of an Apache Spark cluster that is behind a firewall☆98Updated 5 years ago
- Apache Spark and Apache Kafka integration example☆124Updated 8 years ago