testdrivenio / spark-docker-swarm

Related projects: ⓘ

• tashoyan / docker-spark-submit
  Docker image to submit Spark applications
  ☆38Updated 6 years ago
• dsaidgovsg / airflow-pipeline
  An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR
  ☆171Updated 10 months ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆34Updated last year
• johannestang / bigdata_stack
  Dockerized Hadoop/Minio/Hive/Presto stack
  ☆35Updated 6 months ago
• mayur2810 / sope
  Apache Spark ETL Utilities
  ☆40Updated last year
• databricks / drunken-data-quality-1
  Spark package for checking data quality
  ☆25Updated last year
• actionml / docker-spark
  Apache Spark docker container image (Standalone mode)
  ☆36Updated 3 years ago
• cartershanklin / hive-scd-examples
  How to manage Slowly Changing Dimensions with Apache Hive
  ☆55Updated 5 years ago
• nikkatalnikov / bigkube
  Minikube for big data with Scala and Spark
  ☆15Updated 4 years ago
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆75Updated 5 years ago
• FINRAOS / MegaSparkDiff
  A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…
  ☆49Updated 8 months ago
• flaminem / docker-hive-spark
  A docker image with a pre-configured Hive Metastore and a Spark ThriftServer
  ☆18Updated 4 years ago
• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆60Updated 2 weeks ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆79Updated 5 years ago
• testdrivenio / spark-kubernetes
  spark on kubernetes
  ☆105Updated last year
• ZuInnoTe / spark-hadoopoffice-ds
  A Spark datasource for the HadoopOffice library
  ☆39Updated last year
• palantir / spark-influx-sink
  A Spark metrics sink that pushes to InfluxDb
  ☆51Updated 3 years ago
• rubenafo / docker-spark-cluster
  A Spark cluster setup running on Docker containers
  ☆60Updated 4 years ago
• big-data-europe / app-bde-pipeline
  Bootstrap a pipeline on the BDE platform
  ☆26Updated 8 years ago
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 2 years ago
• Yannael / kafka-sparkstreaming-cassandra
  Docker container for Kafka - Spark Streaming - Cassandra
  ☆98Updated 5 years ago
• luisbelloch / data_processing_course
  Some class materials for a data processing course using PySpark
  ☆51Updated last year
• awesome-spark / learn-by-examples
  Real-world Spark pipelines examples
  ☆83Updated 6 years ago
• gtoonstra / databook
  A facebook for data
  ☆26Updated 5 years ago
• dmatrix / examples
  These are some code examples
  ☆55Updated 4 years ago
• MrPowers / bebe
  Filling in the Spark function gaps across APIs
  ☆50Updated 3 years ago
• MrPowers / spark-stringmetric
  Spark functions to run popular phonetic and string matching algorithms
  ☆58Updated 2 years ago
• teamclairvoyant / apache-airflow-cloudera-csd
  CSD for Apache Airflow
  ☆20Updated 5 years ago
• sourav-mazumder / Data-Science-Extensions
  ☆71Updated 3 years ago
• holdenk / sparkProjectTemplate.g8
  Template for Spark Projects
  ☆99Updated 3 months ago