Alternatives and similar repositories for k8s-big-data-experiments:

Users that are interested in k8s-big-data-experiments are comparing it to the libraries listed below

• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• snowplow / snowplow-scala-analytics-sdk
  Scala SDK for working with Snowplow enriched events in Spark, AWS Lambda, Flink et al.
  ☆20Updated 4 months ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆58Updated last year
• JahstreetOrg / spark-on-kubernetes-docker
  Spark on Kubernetes infrastructure Docker images repo
  ☆37Updated 2 years ago
• GoogleCloudDataproc / spark-spanner-connector
  Cloud Spanner Connector for Apache Spark
  ☆17Updated 2 months ago
• palantir / spark-influx-sink
  A Spark metrics sink that pushes to InfluxDb
  ☆51Updated 4 years ago
• gwenshap / flask-and-kafka
  ☆10Updated 6 years ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 5 years ago
• cloudera / dbt-spark-livy
  The dbt-spark-livy adapter allows you to use dbt along with Apache Spark, by connecting via Apache Livy
  ☆12Updated last year
• joerg-schneider / airtunnel
  The sane way of building a data layer in Airflow
  ☆24Updated 5 years ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆33Updated 2 years ago
• bolcom / hive_compared_bq
  hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.
  ☆28Updated 7 years ago
• gtoonstra / databook
  A facebook for data
  ☆26Updated 5 years ago
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆30Updated 4 months ago
• maropu / spark-data-repair-plugin
  Provide functionality to build statistical models to repair dirty tabular data in Spark
  ☆12Updated last year
• holdenk / high-performance-spark-examples
  Examples for High Performance Spark
  ☆15Updated 4 months ago
• PBWebMedia / airflow-prometheus-exporter
  Export Airflow metrics (from mysql) in prometheus format
  ☆29Updated last month
• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆93Updated 4 years ago
• berngp / mesos-spark-docker
  Document and showcase how you can create Spark Applications which run inside Docker Containers using Apache Mesos.
  ☆28Updated 9 years ago
• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆61Updated 6 months ago
• nikkatalnikov / bigkube
  Minikube for big data with Scala and Spark
  ☆15Updated 5 years ago
• ZuInnoTe / spark-hadoopoffice-ds
  A Spark datasource for the HadoopOffice library
  ☆38Updated 2 years ago
• hbutani / spark-datetime
  functionstest
  ☆33Updated 8 years ago
• ronald-smith-angel / owl-data-sanitizer
  A pyspark lib to validate data quality
  ☆18Updated 2 years ago
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆73Updated 5 years ago
• criteo / cluster-pack
  A library on top of either pex or conda-pack to make your Python code easily available on a cluster
  ☆45Updated 3 months ago
• airbnb / sputnik
  ☆63Updated 5 years ago
• acroz / pylivy
  A Python client for Apache Livy, enabling use of remote Apache Spark clusters.
  ☆70Updated 3 years ago
• Wikia / discreETLy
  ETLy is an add-on dashboard service on top of Apache Airflow.
  ☆69Updated last year
• FINRAOS / MegaSparkDiff
  A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…
  ☆50Updated last year