Alternatives and similar repositories for airflow-spark-operator-plugin

Users that are interested in airflow-spark-operator-plugin are comparing it to the libraries listed below

• yamrcraft / etl-light
  A light Kafka to HDFS/S3 ETL library based on Apache Spark
  ☆41Updated 7 years ago
• TIBCOSoftware / snappy-on-k8s
  An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes
  ☆83Updated 5 years ago
• teamclairvoyant / airflow-user-management-plugin
  A plugin for Apache Airflow that allows you to manage the users that can login
  ☆14Updated 5 years ago
• cloudera-labs / envelope
  Build configuration-driven ETL pipelines on Apache Spark
  ☆159Updated 2 years ago
• bmc / spark-hive-udf
  Example project showing how to use Hive UDFs in Apache Spark
  ☆55Updated 6 years ago
• airbnb / sputnik
  ☆63Updated 5 years ago
• holdenk / spark-structured-streaming-ml
  Structured Streaming Machine Learning example with Spark 2.0
  ☆92Updated 8 years ago
• palantir / spark-influx-sink
  A Spark metrics sink that pushes to InfluxDb
  ☆51Updated 4 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆71Updated 5 years ago
• ansrivas / spark-structured-streaming
  Spark structured streaming with Kafka data source and writing to Cassandra
  ☆62Updated 5 years ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆88Updated last year
• agile-lab-dev / DataQuality
  DataQuality for BigData
  ☆144Updated last year
• shivajid / atlas
  This repository is to help with the Partner Demonstration of the Apache Atlas project.
  ☆30Updated 9 years ago
• XavientInformationSystems / Data-Ingestion-Platform
  ☆49Updated 5 years ago
• bolcom / hive_compared_bq
  hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.
  ☆28Updated 7 years ago
• hortonworks-spark / spark-llap
  ☆103Updated 5 years ago
• miho120 / ambari-airflow-mpack
  Ambari stack service for installing and managing Apache Airflow on HDP cluster
  ☆59Updated 6 years ago
• alvinj / ScalaApacheAccessLogParser
  An Apache access log parser written in Scala
  ☆72Updated 4 years ago
• maropu / spark-sql-server
  Yet Another Spark SQL JDBC/ODBC server based on the PostgreSQL V3 protocol
  ☆34Updated 2 years ago
• polomarcus / Spark-Structured-Streaming-Examples
  Spark Structured Streaming / Kafka / Cassandra / Elastic
  ☆183Updated 2 years ago
• hortonworks / streamline
  StreamLine - Streaming Analytics
  ☆164Updated last year
• mayur2810 / sope
  Apache Spark ETL Utilities
  ☆40Updated 8 months ago
• phatak-dev / kubernetes-spark
  Docker Image and Kubernetes Configurations for Spark 2.x
  ☆41Updated 5 years ago
• banzaicloud / spark-metrics
  Spark metrics related custom classes and sinks (e.g. Prometheus)
  ☆183Updated 2 years ago
• KeithSSmith / spark-compaction
  File compaction tool that runs on top of the Spark framework.
  ☆59Updated 6 years ago
• Neuw84 / structured-streaming-avro-demo
  Spark 3.0.0 Structured Streaming Kafka Avro Demo
  ☆15Updated 2 years ago
• SharpRay / spark-druid-connector
  A library for querying Druid data sources with Apache Spark
  ☆23Updated 4 years ago
• teamclairvoyant / airflow-scheduler-failover-controller
  A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability
  ☆235Updated 2 years ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• hortonworks-spark / cloud-integration
  Spark cloud integration: tests, cloud committers and more
  ☆19Updated 4 months ago