Alternatives and similar repositories for airflow-spark-operator-plugin

Users that are interested in airflow-spark-operator-plugin are comparing it to the libraries listed below

• yamrcraft / etl-light
  A light Kafka to HDFS/S3 ETL library based on Apache Spark
  ☆41Updated 7 years ago
• mayur2810 / sope
  Apache Spark ETL Utilities
  ☆40Updated 7 months ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆71Updated 5 years ago
• teamclairvoyant / airflow-user-management-plugin
  A plugin for Apache Airflow that allows you to manage the users that can login
  ☆14Updated 5 years ago
• teamclairvoyant / airflow-scheduler-failover-controller
  A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability
  ☆235Updated 2 years ago
• holdenk / spark-structured-streaming-ml
  Structured Streaming Machine Learning example with Spark 2.0
  ☆92Updated 8 years ago
• dsaidgovsg / airflow-pipeline
  An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR
  ☆174Updated this week
• bmc / spark-hive-udf
  Example project showing how to use Hive UDFs in Apache Spark
  ☆55Updated 6 years ago
• airflow-plugins / airflow_api_plugin
  REST-like API exposing Airflow data and operations
  ☆61Updated 6 years ago
• bolcom / hive_compared_bq
  hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.
  ☆28Updated 7 years ago
• cloudera-labs / envelope
  Build configuration-driven ETL pipelines on Apache Spark
  ☆159Updated 2 years ago
• XavientInformationSystems / Data-Ingestion-Platform
  ☆49Updated 5 years ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆88Updated last year
• hortonworks-spark / spark-llap
  ☆103Updated 5 years ago
• cartershanklin / hive-scd-examples
  How to manage Slowly Changing Dimensions with Apache Hive
  ☆55Updated 5 years ago
• gateway-experiments / hadoop-yarn-api-python-client
  Python client for Hadoop® YARN API
  ☆109Updated 2 years ago
• airbnb / sputnik
  ☆63Updated 5 years ago
• Neuw84 / structured-streaming-avro-demo
  Spark 3.0.0 Structured Streaming Kafka Avro Demo
  ☆15Updated 2 years ago
• ansrivas / spark-structured-streaming
  Spark structured streaming with Kafka data source and writing to Cassandra
  ☆62Updated 5 years ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• KeithSSmith / spark-compaction
  File compaction tool that runs on top of the Spark framework.
  ☆59Updated 6 years ago
• werneckpaiva / spark-to-tableau
  Spark to Tableau Extractor library
  ☆18Updated 7 years ago
• mkuthan / example-spark-kafka
  Apache Spark and Apache Kafka integration example
  ☆124Updated 7 years ago
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 2 years ago
• TIBCOSoftware / snappy-on-k8s
  An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes
  ☆83Updated 5 years ago
• maropu / spark-sql-server
  Yet Another Spark SQL JDBC/ODBC server based on the PostgreSQL V3 protocol
  ☆34Updated 2 years ago
• Fokko / divolte-kafka-druid-superset
  A proof of concept using Divolte, Kafka, Druid and Superset
  ☆62Updated 5 years ago
• dataiku / dataiku-hive-udf
  A collection of Hive UDFs
  ☆75Updated 5 years ago
• mganta / sprue
  spark + drools
  ☆102Updated 3 years ago
• agile-lab-dev / DataQuality
  DataQuality for BigData
  ☆144Updated last year