Alternatives and similar repositories for airflow-spark-operator-plugin:

Users that are interested in airflow-spark-operator-plugin are comparing it to the libraries listed below

• yamrcraft / etl-light
  A light Kafka to HDFS/S3 ETL library based on Apache Spark
  ☆41Updated 7 years ago
• palantir / spark-influx-sink
  A Spark metrics sink that pushes to InfluxDb
  ☆51Updated 4 years ago
• airflow-plugins / airflow_api_plugin
  REST-like API exposing Airflow data and operations
  ☆61Updated 6 years ago
• teamclairvoyant / airflow-user-management-plugin
  A plugin for Apache Airflow that allows you to manage the users that can login
  ☆14Updated 5 years ago
• hortonworks-spark / spark-llap
  ☆102Updated 5 years ago
• mayur2810 / sope
  Apache Spark ETL Utilities
  ☆40Updated 5 months ago
• agile-lab-dev / DataQuality
  DataQuality for BigData
  ☆144Updated last year
• bolcom / hive_compared_bq
  hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.
  ☆28Updated 7 years ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• ansrivas / spark-structured-streaming
  Spark structured streaming with Kafka data source and writing to Cassandra
  ☆62Updated 5 years ago
• Neuw84 / structured-streaming-avro-demo
  Spark 3.0.0 Structured Streaming Kafka Avro Demo
  ☆15Updated last year
• qubole / presto-udfs
  Plugin for Presto to allow addition of user functions easily
  ☆117Updated 4 years ago
• mkuthan / example-spark-kafka
  Apache Spark and Apache Kafka integration example
  ☆124Updated 7 years ago
• dsaidgovsg / airflow-pipeline
  An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR
  ☆174Updated last year
• holdenk / spark-structured-streaming-ml
  Structured Streaming Machine Learning example with Spark 2.0
  ☆92Updated 7 years ago
• Talend / beam-samples
  ☆81Updated last year
• KeithSSmith / spark-compaction
  File compaction tool that runs on top of the Spark framework.
  ☆59Updated 5 years ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆88Updated last year
• cloudera-labs / envelope
  Build configuration-driven ETL pipelines on Apache Spark
  ☆159Updated 2 years ago
• XavientInformationSystems / Data-Ingestion-Platform
  ☆49Updated 5 years ago
• Lewuathe / docker-trino-cluster
  Multiple node presto cluster on docker container
  ☆124Updated 2 years ago
• banzaicloud / spark-metrics
  Spark metrics related custom classes and sinks (e.g. Prometheus)
  ☆180Updated 2 years ago
• snowplow-archive / spark-streaming-example-project
  A Spark Streaming job reading events from Amazon Kinesis and writing event counts to DynamoDB
  ☆94Updated 4 years ago
• sourav-mazumder / Data-Science-Extensions
  ☆72Updated 4 years ago
• egen / spark-sftp
  Spark connector for SFTP
  ☆100Updated 2 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 4 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆71Updated 5 years ago
• teamclairvoyant / airflow-scheduler-failover-controller
  A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability
  ☆233Updated 2 years ago
• markgrover / spark-secure-kafka-app
  Sample Spark Streaming application for secure consumption from Kafka
  ☆33Updated 7 years ago
• jaceklaskowski / spark-streaming-notebook
  Notes about Spark Streaming in Apache Spark
  ☆59Updated 8 years ago