Alternatives and similar repositories for Airflow-Demo

Users that are interested in Airflow-Demo are comparing it to the libraries listed below

• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆73Updated 5 years ago
• teamclairvoyant / airflow_demo
  Airflow script for incremental data import from Mysql to Hive using Sqoop.
  ☆18Updated 7 years ago
• yamrcraft / etl-light
  A light Kafka to HDFS/S3 ETL library based on Apache Spark
  ☆41Updated 7 years ago
• holdenk / spark-structured-streaming-ml
  Structured Streaming Machine Learning example with Spark 2.0
  ☆92Updated 8 years ago
• gateway-experiments / hadoop-yarn-api-python-client
  Python client for Hadoop® YARN API
  ☆109Updated 2 years ago
• airbnb / sputnik
  ☆63Updated 5 years ago
• jcrist / skein
  A tool and library for easily deploying applications on Apache YARN
  ☆143Updated last year
• kawadia / pyspark.test
  Example unit tests for Apache Spark Python scripts using the py.test framework
  ☆84Updated 9 years ago
• mtth / azkaban
  Lightweight Azkaban client
  ☆77Updated 5 years ago
• bolcom / hive_compared_bq
  hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.
  ☆28Updated 7 years ago
• dataiku / dataiku-hive-udf
  A collection of Hive UDFs
  ☆75Updated 5 years ago
• blue-yonder / airflow-plugin-demo
  Example for an airflow plugin
  ☆49Updated 8 years ago
• teamclairvoyant / airflow-scheduler-failover-controller
  A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability
  ☆235Updated 2 years ago
• nexr / hive-udf
  NexR Hive UDFs
  ☆111Updated 9 years ago
• snowplow-archive / spark-streaming-example-project
  A Spark Streaming job reading events from Amazon Kinesis and writing event counts to DynamoDB
  ☆94Updated 4 years ago
• polomarcus / Spark-Structured-Streaming-Examples
  Spark Structured Streaming / Kafka / Cassandra / Elastic
  ☆183Updated 2 years ago
• airflow-plugins / pandora-plugin
  Plugin offering views, operators, sensors, and more developed at Pandora Media.
  ☆26Updated 7 years ago
• teamclairvoyant / airflow-user-management-plugin
  A plugin for Apache Airflow that allows you to manage the users that can login
  ☆14Updated 5 years ago
• sourygnahtw / hadoopUtils
  ☆26Updated 9 years ago
• TargetHolding / pyspark-elastic
  PySpark for Elastic Search
  ☆55Updated 8 years ago
• airbnb / reair
  ReAir is a collection of easy-to-use tools for replicating tables and partitions between Hive data warehouses.
  ☆282Updated 6 years ago
• banzaicloud / spark-metrics
  Spark metrics related custom classes and sinks (e.g. Prometheus)
  ☆183Updated 2 years ago
• JerryLead / MyNotes
  Self-written notes that may be useful
  ☆107Updated 9 years ago
• qubole / presto-udfs
  Plugin for Presto to allow addition of user functions easily
  ☆119Updated 4 years ago
• KeithSSmith / spark-compaction
  File compaction tool that runs on top of the Spark framework.
  ☆59Updated 6 years ago
• geosolutions-it / evo-odas
  Code Repository for the EVO-ODAS
  ☆32Updated 7 years ago
• michalmiklas / atlas-docker
  docker for apache-atlas embedded-cassandra-solr
  ☆23Updated 5 years ago
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆185Updated 2 years ago
• phatak-dev / spark2.0-examples
  Examples of Spark 2.0
  ☆211Updated 3 years ago
• danielvdende / data-testing-with-airflow
  ☆199Updated last year