uday07 / Airflow-Demo
Demonstration workflows for hadoop batch jobs
☆8Updated 9 years ago
Alternatives and similar repositories for Airflow-Demo:
Users that are interested in Airflow-Demo are comparing it to the libraries listed below
- Airflow script for incremental data import from Mysql to Hive using Sqoop.☆18Updated 6 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 5 years ago
- A light Kafka to HDFS/S3 ETL library based on Apache Spark☆41Updated 7 years ago
- Structured Streaming Machine Learning example with Spark 2.0☆92Updated 7 years ago
- A plugin for Apache Airflow that allows you to manage the users that can login☆14Updated 5 years ago
- A collection of Hive UDFs☆75Updated 4 years ago
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆174Updated last year
- Learn the pyspark API through pictures and simple examples☆169Updated 4 years ago
- A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.☆96Updated 4 years ago
- Hive UDFs for funnel analysis☆84Updated last year
- Simple Spark example of generating table stats for use of data quality checks☆28Updated 7 years ago
- ElasticSearch integration for Apache Spark☆47Updated 8 years ago
- Python client for Hadoop® YARN API☆109Updated 2 years ago
- Python client for Spark Jobserver Rest API☆39Updated 4 years ago
- Airflow workflow management platform chef cookbook.☆70Updated 5 years ago
- Plugin for Presto to allow addition of user functions easily☆116Updated 3 years ago
- A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability☆232Updated 2 years ago
- Lightweight Azkaban client☆77Updated 5 years ago
- A Spark Streaming job reading events from Amazon Kinesis and writing event counts to DynamoDB☆94Updated 4 years ago
- A collection of examples using flinks new python API☆243Updated 6 years ago
- PySpark for Elastic Search☆55Updated 7 years ago
- Spark Extension : ML transformers, SQL aggregations, etc that are missing in Apache Spark☆147Updated 9 years ago
- DataQuality for BigData☆143Updated last year
- GeoIP Functions for hive☆48Updated 4 years ago
- Tools for spark which we use on the daily basis☆64Updated 4 years ago
- A tool and library for easily deploying applications on Apache YARN☆142Updated 10 months ago
- Example unit tests for Apache Spark Python scripts using the py.test framework☆85Updated 8 years ago
- Python DB-API client for Presto☆239Updated last year
- Based off the design of SparkOnHBase. This Repo will support Spark, Spark Streaming, and Spark SQL integration with Kudu.☆50Updated 8 years ago
- Example for an airflow plugin☆49Updated 8 years ago