uday07 / Airflow-Demo
Demonstration workflows for hadoop batch jobs
☆8Updated 9 years ago
Alternatives and similar repositories for Airflow-Demo:
Users that are interested in Airflow-Demo are comparing it to the libraries listed below
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 5 years ago
- Airflow script for incremental data import from Mysql to Hive using Sqoop.☆18Updated 6 years ago
- A collection of Hive UDFs☆75Updated 5 years ago
- A light Kafka to HDFS/S3 ETL library based on Apache Spark☆41Updated 7 years ago
- Example for an airflow plugin☆49Updated 8 years ago
- A plugin for Apache Airflow that allows you to manage the users that can login☆14Updated 5 years ago
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆174Updated last year
- A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability☆234Updated 2 years ago
- Lightweight Azkaban client☆77Updated 5 years ago
- Python client for Hadoop® YARN API☆109Updated 2 years ago
- hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.☆28Updated 7 years ago
- Example unit tests for Apache Spark Python scripts using the py.test framework☆84Updated 9 years ago
- Plugin offering views, operators, sensors, and more developed at Pandora Media.☆26Updated 7 years ago
- Plugin for Presto to allow addition of user functions easily☆117Updated 4 years ago
- Send summary messages of your Luigi jobs to Slack☆46Updated 6 years ago
- A tool and library for easily deploying applications on Apache YARN☆143Updated last year
- NexR Hive UDFs☆111Updated 9 years ago
- ☆63Updated 5 years ago
- A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.☆96Updated 4 years ago
- CLI tool to launch Spark jobs on AWS EMR☆67Updated last year
- Example project showing how to use Hive UDFs in Apache Spark☆55Updated 6 years ago
- Updated repository☆157Updated 3 years ago
- PySpark for Elastic Search☆55Updated 8 years ago
- A Spark Streaming job reading events from Amazon Kinesis and writing event counts to DynamoDB☆94Updated 4 years ago
- Structured Streaming Machine Learning example with Spark 2.0☆92Updated 8 years ago
- Spark SQL UDF examples☆56Updated 7 years ago
- Learn the pyspark API through pictures and simple examples☆170Updated 4 years ago
- GeoIP Functions for hive☆48Updated 4 years ago
- Parcel for Apache Airflow☆17Updated 5 years ago
- A pure Python implementation of Apache Spark's RDD and DStream interfaces.☆269Updated 8 months ago