teamclairvoyant / airflow_demo
Airflow script for incremental data import from Mysql to Hive using Sqoop.
☆18Updated 6 years ago
Related projects ⓘ
Alternatives and complementary repositories for airflow_demo
- Demonstration workflows for hadoop batch jobs☆8Updated 8 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆75Updated 5 years ago
- A plugin for Apache Airflow that allows you to manage the users that can login☆14Updated 5 years ago
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆81Updated 4 years ago
- Parcel for Apache Airflow☆17Updated 5 years ago
- This repository is to help with the Partner Demonstration of the Apache Atlas project.☆30Updated 9 years ago
- hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.☆28Updated 6 years ago
- Example for an airflow plugin☆49Updated 8 years ago
- A light Kafka to HDFS/S3 ETL library based on Apache Spark☆41Updated 7 years ago
- Airflow workflow management platform chef cookbook.☆68Updated 5 years ago
- REST-like API exposing Airflow data and operations☆61Updated 5 years ago
- Druid service descriptor and parcel for Cloudera CDH5☆32Updated 5 years ago
- Sample Spark Streaming application for secure consumption from Kafka☆33Updated 7 years ago
- Example of use of Spark Streaming with Kafka☆90Updated 10 years ago
- CSD for Apache Airflow☆20Updated 5 years ago
- Demos around Ambari Views, Services, Blueprints☆63Updated 8 years ago
- A collection of Hive UDFs☆75Updated 4 years ago
- A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability☆232Updated 2 years ago
- Collection of tools for bootstrapping Apache Ambari & deploying clusters☆83Updated 5 years ago
- Vagrant project to spin up a single virtual machine running current versions of Hadoop, Hive and Spark☆75Updated 5 years ago
- Support Highcharts in Apache Zeppelin☆81Updated 7 years ago
- Demonstrates how to submit a job to Spark on HDP directly via YARN's REST API from any workstation☆24Updated 8 years ago
- Vagrant files creating multi-node virtual Hadoop clusters with or without security.☆67Updated 4 years ago
- Hive UDFs for funnel analysis☆84Updated last year
- Workshops on how to setup security on Hadoop using HDP sandboxes☆99Updated 6 years ago