dunnhumby / democratizing-dataprocLinks
Using terraform, deploy multiple dataproc clusters using a shared hive metastore
☆15Updated 3 years ago
Alternatives and similar repositories for democratizing-dataproc
Users that are interested in democratizing-dataproc are comparing it to the libraries listed below
Sorting:
- Example stream processing job, written in Scala with Apache Beam, for Google Cloud Dataflow☆30Updated 8 years ago
- Tools for creating Dataproc custom images☆34Updated 2 weeks ago
- ☆54Updated 7 years ago
- ☆46Updated last year
- The sane way of building a data layer in Airflow☆24Updated 5 years ago
- Tools to deploy Hadoop on EMC Isilon☆17Updated 8 years ago
- Airflow workflow management platform chef cookbook.☆71Updated 6 years ago
- Snippets of code used in blog posts and other media.☆13Updated this week
- Repo for the Stitch Docs☆57Updated 2 weeks ago
- Data Catalog Tag Templates☆30Updated 2 months ago
- Opinion Analysis of News, Threaded Conversations, and User Generated Content☆103Updated 9 months ago
- Collection of utility scripts to extract code so it can be upgraded to SnowFlake using the SnowConvert tool.☆20Updated this week
- A toolset to streamline running spark python on EMR☆20Updated 8 years ago
- Puppet module to provision Airbnb's Airflow☆19Updated 3 years ago
- Terraform script for launching multiple EMR clusters for training purposes.☆16Updated last year
- Multi Cloud Data Tokenization Solution By Using Dataflow and Cloud DLP☆93Updated 11 months ago
- This is the support code and solutions for the NYC Taxi Tycoon Dataflow Codelab☆61Updated 5 years ago
- Apiary provides modules which can be combined to create a federated cloud data lake☆36Updated last year
- An extension for Jupyter notebooks that allows running notebooks inside a Docker container and converting them to runnable Docker images.☆28Updated last year
- Repository with examples and smoke tests for the GCP Airflow operators and hooks☆148Updated 8 years ago
- A framework for systematically quality controlling big data.☆41Updated 2 years ago
- ODPi specifications, developed by ODPi Runtime and ODPi Operations projects. Currently in Emeritus status☆35Updated 6 years ago
- Data pipeline is a tool to run Data loading pipelines. It is an open sourced app engine app that users can extend to suit their own needs…☆87Updated 11 years ago
- ☆33Updated last year
- Apache NiFi Custom Processor Extracting Text From Files with Apache Tika☆35Updated last year
- Styles for dbt on the net☆10Updated 7 months ago
- AWS bootstrap scripts for Mozilla's flavoured Spark setup.☆47Updated 5 years ago
- Ephemeral Hadoop clusters using Google Compute Platform☆136Updated 3 years ago
- GCP extensions for Jupyter and JupyterLab☆56Updated 3 months ago
- Ansible role to deploy and configure Airflow☆41Updated 3 weeks ago