godatadriven / airflow-helm
☆11Updated 5 years ago
Alternatives and similar repositories for airflow-helm:
Users that are interested in airflow-helm are comparing it to the libraries listed below
- Airflow on Kubernetes Operator☆89Updated 2 years ago
- Helm chart for deploying Apache Airflow in kubernetes☆19Updated 5 years ago
- The sane way of building a data layer in Airflow☆24Updated 5 years ago
- Example Set up For DBT Cloud using Github Integrations☆11Updated 5 years ago
- Ansible playbooks for Apache Spark on kube☆27Updated 7 years ago
- 📆 Run, schedule, and manage your dbt jobs using Kubernetes.☆24Updated 6 years ago
- Terraform script for launching multiple EMR clusters for training purposes.☆16Updated last year
- Utility functions for dbt projects running on Spark☆33Updated 2 months ago
- Data validation library for PySpark 3.0.0☆33Updated 2 years ago
- 🐋 Docker image for AWS Glue Spark/Python☆23Updated last year
- Export Airflow metrics (from mysql) in prometheus format☆29Updated 3 weeks ago
- Repository containing Cloud Storage Connectors for Apache Kafka®☆28Updated this week
- Automatically loads new partitions in AWS Athena☆18Updated 4 years ago
- Composable filesystem hooks and operators for Apache Airflow.☆17Updated 3 years ago
- Yet Another (Spark) ETL Framework☆21Updated last year
- Bare minimal Airflow on Kubernetes (Local, EKS, AKS)☆53Updated 5 years ago
- Code that was used as an example during the Data+AI Summit 2020☆15Updated 4 years ago
- A K8s-based infrastructure for analytics☆24Updated 5 years ago
- A Helm Chart for Apache Airflow☆14Updated 6 years ago
- Pylint plugin for static code analysis on Airflow code☆93Updated 4 years ago
- Library which aim to generate kubernetes yamls templates from an Airflow dag using the Airflow Kuberntes Pod Operator☆10Updated 3 years ago
- M3D Engine is a Spark application for the development of scalable data transformations and ingestions in data lakes.☆18Updated 4 years ago
- DataHub on AWS demonstration resources☆10Updated 2 years ago
- Contains example dags and terraform code to create a composer with a node pool to run pods☆13Updated 4 years ago
- ☆24Updated 5 years ago
- PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection☆18Updated 8 years ago
- Ansible roles to deploy Kubernetes, JupyterHub, Jupyter Enterprise Gateway and Spark on Kubernetes cluster☆39Updated 4 years ago
- Data Profiler for AWS Glue Data Catalog application as described in the AWS Big Data Blog post "Build an automatic data profiling and rep…☆19Updated 4 years ago
- ☆96Updated last year
- a pytest plugin for dbt adapter test suites☆19Updated last year