similarweb / puppet-airflow

Related projects ⓘ

Alternatives and complementary repositories for puppet-airflow

• bernhard-42 / pyspark-atlas
  PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection
  ☆18Updated 7 years ago
• jwplayer / sparksteps
  CLI tool to launch Spark jobs on AWS EMR
  ☆67Updated last year
• joerg-schneider / airtunnel
  The sane way of building a data layer in Airflow
  ☆24Updated 4 years ago
• michaelosthege / fairflow
  Functional Airflow DAG definitions.
  ☆38Updated 7 years ago
• alexvanboxel / airflow-gcp-k8s
  ☆54Updated 7 years ago
• sportebois / aws-ec2-ssh-sync
  Terraform samples to sync and use IAM users ssh keys to connect to EC2 instances
  ☆13Updated 5 years ago
• PBWebMedia / airflow-prometheus-exporter
  Export Airflow metrics (from mysql) in prometheus format
  ☆29Updated 2 years ago
• industrydive / fileflow
  Airflow plugin to transfer arbitrary files between operators
  ☆78Updated 6 years ago
• dimajix / terraform-emr-training
  Terraform script for launching multiple EMR clusters for training purposes.
  ☆16Updated last year
• adamgilman / stairstep
  A Pythonic API for Amazon's States Language for defining AWS Step Functions
  ☆8Updated last year
• infOpen / ansible-role-airflow
  Ansible role to deploy and configure Airflow
  ☆41Updated 3 weeks ago
• Houzz / hubot-luigi
  Luigi Plugin for Hubot
  ☆35Updated 8 years ago
• EntilZha / spot-price-reporter
  Fetch and plot AWS spot pricing history
  ☆23Updated 8 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆68Updated 5 years ago
• azavea / terraform-aws-emr-cluster
  A Terraform module to create an Amazon Web Services (AWS) Elastic MapReduce (EMR) cluster.
  ☆39Updated 5 years ago
• IntegriChain1 / s3parq
  Parquet file management in S3 for Athena / Spectrum / Presto partitioning
  ☆22Updated this week
• atlassian / themis
  Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)
  ☆47Updated 11 months ago
• yodasco / pyspark-emr
  A toolset to streamline running spark python on EMR
  ☆20Updated 8 years ago
• quiltdata / t4
  T4 is now in production as Quilt 3
  ☆64Updated 5 years ago
• snowplow / kinesis-tee
  Unix tee, but for Kinesis streams
  ☆12Updated 3 years ago
• pysysops / docker-luigi-taskrunner
  Docker container to make running Luigi tasks real easy.
  ☆11Updated 8 years ago
• ychantit / airflow_aws_utils
  A collection of airflow sample workflows for data processing on aws
  ☆12Updated 6 years ago
• Yelp / data_pipeline_avro_util
  Provides a Pythonic interface for reading and writing Avro schemas
  ☆26Updated 2 years ago
• wrobstory / malort
  JSON -> Relational DB Column Types
  ☆64Updated last year
• jrderuiter / airflow-fs
  Composable filesystem hooks and operators for Apache Airflow.
  ☆17Updated 3 years ago
• pdeyhim / spark-emr
  spark-emr
  ☆14Updated 10 years ago
• nteract / coffee_boat
  ☕⛵WIP PySpark dependency management
  ☆22Updated 6 years ago