pysysops / docker-luigi-taskrunner

Related projects ⓘ

Alternatives and complementary repositories for docker-luigi-taskrunner

• ychantit / airflow_aws_utils
  A collection of airflow sample workflows for data processing on aws
  ☆12Updated 6 years ago
• shaypal5 / s3bp
  Read and write Python objects to S3, caching them on your hard drive to avoid unnecessary IO.
  ☆24Updated 6 years ago
• blue-yonder / airflow-plugin-demo
  Example for an airflow plugin
  ☆49Updated 8 years ago
• treasure-data / luigi-td-example
  Example Repository for Building Complex Data Pipeline with Luigi +TD
  ☆24Updated 9 years ago
• Houzz / hubot-luigi
  Luigi Plugin for Hubot
  ☆35Updated 8 years ago
• wrobstory / malort
  JSON -> Relational DB Column Types
  ☆64Updated last year
• axonchisel / ax_metrics
  "BI Glue" Business Intelligence middleware library for aggregation of metrics/KPI from any source and custom reporting for humans or othe…
  ☆10Updated 9 years ago
• bonzanini / luigi-slack
  Slack notifications for the Luigi workflow manager
  ☆46Updated 3 years ago
• unruly / terraform-aws-airflow
  Terraform module for a PostgreSQL-backed Apache Airflow instance
  ☆24Updated 6 years ago
• industrydive / fileflow
  Airflow plugin to transfer arbitrary files between operators
  ☆78Updated 6 years ago
• blaze / datafabric
  A distributed in-memory fabric based on shared-memory blocks and datashape. Any language can operate on the data.
  ☆13Updated 8 years ago
• groupon / luigi-warehouse
  A luigi powered analytics / warehouse stack
  ☆87Updated 7 years ago
• alexvanboxel / airflow-gcp-k8s
  ☆54Updated 7 years ago
• LREN-CHUV / ansible-airflow
  Ansible role for the installation of Apache Airflow
  ☆18Updated 4 months ago
• Yelp / data_pipeline_avro_util
  Provides a Pythonic interface for reading and writing Avro schemas
  ☆26Updated 2 years ago
• snowplow / snowplow-python-analytics-sdk
  Python SDK for working with Snowplow enriched events in Spark, AWS Lambda et al.
  ☆21Updated last year
• axiom-data-science / docker-luigi
  🐍 🐳 Luigi in Docker - alpine and ubuntu images available
  ☆50Updated 3 years ago
• hudl / luigi-monitor
  Send summary messages of your Luigi jobs to Slack
  ☆46Updated 5 years ago
• capless / docb
  Opinionated Python ORM for DynamoDB
  ☆27Updated 5 years ago
• jwplayer / sparksteps
  CLI tool to launch Spark jobs on AWS EMR
  ☆67Updated last year
• singer-io / target-stitch
  A Singer.io Target for the Stitch Import API
  ☆26Updated last week
• Yelp / yelp_uri
  Utilities for dealing with URIs, invented and maintained by Yelp.
  ☆14Updated last year
• wrobstory / sticky
  IPython Notebook + D3
  ☆128Updated 9 years ago
• blue-yonder / postgraas_server
  Postgraas is a super simple PostgreSQL-as-a-service
  ☆29Updated 4 years ago
• airflow-plugins / airflow_api_plugin
  REST-like API exposing Airflow data and operations
  ☆61Updated 5 years ago